If you aren't kidding about your wife, don't go. If you can't depend on your only crew you can be in serious trouble. You will be single handing while carrying a passenger. While a single hander accepts the risks of his(or her) adventure I would be reluctant to impose those risks on a passenger who hasn't the knowledge or experience to understand them. Daysailing is one thing but passages are long, can be tedious and can become very uncomfortable. If you're not in it together, it will be tough.
You have to remember I am pilot. I take on this responsibility each time I take off. I fly all over the US with my family, kids and grandkids. It is a huge responsibility, but one that is well worth it. Have you ever seen Niagara Falls from the air? I have been there twice on the ground and was not that impressed. the time I flew over it though opens your eyes to a whole new experience. Flying to the Bahamas in my four seater is not out of the question for me so I would not think that sailing there would be any different.
Each time you get into a car you put yourself at risk. In my opinion far more risk that if you take off in your own plane. Done correct I think sailing can be even less risk.