Please don't let this discourage you from sailing or single-handing. It will take a few trips*, but it feels pretty good to pull off a smartly executed single-hand tack.
It's even better if someone sees it!
Don't wear a swimsuit (that's a defeatist approach) but make sure your wallet and cell phone are somewhere dry and safe.
Good Luck! Keep us posted.
*and maybe another unscheduled swim call or two.