The eastern end of Long Island Sound (Fishers Island Sound) isn’t so bad and neither is the rest of the coastal SE New England area. You can actually swim in this area for an order of magnitude longer than in Maine without suffering hypothermia. A MOB actually has a chance of being rescued alive if not in a wet suit.
You can actually cruise to areas with sandy beaches, like Long Island, Napatree Point, Block Island, Third Beach, Cape Cod and “the islands”(Cutthyhunk, Marthas Vineyard, Nantucket). And you won’t be lonely in any of the harbors in this venue.
P.S. You can actually enjoy the scenery instead of concentrating on dodging lobster gear. (Well, maybe there is the occasional fishing trawler or barge under tow.)