I had not thought about LI shore as an option. It would be faster than the 3 hour drive but probably only by 1 hour (each way). There is the added complication that the Port Jefferson Ferry does not run 24/7.
On a related note: I saw on Craigslist a private slip for sale on Housatonic. I wonder if that is taxable property like a house, car or boat trailer?