Yup, all year unless the water gets hard.
I was out (Deale, MD) Saterday and enjoyed an easy 9 kn and no traffic or express cruiser wakes. I do lose my taste for strong wind, spray, and rain until spring.
Exchanging your sunglasses for ski goggles is a good idea, even without spray - much warmer, not just for the eyes but for the who face. Try it.
1 year in 10 we will get enough ice in the harbor, for a few days, that getting out would be trouble. But even that does not last.