Two years ago, I left Belhaven, NC, with Davit and his brother, the first week of November. We headed south to St Augustine, FL and ended up getting into St Augustine two days before Thanksgiving. The days were cold (60's), and the nights were even colder (30's). The first day that it was decent enough to wear shorts and a tee shirt was the day we got into St Augustine.
I have a set of foul weather gear that's kind of like yours. I had a tee shirt, sweatshirt, polar fleece jacket, and a mid range rain jacket from West Marine stocking cap, and gloves. My rain pants were from REI, and under them, I wore poly propylene long underwear and sweat pants I was comfortable the whole trip, but could have bad a little more coverage for my hands and feet.
Once you get past Cape Canaveral, The weather should be warm enough to get into something a little lighter.
It could be warmer this year though. Have a great trip.