I once had the same theory whats all this extra lead in my bilge needed for it will just slow me down,so I took it out,next time out sailing got hit by a gust and the mast head was in the water it took a couple of minutes to self right,not a fun experience.So the lead went back in it could have been serious if I was further out to sea.Ballast is there for a reason leave it there.