Hmmm, thinking that mast isn't straight? So how do your halyards hang Chief? Start there, I've seen a host of mast wedgies made for Helms 25'er's fitted inside the mast step at the foot, I just haven't paid a lot of attn. to the 24's, yet... I've got running back stays (you probably don't) so I kind of know mine is bent, when I tell it to be so. Anyway see how it's hanging fore & aft as well as athwartship.
My Helms is a 76 and my Starboard everything is longer/bigger..meaning the hull isn't exactly symetrical, go figure, eh? And on a boat where nothing is plumb either. That may explain your pointing differential...