It would be a lot easier to qualify that statement if we knew the type of boat and typical conditions at time of race.
My boat does well in light wind flat water races compared to heavier boats which do well in choppier and windier days. This is because PHRF is a rating over a broad range of wind conditions.
Maybe your boat is heavy and not well suited for evening races in a dying breeze. Oh well ... in that case practice in those situations and Kick ass in thise favourable to your boat.
The other things to consider are that your boat is probably outfitted for cruising. That would mean roller furling headsails that are cut high above the deck and do not have the performance of the rating adjustments their size brings to your boat. Similarly roller furling mains, etc... do not give much of a credit under PHRF, etc...
Your boat would probably do well if it was outfitted for racing ....
That being said many clubs have local handicapping for club races to take a lot of that into account...
Do what a friend does. Race locally on a friend''s racing boat and cruise on your own boat. A lot cheaper that way!