I am going to be the lone voice of dissent... For what it sounds like you will be using the boat for, the Hunters will be just fine. A lot of the Hunters from that era sail pretty well and are fast boats. They are a great value regardless of what anyone here would have you believe. Also, I would rather have a 20 year old well cared for Hunter than a neglected 20 year old higher initial quality boat any day (especially for the price I would pay). The survey should tell you what you need to know.
There are a ton of happy hunter owners out there - they are the largest manufacturer in the US and have a lot of repeat business (Catalina is probably close to same size as well).
You would be well served to ask the same question on the hunterowners forum -
Hunter Owners.com for owners sailing production sailboats. You may get an answer there from actual owners of those particular boats which may help in your decision making process.