I have only been in Hyannis once. so I don't know any better.
Going to Legal Seafood is a safe bet for the out of towner. I have been going there for the last twenty years. It is comforting since I know what I will get.
I guess just like Philip Seafood here in Maryland/DC areas, everyone visiting me wants to go there. But I have NOT been there on my own for years.