I'm guessing it will affect the boats windward performance A LITTLE, but probably not enough to worry about. I believe the 37's board is non-ballasted like the 34's and adds basically nothing to her stability. There are a lot of these boats that have had problems with the CB and the owners just removed them. On the bright side you won't have to worry about any maintenance or repairs on the board, pivot, or its control mechanism.
Maxum 3200 Miss Adventure
Formerly - Tartan 34C Yawl