It sounds like both of you were thinking of different things. The boat was safe although sail reduction would usually be desirable. Most standard sails are set for 15 knots and by 25 require a halving of sail area for the same force.
The child's safety was a concern. He or she could easily fly from one side to the other and break something, unless wedged in a quarterberth which would not be pleasant.
Even being in a cockpit with short tacking going on in 25 knots would not be great, if your legs would not reach the floor and you could not brace yourself let alone relying on the child to change sides at the right time versus starting late and being thrown against the cockpit sides easily breaking something.
Sometimes spouses have been known to say unkind things when stressed and defensive. So I hear.