Chris-
The "color safe bleach" simply isn't bleach. Whatever it is--I don't think it is a biocide like bleach, either, so any mold spores, etc. in the foam are probably still viable.
AFAIK only bleach and peroxide really those critters.
Unless you've got a nice irradiation machine around.