I too have Too-Much-Stuff-itis however I do make a concerted effort to always have everything put away. That way if it doesn't have a place stowed, out it goes.
There are exceptions -- at present my lentil sprouts still do not have a permanent home that would work when underway. It's one of the innumerable projects though for now I put them in the top shelf of the reefer. Storing them in the refrigerator is not ideal but it's the best I can do for the time-being.
And in the heat, it's not a horrible temporary solution.
I do have a home for everything though -- it's always been a practice to go from "at anchor" to "underway" in less than 15 minutes. That's the way I was raised (aboard a 40'er) and it's natural to keep up the same process on my boat.
If your stuff is stored so you can use your boat at a moment's notice, I see no problem with the junk. You can get rid of it as is convenient.
That said, one thing that drives me NUTS when I'm working on boats is to be handed a screw with a torn up end. Or a bent one. Really, if the doggone thing can't be tightened down or is not straight, please, get rid of it today. Immediately!
Now I wouldn't keep a broken temperature gauge but I did keep the oil pressure sending unit (failed) when I replaced it with a new one. On the bright side, with the addition of JB Weld, the old one didn't leak any more so my "fix" actually did work. It didn't tell psi though.