My Yanmar is 8hp as well, YSE8. Not the best engine for pushing into a choppy sea but adequate for normal use. Sailboats had smaller engines 30 years ago than they do now.
All small diesels are fairly noisy - all the more reason to sail. If there is no sound absorbent lining to the engine compartment it can be added.
Living aboard in Victoria Harbour