You can surely approach the Turkish coast,
anchor offshore or near a remote pier by a taverna where you have dinner and stay overnight (e.g. in Hisaronu Gulf or at Serce Limani, after the island of Symi) without calling at a port or a marina. I did it the other way round
just one week ago, on a yacht that we sailed off from
Gocek,
Turkey, and anchored at
Kastellorizon island,
Greece. The harbour authorities and marinas in Turkey were keen collecting the fees (a little less than € 50 for a 45-footer), while in Greece they didn't show up at all, so the money could be spent on a delicious fish soup instead (3.8 kg of fish for six hungry sailors)!