This is a reasonably common issue within the escort community. There isn't an awful lot you can do, for every business, there is a competitor trying to drag you down. The police would be very unlikely to contact your landlord anyway. If your landlord does find out, which I find unlikely, you have the option to deny it. Don't show your face on your ads, or make them too distinctive.
When you've been doing this a while, your competition will give up and move on to the next person. When you're new, it's all a bit overwhelming. But you do get used to it and become better quipped to deal with it.