If they want to kick you out, hotels/apartment companies can find any reason under the sun based on their standard t&cs to justify their decision. Depends on the particular t&cs but I am sure they can find something and have their backs covered. As long as you are noticed it may be for non 'appropriate' conduct, causing 'offence' to other guests or staff according to their 'reasonable' opinion, even on the basis of health and safety for not identifying and registering your visitors. They will also have legal resources available.
Harassing you is unacceptable but you also need to be careful of how you conduct yourself from the moment they give you notice, so that at least they can't object to any complaints about that.