I rented a flat for a week where the landlord knew what I did. He told me I’d need to collect clients as the intercom wasn’t working.
This didn’t bother me, but the neighbour had a ring doorbell and she complained about all the clients coming and going.
Now, only being there for a week meant it wasn’t a problem, but in the long term it would have been disastrous.
I wouldn’t leave a key as you are opening yourself up to security problems.
I honestly wouldn’t rent a place long term that wasn’t suitable. You can always muddle through for a few days if you’re on tour and have to make do, but long term, I wouldn’t take the risk.