It's happened to me, I'll usually stand my ground and they'll back off when they realise I won't respond to their bully tactics though you can end up in very scary situations. If they pulled a knife on me or were seriously threatening to attack me or break my stuff I'd just give them the money since I can make money again but can't if I get a serious injury and end up in hospital. Your health is worth more than a bookings worth of earning anyway.
Don't just do it anytime somebody gets demanding though most of them are cowards and opportunists who will give it a go but won't do anything if you tell them to get lost or start calling the police. They soon bolt out the door when you don't make it easy.