I understand why it might have rattled you.
Myself, if I work past 9pm then they need to have an AW booking in place with feedback on their profile. I have occasionally worked really late calls but they do tend to be with piss heads or coked up idiots. I personally find the coke heads hard work as they just can't get it up, mind you they do chuck lots of money at you extending their time thinking they may eventually get hard.
If something makes you feel uneasy then trust your instinct and don't do it.