The problem I sometimes have with it is if someone asks to make an appointment and I say yes I have time then during the call I think he's a creep and change my mind. Can be a bit awkward but I say something like oh actually I have someone booked shortly after so it might be a bit too close, or that I'm out, hoping they don't then say ok a bit later then.