Yes, infuriating. Most of them don't mean anything by it, they're just not very good at appropriate small talk. I usually say something that's an obvious lie, like "you're the 25th today, so I'm halfway through my day". I say it with a smile, and most of them get the message.