What an unpleasant man.
I expect that if you start working now, in 3 months time you will have forgotten about your financial stress, and also about him, and feel like it was the best decision you ever made.
Seems like you're at the point I think many of us reached, where you've spent a few weeks/months thinking about it, done all the research, and made the careful decision that working as an escort will be a good thing for you. Then as you reach the starting line, you're full of butterflies and it makes you want to bottle it, makes you question and doubt everything...
It's like ripping of a big plaster, just go for it, and most of your worries will melt away very quickly. I wish you the best of luck whatever you do.