You are a business not a charity, put your foot down.
Tell him these are your rates and these are the hours that cover those rates, if he does not like it, I would suggest he finds someone else.
If you give in it will only make him think he can abuse his power as a punter because he assumes you need the money, I would be insulted.