No, gosh what rude people. It is illegal to film without consent. Especially as the content of the film sounds like he captured you bonking or something :S. If anything he could get in trouble, but you are fine, dandy & legal. Maybe they can hear you but if it gets brought up say it would have been nice that you would have came to me first, you feel attacked & know that they have unlawful filming of you. Some people flat out don't know it is legal so you've got nothing to worry about apart from narrow minded neighbours.