Do what you feel is best. Your house/flat is supposed to be your home where you feel the most comfortable/relaxed.

is there someone below who never sleeps and listens for everything below ?

I was a semi detached maisonette, not a flat. I had a neighbour below me but she didnt bother me. She did mention she could hear me every now and again, but she was nowhere as problematic as your neighbour. It was my neighbours on the left who I could hear. In fact, the walls were so thin I could hear their neighbours too 

The neighbours on the left didnt complain either - my issue was that I could hear everything - walking, turning on the lights, talking - the fulls works and that made me uncomfy/uneasy. I even recall being woken up to talking - I thought someone has broken in so I went downstairs (to the 1st floor) and it dawned on me then that I could hear the neighbours to my left talking through the wall! I couldnt handle the anxiety so I put it on the market and sold it less then a year after buying it.

I now own a fully detached house and will stick to detached properties until the day I die haha\

Edit: the place I lived prior to that was a mid terraced house. I was there for many years and it was fine. I hear the odd sound but it was nothing in comparison to the maisonette. Even my guests who came to visit were shocked at how thin the walls were. I constantly felt like I was living with room mates who I could never see 

Laughing, about the mates , you never saw lol.

Glad I made you laugh hahaha! It was so true though, FML!

I'm finding it a really anxious time at the moment but going to get my tough head on ..., thanks SO much ! This can make you very lonely sometimes xx

Hope you find solace soon xxx