I've tried the Beppy before, which worked fine... until I had to get it out. It was up there for 3 days before a friend convinced me to let her take it out. It was quite... traumatising, to have it up there for so long. I would have gone to Emergency is she wasn't able to get it out, but from her angle and with her nails it was easy. I'll have to try some of the tips here to get it out again next time.
At the moment I'm just skipping the sugar pills of the contraceptive. I'll do skip them for 3 months, and then "let" my body have a period. I'll be off for a full week with a heavy period, but it's better than dealing with it every 3 weeks. Stuff that.