What about taking off the latches? Remember the latches have to be secure, so they have to be on tight ot the vehicle. Therefore when you're trying to pull them off, it isn't going to come off easily.

I like the magnetic latches idea, but it should be an electromagnetic latch. Then it would be a good idea, at least, personally.