Oh yeah, if you don't use it, plug the holes. It's a problem waiting to happen. I found adding rubber mounts helped quite a bit.

Locktite would probably keep the screws in, just as well. I just got a new fuel tank gasket for my bike, it came with pre-locktited screws.