Question

Which is the simplest way to permanently get rid of an unwanted file

Answer 1

Go to system files, find the file and destroy the whole thing or just what you dont want. ;]

Answer 2

I guess you could take the file and drag it to your trash can and then you could clear your trash can.