Actually delete the file we wanted to, and also the metadata signature, which is no longer valid