The delete-volume annotation must be removed when re-binding a persistent volume
Consider the following scenario:
- PV is in use
- user deletes PVC by mistake and asks support to recover it
- we reconnect the same PV to a new PVC so user gets back his data
- several months later, the project is deleted
If the volume reclaimer runs between steps 2. and 3., it will leave a volume-ready-to-delete.cern.ch/delete-volume annotation on the PV. After step 4., the date on the delete-volume annotation will be passed and volume will be deleted immediately instead of entering the grace period!
We already had this issue with NFS volumes. This was addressed by documenting the PV recovery process. It needs to be addressed for cephfs volumes as well (a procedure similar to NFS is fine, please make sure it has been tested in openshift-test!)