clean up jobs
Summary
When running the corsika production with the temporary storage option enabled. i.e. writing the output temporary at the servers, in case the job is cancelled the temporary directories are not cleaned up. That's expected, since sim_runner can't know the fate of the job. Cancellation of the job can happen either by the user or by the system, if the running time of the job surpasses the limit. In case of failed or successful jobs, the cleanup works fine.
What is the expected correct behavior?
Sim_runner should be able to produce jobs that run in all servers, look for directories based on a user-defined pattern, and delete those directories.