Skip to content

PyJobTransforms: Add option to delete unneeded intermediate files

Johannes Elmsheuser requested to merge elmsheus/athena:pyjobtransforms_20211207 into master

As discussed in https://its.cern.ch/jira/browse/ATLASJT-423 this MR adds the --deleteIntermediateOutputfiles option to allow deleting intermediate outputfiles in a multi-step transform. It only deletes (most) input files named tmp* after each individual sub-step.

Keeping this MR in "Draft" status for the moment and tagging @mavogel, @walkerr, @emoyse for their feedback.

Edited by Johannes Elmsheuser

Merge request reports