Skip to content

Add maxFilesPerJob to ATLAS tasklist handlers.

Karol Krizka requested to merge kk_addmaxfilesperjob into master

Add a new option (maxFilesPerJob) to the ATLAS tasklist handlers that combines multiple input files into a single task. This is the opposite of the maxEventsPerJob option, which splits an input file into multiple jobs.

The two options cannot be mixed. The latter takes precedence if both are specified.

Notes on technical implementation: Introduced three new generator functions (tasklist_simple, tasklist_nevents and tasklist_nfiles) that take a filelist as input and give tasks as output. Each function corresponds to different "grouping" mechanisms. They are used by both the TransformTaskList and AthenaTaskList handlers. Any options that are different between the handlers (ie: athena expects maxEvt while Reco_tf expects maxEvents) are passed as arguments.

Edited by Karol Krizka

Merge request reports