Skip to content

[v29] automatic job splitting for splitting files, logging names

Andre Sailer requested to merge sailer/ILCDIRAC:v29_splitSkip into Rel-v29r0

BEGINRELEASENOTES

*Interfaces
NEW: New automatic job splitting function to split one file across multiple jobs :func:~ILCDIRAC.Interfaces.API.NewInterface.UserJob.setSplitFilesAcrossJobs
NEW: New function to set the job indices to use for automatic job splitting: :func:~ILCDIRAC.Interfaces.API.NewInterface.UserJob.setSplitJobIndexList
CHANGE: The name of the loggers has changed, the output will be more hierarchical
CHANGE: :func:ILCDIRAC.Interfaces.DiracILC.runLocal is used from DIRAC interfaces again, as the patches to run with LFNs in inputsand boxes have been ported to upstream

*Workflow
CHANGE: The number of events to process is no longer always taken from the FileCatalog when defined, only when it is not set explicitly, this change is necessary when trying to split production files, which have the NumberOfEvents metadata defined
CHANGE: The name of the loggers has changed, the output will be more hierarchical

*Docs: CHANGE: The overview pages for packages has change to index

ENDRELEASENOTES

Merge request reports