Skip to content

[master] Add option to transformation-debug to automatically exclude runs

This option allows to exclude from run checks those runs that are in status Unused, Problematic, Assigned, MaxResetin another transformation. This allows to check why runs are not flushed in merging productions, excluding runs that cannot be flushed because files are in the above statuses in the stripping production...

Example:

[localhost] ~ $ dirac-transformation-debug --Status Unused --Info flush 103804 --Except 103803
 Transformation 103804 (Active) of type Merge (plugin ByRunFileTypeSizeWithFlush, GroupSize: 5) in Real Data/Reco16/Stripping28r2
BKQuery: {'EventType': 90000000L, 'FileType': ['BHADRON.MDST', 'BHADRONCOMPLETEEVENT.DST', 'CHARM.MDST', 'CHARMCOMPLETEEVENT.DST', 'DIMUON.DST', 'EW.DST', 'LEPTONIC.MDST', 'LOWMULT.DST', 'SEMILEPTONIC.DST'], 'ProductionID': 103803L, 'DataQualityFlag': 'OK'}

2 runs found: 185498,185522
Runs 184916,184925,184939,185006,185019,185074,185109,185199,185321,185335,185405,185411,185440,185446,185478,185513,185526 excluded: they have non-processed files in production 103803
Run: 185498 (Active) - 810 files (197 files in no task, 0 tasks, SelectedSite: ['CNAF-BUFFER']), 613 processed, status: Active
Run not flushed: 101 ancestors found for BHADRON.MDST,BHADRONCOMPLETEEVENT.DST,CHARM.MDST,CHARMCOMPLETEEVENT.DST,DIMUON.DST,EW.DST,LEPTONIC.MDST,LOWMULT.DST,SEMILEPTONIC.DST;  while 102 RAW files
Missing RAW files:
	/lhcb/data/2016/RAW/FULL/LHCb/COLLISION16/185498/185498_0000000943.raw
197 files found with status ['Unused'] in run 185498
Edited by Philippe Charpentier

Merge request reports