Skip to content

[ATR-24630] Add HLTMonitoring JSON as in-file payload, this is to be added to MC POOL

Tim Martin requested to merge tamartin/athena:MonitoringJSONIntoMC into master

Add HLTMonitoring JSON as in-file POOL payload, this is to be added to MC POOL files. We will be running from python for R3 MC so there is no DB.

We don't plan on adding it to data POOL files, for monitoring on data we should always be able to access the DB.

While C++ access is implemented it is a shell, the user would have to access data from the raw ptree object. A nicer interface can be added transparently in the future.

Use:

tamartin@pc-tbed-pub-24.cern.ch$ athena -i
...
athena> from AthenaConfiguration.AllConfigFlags import ConfigFlags
athena> from TrigConfigSvc.TriggerConfigAccess import *
athena> ConfigFlags.Input.Files = ['RDO_TRIG.pool.root']
athena> m = getHLTMonitoringAccess(ConfigFlags)
Py:AutoConfigFlags    INFO Obtaining metadata of auto-configuration by peeking into 'RDO_TRIG.pool.root'
Py:MetaReader        INFO Current mode used: lite
Py:MetaReader        INFO Current filenames: ['RDO_TRIG.pool.root']
Py:MetaReader        INFO MetaReader is called with the parameter "unique_tag_info_values" set to True. This is a workaround to remove all duplicate values from "/TagInfo" key
Py:AutoConfigFlags    INFO Looking into the file in 'peeker' mode as the configuration requires more details: TriggerMenuJson_HLTMonitoring
Py:MetaReader        INFO Current mode used: peeker
Py:MetaReader        INFO Current filenames: ['RDO_TRIG.pool.root']
Py:MetaReader        INFO MetaReader is called with the parameter "unique_tag_info_values" set to True. This is a workaround to remove all duplicate values from "/TagInfo" key
athena> print(m)
OrderedDict([('filetype', 'hltmonitoringsummary'), ('name', 'Dev_pp_run3_v1'), ('signatures', OrderedDict([('egammaMon', OrderedDict([('HLT_e26_lhtight_ivarloose_L1eEM26M', ['online', 'shifter']), ('HLT_e26_lhtight_ivarloose_L1eEM26T', ['online', 'shifter']), ('HLT_e60_lhmedium_L1eEM26M', ['t0']), ('HLT_e140_lhloose_L1eEM26M', ['t0']), ('HLT_e300_etcut_L1eEM26M', ['t0']), ('HLT_e26_lhtight_ivarmedium_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_ivarloose_L1EM22VHI', ['online', 'shifter']), ('HLT_e60_lhmedium_L1EM22VHI', ['online', 'shifter']), ('HLT_e140_lhloose_L1EM22VHI', ['t0']), ('HLT_e300_etcut_L1EM22VHI', ['t0']), ('HLT_e26_dnnloose_L1EM22VHI', ['t0']), ('HLT_e26_dnnmedium_L1EM22VHI', ['t0']), ('HLT_e26_dnntight_L1EM22VHI', ['t0']), ('HLT_e60_dnnmedium_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_gsf_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_gsf_ivarloose_L1EM22VHI', ['t0']), ('HLT_e60_lhmedium_gsf_L1EM22VHI', ['t0']), ('HLT_g140_loose_L1EM22VHI', ['t0']), ('HLT_g300_etcut_L1EM22VHI', ['t0']), ('HLT_g25_medium_L1EM20VH', ['online', 'shifter']), ('HLT_g35_medium_L1EM20VH', ['t0']), ('HLT_g20_tight_icaloloose_L1EM15VHI', ['online', 'shifter']), ('HLT_g22_tight_L1EM15VHI', ['t0']), ('HLT_g50_loose_L1EM20VH', ['t0']), ('HLT_e26_lhtight_ivarloose_e4_etcut_probe_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_ivarloose_e12_lhvloose_probe_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_ivarloose_e17_lhvloose_probe_L1EM22VHI', ['online', 'shifter']), ('HLT_e26_lhtight_ivarloose_e24_lhvloose_probe_L1EM22VHI', ['t0']), ('HLT_e26_lhtight_ivarloose_e26_lhtight_probe_L1EM22VHI', ['t0'])])), ('muMon', OrderedDict([('HLT_mu6_L1MU5VF', ['online', 'shifter']), ('HLT_mu60_0eta105_msonly_L1MU14FCH', ['shifter'])])), ('muonMon', OrderedDict([('HLT_mu26_ivarmedium_L1MU14FCH', ['shifter', 'online']), ('HLT_mu50_L1MU14FCH', ['online', 'shifter']), ('HLT_mu22_mu8noL1_L1MU14FCH', ['online', 'shifter']), ('HLT_2mu14_L12MU8F', ['online', 'shifter']), ('HLT_3mu6_L13MU5VF', ['online']), ('HLT_3mu6_msonly_L13MU5VF', ['online']), ('HLT_4mu4_L14MU3V', ['online']), ('HLT_mu24_LRT_d0loose_L1MU14FCH', ['online']), ('HLT_mu6_msonly_L1MU5VF', ['shifter'])])), ('idMon', OrderedDict([('HLT_mu6_msonly_L1MU5VF', ['t0'])])), ('bJetMon', OrderedDict([('HLT_j225_0eta290_pf_ftf_bdl1d70_preselj180_L1J100', ['online']), ('HLT_j225_0eta290_pf_ftf_bdl1r70_preselj180_L1J100', ['online']), ('HLT_e26_lhtight_ivarloose_2j20_0eta290_020jvt_pf_ftf_boffperf_L1EM22VHI', ['online']), ('HLT_mu26_ivarmedium_2j20_0eta290_020jvt_pf_ftf_boffperf_L1MU14FCH', ['online'])])), ('metMon', OrderedDict([('HLT_xe65_cell_xe90_pfopufit_L1XE50', ['shifter']), ('HLT_xe75_cell_xe65_tcpufit_xe90_trkmht_L1XE50', ['shifter']), ('HLT_xe60_cell_xe95_pfsum_cssk_L1XE50', ['shifter']), ('HLT_xe55_cell_xe70_tcpufit_xe90_pfsum_vssk_L1XE50', ['shifter']), ('HLT_xe65_cell_xe105_mhtpufit_em_subjesgscIS_L1XE50', ['shifter']), ('HLT_xe65_cell_xe100_mhtpufit_pf_subjesgscIS_L1XE50', ['shifter']), ('HLT_xe55_cell_xe70_tcpufit_xe95_pfsum_cssk_L1XE50', ['shifter']), ('HLT_xe65_cell_xe95_pfsum_vssk_L1XE50', ['shifter']), ('HLT_xe30_cell_xe30_tcpufit_L1XE30', ['val']), ('HLT_xe65_cell_xe110_tcpufit_L1XE50', ['t0']), ('HLT_xe80_cell_xe115_tcpufit_L1XE50', ['shifter'])])), ('tauMon', OrderedDict([('HLT_tau160_mediumRNN_tracktwoMVABDT_L1TAU100', ['online', 't0']), ('HLT_tau180_mediumRNN_tracktwoLLP_L1TAU100', ['shifter']), ('HLT_tau200_mediumRNN_tracktwoLLP_L1TAU100', ['online', 't0']), ('HLT_tau200_tightRNN_tracktwoLLP_L1TAU100', ['t0']), ('HLT_tau80_mediumRNN_tracktwoMVA_tau60_mediumRNN_tracktwoMVA_03dRAB_L1TAU60_2TAU40', ['t0']), ('HLT_tau80_mediumRNN_tracktwoMVABDT_tau60_mediumRNN_tracktwoMVABDT_03dRAB_L1TAU60_2TAU40', ['t0']), ('HLT_tau80_mediumRNN_tracktwoMVA_tau35_mediumRNN_tracktwoMVA_03dRAB30_L1TAU60_DR-TAU20ITAU12I', ['t0']), ('HLT_tau80_mediumRNN_tracktwoMVABDT_tau35_mediumRNN_tracktwoMVABDT_03dRAB30_L1TAU60_DR-TAU20ITAU12I', ['online']), ('HLT_tau35_mediumRNN_tracktwoMVA_tau25_mediumRNN_tracktwoMVA_03dRAB30_L1DR-TAU20ITAU12I-J25', ['shifter']), ('HLT_tau35_mediumRNN_tracktwoMVABDT_tau25_mediumRNN_tracktwoMVABDT_03dRAB30_L1DR-TAU20ITAU12I-J25', ['online']), ('HLT_tau35_mediumRNN_tracktwoMVABDT_tau25_mediumRNN_tracktwoMVABDT_03dRAB_L1TAU20IM_2TAU12IM_4J12p0ETA25', ['t0']), ('HLT_tau40_mediumRNN_tracktwoMVABDT_tau35_mediumRNN_tracktwoMVABDT_03dRAB_L1TAU25IM_2TAU20IM_2J25_3J20', ['t0']), ('HLT_tau80_mediumRNN_tracktwoLLP_tau60_mediumRNN_tracktwoLLP_03dRAB_L1TAU60_2TAU40', ['shifter']), ('HLT_tau80_mediumRNN_tracktwoLLP_tau60_tightRNN_tracktwoLLP_03dRAB_L1TAU60_2TAU40', ['t0']), ('HLT_tau80_tightRNN_tracktwoLLP_tau60_tightRNN_tracktwoLLP_03dRAB_L1TAU60_2TAU40', ['t0']), ('HLT_tau100_mediumRNN_tracktwoLLP_tau80_mediumRNN_tracktwoLLP_03dRAB_L1TAU60_2TAU40', ['t0']), ('HLT_tau0_ptonly_L1TAU8', ['t0']), ('HLT_tau0_ptonly_L1TAU60', ['online']), ('HLT_tau25_idperf_tracktwoMVABDT_L1TAU12IM', ['online', 't0']), ('HLT_tau25_perf_tracktwoMVABDT_L1TAU12IM', ['online', 't0']), ('HLT_tau25_mediumRNN_tracktwoMVABDT_L1TAU12IM', ['online', 't0']), ('HLT_tau25_mediumRNN_tracktwoLLP_L1TAU12IM', ['online']), ('HLT_tau60_mediumRNN_tracktwoMVABDT_L1TAU40', ['t0']), ('HLT_tau80_mediumRNN_tracktwoMVABDT_L1TAU60', ['t0']), ('HLT_tau160_idperf_tracktwoMVABDT_L1TAU100', ['online', 't0']), ('HLT_tau160_perf_tracktwoMVABDT_L1TAU100', ['online', 't0']), ('HLT_tau25_idperf_tracktwoMVA_L1TAU12IM', ['online', 'shifter']), ('HLT_tau25_perf_tracktwoMVA_L1TAU12IM', ['online', 'shifter']), ('HLT_tau25_mediumRNN_tracktwoMVA_L1TAU12IM', ['online', 'shifter']), ('HLT_tau160_idperf_tracktwoMVA_L1TAU100', ['online', 't0']), ('HLT_tau160_perf_tracktwoMVA_L1TAU100', ['online', 't0']), ('HLT_tau160_mediumRNN_tracktwoMVA_L1TAU100', ['online', 'shifter']), ('HLT_tau35_idperf_tracktwoMVA_L1TAU20IM', ['t0']), ('HLT_tau35_idperf_tracktwoMVABDT_L1TAU20IM', ['t0']), ('HLT_tau35_perf_tracktwoMVA_L1TAU20IM', ['t0']), ('HLT_tau35_perf_tracktwoMVABDT_L1TAU20IM', ['t0']), ('HLT_tau35_mediumRNN_tracktwoMVA_L1TAU20IM', ['t0']), ('HLT_tau35_mediumRNN_tracktwoMVABDT_L1TAU20IM', ['t0']), ('HLT_tau25_mediumRNN_tracktwoMVABDT_L1eTAU20', ['online', 't0']), ('HLT_tau25_mediumRNN_tracktwoMVABDT_L1eTAU20M', ['online', 't0']), ('HLT_tau160_mediumRNN_tracktwoMVABDT_L1eTAU140', ['t0']), ('HLT_tau180_mediumRNN_tracktwoLLP_L1eTAU140', ['shifter'])])), ('DJTrigMon', OrderedDict([('HLT_unconvtrk0_dispj_L1J100', ['online'])]))]))])
athena> print(m.monitoredChains('egammaMon'))
['HLT_e26_dnntight_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_e12_lhvloose_probe_L1EM22VHI', 'HLT_g35_medium_L1EM20VH', 'HLT_e26_lhtight_gsf_ivarloose_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_e26_lhtight_probe_L1EM22VHI', 'HLT_e60_lhmedium_L1EM22VHI', 'HLT_g140_loose_L1EM22VHI', 'HLT_e140_lhloose_L1eEM26M', 'HLT_e26_dnnmedium_L1EM22VHI', 'HLT_e300_etcut_L1eEM26M', 'HLT_g20_tight_icaloloose_L1EM15VHI', 'HLT_g25_medium_L1EM20VH', 'HLT_g22_tight_L1EM15VHI', 'HLT_e26_lhtight_ivarloose_L1eEM26T', 'HLT_e26_lhtight_ivarloose_e4_etcut_probe_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_L1eEM26M', 'HLT_e300_etcut_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_e17_lhvloose_probe_L1EM22VHI', 'HLT_e26_lhtight_gsf_L1EM22VHI', 'HLT_e60_dnnmedium_L1EM22VHI', 'HLT_g50_loose_L1EM20VH', 'HLT_g300_etcut_L1EM22VHI', 'HLT_e60_lhmedium_L1eEM26M', 'HLT_e140_lhloose_L1EM22VHI', 'HLT_e26_dnnloose_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_L1EM22VHI', 'HLT_e26_lhtight_ivarmedium_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_e24_lhvloose_probe_L1EM22VHI', 'HLT_e60_lhmedium_gsf_L1EM22VHI']
athena> print(m.monitoredChains('egammaMon', 'shifter'))
['HLT_e26_lhtight_ivarloose_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_e17_lhvloose_probe_L1EM22VHI', 'HLT_e26_lhtight_ivarloose_L1eEM26M', 'HLT_g20_tight_icaloloose_L1EM15VHI', 'HLT_g25_medium_L1EM20VH', 'HLT_e26_lhtight_ivarloose_L1eEM26T', 'HLT_e60_lhmedium_L1EM22VHI']
Edited by Tim Martin

Merge request reports