WIP: PEB+TLA for jets attempt #2 (supersedes MR:45506, refers to ATR-21596)
This is a WIP MR for discussing the first version of a PEB+TLA chain for jets that we've been working on and discussing with @mmontell and @boveia, and it implements the suggestions by @rbielski in MR:45506. Our goal is to have a single, separate new stream containing both PEB and TLA information, and we're starting with jets since we have dark sector jets and b-jets in mind for analysis purposes.
This MR still based on a release from a couple of weeks ago (2021-11-30T2101) so it needs to be updated, but while we do that we'd appreciate some pointers on how to go ahead and debug the content of the PEB part (and in general on the strategy of writing TLA+PEB out simultaneously).
This MR produces a file containing both TLA and PEB information using this command:
athenaHLT.py -l DEBUG -c "setMenu='LS2_v1';doL1Sim=True;rewriteLVL1=True; selectChains=['HLT_j20_JetPEBPhysicsTLA_L1J100'];" -o output --imf --perfmon --threads=1 --concurrent-events=1 --nprocs=1 --number-of-events=100 --file=/cvmfs/atlas-nightlies.cern.ch/repo/data/data-art/TrigP1Test/data18_13TeV.00360026.physics_EnhancedBias.merge.RAW._lb0151._SFO-1._0001.1 TriggerJobOpts/runHLT_standalone.py | tee out.txt
This produces a 200k file (the size is unexpectedly large - there are some questions about that later)
-rw-rw-r--. 1 doglioni doglioni 200K Dec 15 14:22 data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
We then extract the stream:
trigbs_extractStream.py -s TLAJetPEB data18_13TeV.00360026.unknown_SingleStream.daq.RAW._lb0151._HLTMPPy_output._0401.data
INFO:trigbs_extractStream:Total number of events processed = 1
INFO:trigbs_extractStream:Number of events skipped at the beginning = 0
INFO:trigbs_extractStream:Number of events written to output file = 1
INFO:trigbs_extractStream:Output file = ./data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.dataChecking TLA and PEB content separately (see output below), we seem to have something in the file. While we understand what is in the TLA side of things, we do not understand exactly what is saved in the PEB part. Some questions:
-
what does "maxROI" indicates for the RoIPEBInfoWriterTool?
-
why are there more subdetectors (14 in output) than what we've asked for (8 in
tool.addRegSelDets(['Pixel', 'SCT', 'TRT', 'TTEM', 'TTHEC', 'FCALEM', 'FCALHAD', 'TILE']inTriggerCommon/TriggerMenuMT/python/HLTMenuConfig/CommonSequences/EventBuildingSequences.py)
→ we answered that by modifying get_stream_info.py for more verbosity, and this is what we see:
RawInfo 2021-12-15 16:18:50,273 INFO SCT_BARREL_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO LAR_EM_BARREL_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO SCT_ENDCAP_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO LAR_EM_ENDCAP_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO LAR_HAD_ENDCAP_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO PIXEL_BARREL
RawInfo 2021-12-15 16:18:50,273 INFO PIXEL_DISK_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO PIXEL_B_LAYER
RawInfo 2021-12-15 16:18:50,273 INFO PIXEL_IBL
RawInfo 2021-12-15 16:18:50,273 INFO TRT_BARREL_A_SIDE
RawInfo 2021-12-15 16:18:50,273 INFO TRT_ENDCAP_A_SIDE
RawInfo 2021-12-15 16:18:50,274 INFO TILECAL_BARREL_A_SIDE
RawInfo 2021-12-15 16:18:50,274 INFO TILECAL_EXT_A_SIDE
RawInfo 2021-12-15 16:18:50,274 INFO TDAQ_HLTAny other comments or feedback is also appreciated.
Thanks, Caterina and @mmontell
TLA content check:
trigbs_dumpHLTContentInBS_run3.py --hltres --sizeSummary data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
Py:dumpHLTContentInBS INFO Opening data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
Event: 1, RunNumber: 360026, LB: 151, Global_ID: 629114529, LVL1_ID: 1745177078, BC_ID: 932, TT: x85 > Found 1 HLT ROBs
-- ROBFragment SourceID: TDAQ_HLT, module=5 (opt=0), Version: 1.1, Size: 7952 bytes
---
- Size summary:
---
-- TDAQ_HLT module 5 total size 7952 bytes, 7952.000 bytes/event
---- xAOD::JetAuxContainer_v1#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux. 1784 B 1784.000 B/ev
---- xAOD::MuonAuxContainer_v5#HLT_MuonsCB_RoI_TLAAux. 1484 B 1484.000 B/ev
---- vector<vector<float> >#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.EnergyPerSampling 564 B 564.000 B/ev
---- xAOD::PhotonAuxContainer_v3#HLT_egamma_Photons_TLAAux. 452 B 452.000 B/ev
---- xAOD::JetAuxContainer_v1#HLT_AntiKt4EMPFlowJets_subjesIS_TLAAux. 252 B 252.000 B/ev
---- xAOD::JetContainer_v1#HLT_AntiKt4EMTopoJets_subjesIS_TLA 140 B 140.000 B/ev
---- xAOD::JetContainer_v1#HLT_AntiKt4EMPFlowJets_subjesIS_TLA 140 B 140.000 B/ev
---- xAOD::PhotonContainer_v1#HLT_egamma_Photons_TLA 132 B 132.000 B/ev
---- xAOD::MuonContainer_v1#HLT_MuonsCB_RoI_TLA 124 B 124.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetConstitScaleMomentum_pt 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetConstitScaleMomentum_eta 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetConstitScaleMomentum_phi 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetEtaJESScaleMomentum_eta 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetEtaJESScaleMomentum_phi 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetPileupScaleMomentum_eta 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetPileupScaleMomentum_phi 108 B 108.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetConstitScaleMomentum_m 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetEtaJESScaleMomentum_m 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetEtaJESScaleMomentum_pt 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetGSCScaleMomentum_eta 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetGSCScaleMomentum_phi 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetGSCScaleMomentum_pt 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetPileupScaleMomentum_m 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetPileupScaleMomentum_pt 104 B 104.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.ActiveArea4vec_eta 100 B 100.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.ActiveArea4vec_phi 100 B 100.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.JetGSCScaleMomentum_m 100 B 100.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.ActiveArea4vec_m 96 B 96.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.ActiveArea4vec_pt 96 B 96.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.SizeParameter 92 B 92.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.ActiveArea 92 B 92.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.DetectorEta 92 B 92.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.DetectorPhi 92 B 92.000 B/ev
---- vector<int>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.AlgorithmType 88 B 88.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.EMFrac 88 B 88.000 B/ev
---- vector<float>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.HECFrac 88 B 88.000 B/ev
---- vector<int>#HLT_AntiKt4EMTopoJets_subjesIS_TLAAux.InputType 84 B 84.000 B/evPEB content check:
python get_stream_info.py -p -S TLAJetPEB data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
bash-4.2$ python get_stream_info.py -p -S TLAJetPEB data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
RawInfo 2021-12-15 15:04:48,251 INFO Log level: INFO
RawInfo 2021-12-15 15:04:48,251 INFO Loading file: data18_13TeV.00360026.physics_TLAJetPEB.daq.RAW._lb0151._athenaHLT._0001.data
RawInfo 2021-12-15 15:04:48,253 INFO Checking TLAJetPEB stream.
RawInfo 2021-12-15 15:04:48,254 INFO Skipping 0 events
RawInfo 2021-12-15 15:04:48,254 INFO Checking 1 events
RawInfo 2021-12-15 15:04:48,255 INFO ----------------------------------------------------------------------------------------------------
RawInfo 2021-12-15 15:04:48,255 INFO Event 0 = RunNumber 360026, LB 151, BCID 932
/cvmfs/atlas.cern.ch/repo/sw/tdaq/tdaq-common/tdaq-common-04-04-00/installed/share/lib/python/eformat/__init__.py:148: EformatDeprecationWarning: "FullEventFragment.robs" may crash with compressed data, please use an iterator.
warnings.warn('"FullEventFragment.robs" may crash with compressed data, please use an iterator.',
RawInfo 2021-12-15 15:04:48,260 INFO Event contains 275 robs from 14 detectors
RawInfo 2021-12-15 15:04:48,261 INFO
RawInfo 2021-12-15 15:04:48,261 INFO Stream tags:
RawInfo 2021-12-15 15:04:48,262 INFO Stream tag: TLAJetPEB , robs: 275, dets: 0
RawInfo 2021-12-15 15:04:48,262 INFO - All robs in stream tag are found in the event: True
RawInfo 2021-12-15 15:04:48,262 INFO ----------------------------------------------------------------------------------------------------
RawInfo 2021-12-15 15:04:48,263 INFO Streams in file: ['TLAJetPEB']
RawInfo 2021-12-15 15:04:48,263 INFO PEB Streams in file: ['TLAJetPEB']
RawInfo 2021-12-15 15:04:48,263 INFO Found 1 good and 0 bad events.
RawInfo 2021-12-15 15:04:48,263 INFO ----------------------------------------------------------------------------------------------------
RawInfo 2021-12-15 15:04:48,263 INFO Done.