DerivationFramework implementation of new TLA0 and TLA1 formats
DerivationFramework implementation of two new derivation formats to be used for the Dijet+ISR TLA and related studies. The new derivation formats are:
Derivation 1: TLA0
Description: Large event content, versatile trigger skimming
Application: In-depth studies for all existing TLA signatures
Target: Low, limited to 1-2 runs (o(fb))
Content: Main Offline Objects, HLT Photons, HLT Jets, Offline Tracks (Thinned), HLT Tracks (unthinned), HLT Vertices, JetTriggerContent
Trigger Skimming: All Primary TLA Chains + Support Single Jets + Support Single Photon + Support Multijet
Event Size: ~65kB/evt Trigger Skimming Retention: 47%
Size estimate per fb = 95.3e6 evt/fb x 65 kb/evt x 0.47 (acc events / all events ) = 2.9TB/fb
Estimated DiskUsage for initial request: ~3TB
Derivation 2: TLA1
Description: Large event content, intense trigger skimming
Application: Photon/Jets studies for ongoing Run 3 ISR+DiJet analysis, background modelling studies in MC, Signal Studies
Target: Large, 2022+2023 Datasets, MCs
Content: same as TLA0
Trigger Skimming: ISR TLA Chain + Support Single Photon
Event Size: ~65kB/evt
Trigger Skimming Retention: 6.5%
Size Estimate per fb: TLA0 / 0.47 x 0.065 = 0.4TB/fb
Estimated DiskUsage for initial request:
2022 Data: 8TB (20 fb)
2023 Data: 12TB (30 fb) (probably less considering GRL)
MC: mc23: gamma+jets = ~60e6evts x 65kB/evt = ~4TB
Merge request reports
Activity
added Derivation main labels
- Resolved by Jan-Eric Nitschke
Hi @mmontell the fork seems unreachable. Could you check if the fork is set to private instead of internal?
Cheers L1
added 1 commit
- dd293a53 - Adding MetaData streaming to TLA derivations
This merge request affects 3 packages:
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkConfiguration
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkCore
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA
Affected files list will not be printed in this case
CI Result SUCCESS (hash dd293a53)Athena AthAnalysis externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 1
AthAnalysis: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 78230]This merge request affects 3 packages:
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkConfiguration
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkCore
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA
Affected files list will not be printed in this case
added review-pending-level-1 label
CI Result SUCCESS (hash dd293a53)Athena AthAnalysis externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 1
AthAnalysis: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 78695]Hi @mmontell. There is a compilation warning as follows:
var/lib/jenkins/workspace/CI-MERGE-REQUEST-CC7/main/PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA/python/TLA1.py:20:5: warning: F401 'DerivationFrameworkTLA.TLATriggerList.SupportSingleJetTriggers' imported but unused from DerivationFrameworkTLA.TLATriggerList import SupportSingleJetTriggers, SupportPhotonTriggers, PrimaryISRTLATriggers, SupportTLATriggers ^ /var/lib/jenkins/workspace/CI-MERGE-REQUEST-CC7/main/PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA/python/TLACommonConfigFunctions.py:38:5: warning: F401 'JetRecConfig.StandardSmallRJets.AntiKtVR30Rmax4Rmin02PV0Track' imported but unused from JetRecConfig.StandardSmallRJets import AntiKt4EMTopo,AntiKt4EMPFlow,AntiKtVR30Rmax4Rmin02PV0Track ^
Can this be looked into?
-- James for L1
added review-user-action-required label and removed review-pending-level-1 label
- Resolved by Marco Montella
Opening a comment thread so that this isn't merged during Wednesday when the CI will be unavailable.
This merge request affects 3 packages:
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkConfiguration
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkCore
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA
Affected files list will not be printed in this case
added review-pending-level-1 label and removed review-user-action-required label
CI Result SUCCESS (hash 4748642e)Athena AthAnalysis externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST 198]- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
- Resolved by Marco Montella
@mmontell thanks for the MR. I have a few comments from L1 perspective. They are mostly related to commented lines and left-over TODO items. I think it would be good to clearly state what you mean with these TODO items and whether or not they should be part of a different MR.
Cheers, Steffen (L1)
added review-user-action-required label and removed review-pending-level-1 label
This merge request affects 3 packages:
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkConfiguration
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkCore
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA
Affected files list will not be printed in this case
added review-pending-level-1 label and removed review-user-action-required label
CI Result SUCCESS (hash 127cbb7a)Athena AthAnalysis externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST-EL9 304]added 1 commit
- 0e1bda9f - Remove comment from TLACommonConfigFunctions.py
This merge request affects 3 packages:
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkConfiguration
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkCore
- PhysicsAnalysis/DerivationFramework/DerivationFrameworkTLA
Affected files list will not be printed in this case
CI Result SUCCESS (hash 0e1bda9f)Athena AthAnalysis externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST-EL9 315]added review-approved label and removed review-pending-level-1 label