AthenaMP+AthenaServices: Support executing algorithms/sequences in AthenaMP during PreFork
This is an adaptation of @fwinkl's !55759 (merged) to generic AthenaMP
. In a nutshell, this gives the possibility of executing certain algorithms/sequences during PreFork
incident in AthenaMP
. One can use this to execute the conditions algorithms before the first event, hence sharing the memory across workers even without FAFE.
Based on an 8 process, 10k event AODtoDAOD
test w/ SharedWriter
, vanilla MP uses about 2 GB/worker, executing conditions algorithms before the event loop this way reduces this to 1.5 GB/core, while FAFE still performs the best at 0.9 GB/worker:
We can take a look to see if there is any milage in adopting such an approach in other jobs such as derivation production.
Merge request reports
Activity
assigned to @amete
This merge request affects 2 packages:
- Control/AthenaMP
- Control/AthenaServices
Affected files list will not be printed in this case
Adding @ssnyder as watcher
added Core master review-pending-level-1 labels
CI Result SUCCESS (hash aacfad31)Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon externals cmake make tests Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 0, warnings 0
AthSimulation: number of compilation errors 0, warnings 0
AthGeneration: number of compilation errors 0, warnings 0
AnalysisBase: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 0, warnings 0
DetCommon: number of compilation errors 0, warnings 0
For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 57282]added alsoTargeting:22.0 label
added review-approved label and removed review-pending-level-1 label
mentioned in commit 932bed12
added sweep:done label
picked the changes into the branch
cherry-pick-932bed12b5b-22.0
with commit 991416e8mentioned in commit 991416e8
mentioned in merge request !55854 (merged)
Sweep summary
successful:- 22.0
(see https://aiatlas154.cern.ch/jenkins/job/auto_git_sweeps/2979/console for details)
mentioned in commit e9b8eaf2
- Resolved by Alaettin Serhan Mete
mentioned in merge request !56517 (merged)