Processing speed heavily impacted by logging verbosity
It appears that the event processing rate drastically depends on the logging verbosity setting, and this is true even for verbosity settings that are actually not spamming much, such as INFO.
I have put a config + test file on lxplus for reproducing: /afs/cern.ch/user/o/omajersk/work_public/easyjet_perf_test
One can do a simple test (repeated multiple times to avoid some I/O caching effect) -- run the single DAOD_PHYS file with bbyy config one time with -l WARNING
or ERROR
and time with -l INFO
.
Time spent running the file with INFO: 640s Time spent running the file with WARNING/ERROR (found almost identical performance): ~50s
Obviously when you see how much printout INFO level does, this should not happen at all, so it appears some expensive code is run behind the scenes that leads to drastic slowdown.
Tested with easyjet 0.6.0 and AthAnalysis 24.2.20