AthGeneration Fixes, master branch (2020.03.20.) (!31349) · Merge requests · atlas / athena

Attila Krasznahorkay requested to merge akraszna/athena:AthGeneratorsFixes-master-20200320 into master Mar 20, 2020

These are some changes to address the issue described in ATEAM-599.

After fixing the issue with decorator not being available in the nightly's runtime environment (by updating PyUtils/CMakeLists.txt), I ran into a number of other issues as well while trying to run @ewelina's example job.

Gen_tf.py --ecmEnergy=13000 --maxEvents=10 --jobConfig=421101 --outputEVNTFile=test_bb_Jpsimu4mu4X.pool.root

I had to add xAODEventInfoCnv (and as a consequence xAODCnvInterfaces) to AthGeneration;
- To make the package compile successfully, I also had to update its code a bit;
I had to fix a number of issues in skel.GENtoEVGEN.py to make it (sort of) work.

After all of this, with all these changes applied, the above mentioned job fails during configuration with:

...
generate 09:53:52 Py:Athena            INFO including file "/cvmfs/atlas.cern.ch/repo/sw/Generators/MC16JobOptions/scripts/check_jo_consistency.py"
generate 09:53:52       OK: New jobOption file
generate 09:53:52       OK: name format correct
generate 09:53:52       OK: P8B_A14NNPDF23LO_pp_JpsimumuZmumu physicsShort less than 50 characters long
generate 09:53:52       OK: 2 physicsShort parts found
generate 09:53:52       OK: Loading generator list file from cvmfs
generate 09:53:52       OK: No generator full name is found
generate 09:53:52       Generators used:  ['P8B']
generate 09:53:52 Py:Athena            INFO including file "mc.P8B_A14NNPDF23LO_pp_JpsimumuZmumu.py"
generate 09:53:52 Shortened traceback (most recent user call last):
generate 09:53:52   File "/workspaces/build/x86_64-centos7-gcc8-opt/jobOptions/EvgenJobTransforms/skel.GENtoEVGEN.py", line 245, in <module>
generate 09:53:52     include(jofile)
generate 09:53:52   File "/cvmfs/atlas.cern.ch/repo/sw/Generators/MCJobOptions/421xxx/421101/mc.P8B_A14NNPDF23LO_pp_JpsimumuZmumu.py", line 8, in <module>
generate 09:53:52     include('Pythia8B_i/Pythia8B_A14_NNPDF23LO_Common.py')
generate 09:53:52 
generate 09:53:52 IncludeError: include file Pythia8B_i/Pythia8B_A14_NNPDF23LO_Common.py can not be found
generate 09:53:52 
generate 09:53:52 Py:Athena            INFO leaving with code 2: "an error occurred when including a file"
PyJobTransforms.trfExe.execute 2020-03-20 09:53:52,938 INFO generate executor returns 2
PyJobTransforms.trfExe.validate 2020-03-20 09:53:52,939 ERROR Validation of return code failed: Non-zero return code from generate (2) (Error code 65)
PyJobTransforms.trfExe.validate 2020-03-20 09:53:52,955 INFO Scanning logfile log.generate for errors in substep None
PyJobTransforms.trfValidation.scanLogFile 2020-03-20 09:53:52,957 WARNING Detected python exception - activating python exception grabber
PyJobTransforms.transform.execute 2020-03-20 09:53:52,957 CRITICAL Transform executor raised TransformValidationException: Non-zero return code from generate (2); Logfile error in log.generate: "IncludeError: include file Pythia8B_i/Pythia8B_A14_NNPDF23LO_Common.py can not be found"
PyJobTransforms.transform.execute 2020-03-20 09:53:56,002 WARNING Transform now exiting early with exit code 65 (Non-zero return code from generate (2); Logfile error in log.generate: "IncludeError: include file Pythia8B_i/Pythia8B_A14_NNPDF23LO_Common.py can not be found")

But I decided that this I would rather just leave to the generators group to sort out... 😉

Pinging @jchapman as well.

AthGeneration Fixes, master branch (2020.03.20.)

Merge request reports