Egammaperformance24082021

This MR implements a first working version of the Egamma monitoring and associated Webdisplay for Run 3. When running the RunTier0Tests.py, experienced some issues but as far as I understand I think they are not coming from my code.

This code has been able to run smoothly and produce locally han files. I could also produce working webdisplays for a testfile.

My hypothesis is that this new branch is activating two Tag and Probe monitors which were not run before (see Reconstruction/egamma/egammaPerformance/python/egammaMonitoringConfig.py.)... :

RunTier0Tests.py INFO
INFO The head directory for the output of the clean Tier0 q-tests will be /tmp/laforge INFO
INFO Your tags will be tested in environment master,x86_64,centos7,gcc8,opt,2021-09-05T2101,Athena INFO Patch packages in your build to be tested:

INFO DataQuality/DataQualityConfigurations

INFO Reconstruction/egamma/egammaPerformance

INFO ------------------ Run Athena q-test jobs--------------- INFO Running clean in rel master,x86_64,centos7,gcc8,opt,2021-09-05T2101,Athena "ATHENA_CORE_NUMBER=1 Reco_tf.py --multithreaded --AMI q221 --imf False " INFO Running patched in rel master,x86_64,centos7,gcc8,opt,2021-09-05T2101,Athena "ATHENA_CORE_NUMBER=1 Reco_tf.py --multithreaded --AMI q221 --imf False " INFO Finished clean "Reco_tf.py --AMI q221" INFO Finished patched "Reco_tf.py --AMI q221" INFO Running clean in rel master,x86_64,centos7,gcc8,opt,2021-09-05T2101,Athena "ATHENA_CORE_NUMBER=1 Reco_tf.py --multithreaded --AMI q431 --imf False " INFO Running patched in rel master,x86_64,centos7,gcc8,opt,2021-09-05T2101,Athena "ATHENA_CORE_NUMBER=1 Reco_tf.py --multithreaded --AMI q431 --imf False " INFO Finished clean "Reco_tf.py --AMI q431" INFO Finished patched "Reco_tf.py --AMI q431" INFO ----------------------------------------------------- INFO ----------- Post-processing of q221 Test ----------- INFO ----------------------------------------------------- INFO Did each step of the q221 test complete successfully? INFO
INFO HITtoRDO Patched test successful INFO HITtoRDO Reference test successful INFO
INFO RAWtoESD Patched test successful INFO RAWtoESD Reference test successful INFO
INFO ESDtoAOD Patched test successful INFO ESDtoAOD Reference test successful INFO
INFO All q221 athena steps completed successfully INFO --------------------------------------------------------------------------------------- INFO Running q221 Frozen Tier0 Policy Test on ESD for 10 events INFO Reading the reference file from location /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4 INFO No diff rules file exists, using the default list ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.decisions]: 237649 leaves differ

ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.linkColClids]: 23289 leaves differ

ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.linkColIndices]: 32433 leaves differ

ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.linkColKeys]: 23739 leaves differ

ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.linkColNames]: 23133 leaves differ

ERROR Py:diff-root INFO [xAOD::TrigCompositeAuxContainer_v2_HLTNav_Summary_OnlineSlimmedAux.name]: 11677 leaves differ

ERROR Your tag breaks the frozen tier0 policy in test q221. See run_q221/diff-root-q221.ESD.log file for more information. INFO --------------------------------------------------------------------------------------- INFO Running q221 Frozen Tier0 Policy Test on AOD for 20 events INFO Reading the reference file from location /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4 INFO No diff rules file exists, using the default list ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.decisions]: 435818 leaves differ

ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.linkColClids]: 40773 leaves differ

ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.linkColIndices]: 57261 leaves differ

ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.linkColKeys]: 41605 leaves differ

ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.linkColNames]: 40511 leaves differ

ERROR Py:diff-root INFO [HLTNav_Summary_OnlineSlimmedAux.name]: 20002 leaves differ

ERROR Your tag breaks the frozen tier0 policy in test q221. See run_q221/diff-root-q221.AOD.log file for more information. INFO --------------------------------------------------------------------------------------- INFO Running q221 Frozen Tier0 Policy Test on RDO for 10 events INFO Reading the reference file from location /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4 INFO No diff rules file exists, using the default list INFO Passed! INFO ----------------------------------------------------- INFO Running q221 CPU Time Test INFO Passed! INFO ----------------------------------------------------- INFO Running q221 Physical Memory Test INFO Passed! INFO ----------------------------------------------------- INFO Running q221 Virtual Memory Test INFO Passed! INFO ----------------------------------------------------- INFO Running q221 Memory Leak Test INFO Passed! INFO ----------------------------------------------------- INFO Running q221 WARNINGS Test INFO
INFO Test log file run_q221/log.HITtoRDO has the same number of warnings as the reference log file /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4/log.HITtoRDO INFO
INFO Test log file run_q221/log.RAWtoESD has the same number of warnings as the reference log file /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4/log.RAWtoESD INFO
ERROR Test log file run_q221/log.ESDtoAOD has 62 more warning(s) than the reference log file /tmp/laforge/clean_run_q221_11b50aca-b1cf-4ddc-a654-67994d1809a4/log.ESDtoAOD ERROR Please remove the new warning message(s): ERROR PublicToolHandleArray WARNING PublicToolHandle('xAODMaker::EventFormatMetaDataTool/EventFormatMetaDataTool') with instance name 'EventFormatMetaDataTool' already in list. Not adding <xAODMaker::EventFormatMetaDataTool/ToolSvc.EventFormatMetaDataTool at 0x7f8cf14c7040>

ERROR PublicToolHandleArray WARNING PublicToolHandle('xAODMaker::TriggerMenuMetaDataTool/TriggerMenuMetaDataTool') with instance name 'TriggerMenuMetaDataTool' already in list. Not adding <xAODMaker::TriggerMenuMetaDataTool/ToolSvc.TriggerMenuMetaDataTool at 0x7f8cf15084c0>

INFO
ERROR Failed! INFO ----------------------------------------------------- INFO ----------- Post-processing of q431 Test ----------- INFO ----------------------------------------------------- INFO Did each step of the q431 test complete successfully? INFO
INFO RAWtoESD Patched test successful INFO RAWtoESD Reference test successful INFO
INFO ESDtoAOD Patched test successful INFO ESDtoAOD Reference test successful INFO
INFO All q431 athena steps completed successfully INFO --------------------------------------------------------------------------------------- INFO Running q431 Frozen Tier0 Policy Test on ESD for 10 events INFO Reading the reference file from location /tmp/laforge/clean_run_q431_11b50aca-b1cf-4ddc-a654-67994d1809a4 INFO No diff rules file exists, using the default list INFO Passed! INFO --------------------------------------------------------------------------------------- INFO Running q431 Frozen Tier0 Policy Test on AOD for 20 events INFO Reading the reference file from location /tmp/laforge/clean_run_q431_11b50aca-b1cf-4ddc-a654-67994d1809a4 INFO No diff rules file exists, using the default list INFO Passed! INFO ----------------------------------------------------- INFO Running q431 CPU Time Test INFO Passed! INFO ----------------------------------------------------- INFO Running q431 Physical Memory Test INFO Passed! INFO ----------------------------------------------------- INFO Running q431 Virtual Memory Test INFO Passed! INFO ----------------------------------------------------- INFO Running q431 Memory Leak Test INFO Passed! INFO ----------------------------------------------------- INFO Running q431 WARNINGS Test INFO
INFO Test log file run_q431/log.RAWtoESD has the same number of warnings as the reference log file /tmp/laforge/clean_run_q431_11b50aca-b1cf-4ddc-a654-67994d1809a4/log.RAWtoESD INFO
INFO Test log file run_q431/log.ESDtoAOD has the same number of warnings as the reference log file /tmp/laforge/clean_run_q431_11b50aca-b1cf-4ddc-a654-67994d1809a4/log.ESDtoAOD INFO
INFO Passed! INFO ----------------------------------------------------- INFO ---------------------- Summary ---------------------- ERROR ALL TESTS: FAILED (-1)