CPAlgorithms: full printout of the tools and algorithms configuration

(Largely based on the work from @hrussell a few months ago... Bringing the changes up to date and ironing out a few things)

This MR adds the necessary functions to allow a user running CP algorithms to save a JSON file containing the full configuration (defaults + user changes) of all algorithms and tools scheduled during the job. We plan to integrate this fully in TopCPToolkit as the Top WG is very interested in designing tools to leverage this information for e.g. analysis preservation, combination checks, facilitating technical review, automatically writing documentation, etc.

Note that while this could also be done for the CP algorithms run in PHYSLITE at derivation-level, this is beyond the scope of this MR. See https://its.cern.ch/jira/browse/ATLASDPD-2155 and links therein for the PHYSLITE implementation.

added 3 commits

• 15ed059c - include new alg in ComponentFactoryPreloader
• 3df1f82a - update copyright year
• 918f5d34 - improve the c++ algorithm for tool dumping

Compare with previous version

added 2 commits

• 851b5619 - clean up config block, remove make-method
• 4ab70c3f - improve error handling, parsing and modularisation of the JSON reader/writer

Compare with previous version

added 1 commit

• 48b3373f - heavy refactoring, put all utility functions in SaveConfigUtils.py

Compare with previous version

added 1 commit

• 7759c85d - minor cleanup

Compare with previous version

this is awesome, thanks Baptiste!! Please let me know if anything comes up in review that I should help address (I'll try to keep an eye on the discussions).

added 1 commit

• 27e3e1d9 - refactor for robustness and maintanability

Compare with previous version

added 1 commit

• 76888c23 - use tool ID instead of tool path for top-level tools

Compare with previous version

marked this merge request as ready

This merge request affects 3 packages:

• PhysicsAnalysis/Algorithms/AnalysisAlgorithmsConfig
• PhysicsAnalysis/Algorithms/AsgAnalysisAlgorithms
• PhysicsAnalysis/Algorithms/ComponentFactoryPreloader

Affected files list will not be printed in this case

Adding @tadej ,@krumnack as watchers

added Analysis CPAlgorithms analysis-review-required main review-pending-level-1 labels

CI integration tests for projects Athena,AthAnalysis are cancelled because of compilation error(s)

CI Result FAILURE (hash 76888c23)

	Athena	AnalysisBase	AthAnalysis
externals
cmake
make
tests

Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 1, warnings 0
AnalysisBase: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 1, warnings 0
For experts only: Jenkins output (remote access info)

added 1 commit

• 357bb4fe - add PrintConfiguration to YAML configs

Compare with previous version

It seems that asg::ToolStore::dumpToolConfig() is only defined in AnalysisBase, not sure how we want to handle that...

Build area was cleaned as per request posted in the DB. The full software build will be performed

This merge request affects 3 packages:

• PhysicsAnalysis/Algorithms/AnalysisAlgorithmsConfig
• PhysicsAnalysis/Algorithms/AsgAnalysisAlgorithms
• PhysicsAnalysis/Algorithms/ComponentFactoryPreloader

Affected files list will not be printed in this case

Adding @krumnack ,@tadej as watchers

CI integration tests for projects Athena,AthAnalysis are cancelled because of compilation error(s)

CI Result FAILURE (hash 357bb4fe)

	Athena	AnalysisBase	AthAnalysis
externals
cmake
make
tests

Full details available on this CI monitor view. Check the JIRA CI status board for known problems
Athena: number of compilation errors 1, warnings 0
AnalysisBase: number of compilation errors 0, warnings 0
AthAnalysis: number of compilation errors 1, warnings 0
For experts only: Jenkins output (remote access info)

added 1 commit

• 7b451d57 - fix unit test

Compare with previous version

This merge request affects 3 packages:

• PhysicsAnalysis/Algorithms/AnalysisAlgorithmsConfig
• PhysicsAnalysis/Algorithms/AsgAnalysisAlgorithms
• PhysicsAnalysis/Algorithms/ComponentFactoryPreloader

Affected files list will not be printed in this case

Adding @krumnack ,@tadej as watchers