Draft: clean up and simplify the config

The current Moore config file became too large to handle and maintain. This is now split into main configuration for moore/allen, report writers (collecting and creating all report banks) and stream writers. Hlt1/hlt2/Spruce/pass configurations are made more explicit wherever needed.

A new Stream object (name, routing bit, lines, raw banks) is introduced to make stream configuration more clear. An additional Streams object holds the list of streams. This allows easy access to all lines in all streams when needed.

Goes with MooreAnalysis!130 (closed) lhcb-datapkg/PRConfig!357 (merged)

Superseded by !2802 (merged) due to many MR conflicts

marked this merge request as draft

added RTA label

added 1 commit

• f60f0cd4 - remove output level from sprucing check

Compare with previous version

added 2 commits

• 4fecb8b1 - Fixed formatting
• e9748ec0 - Make Stream(s) objects to set stream name, routing bit, lines consistently

Compare with previous version

added 2 commits

• be6b1d5b - Fixed formatting
• 57b6fc8d - fix missing/extra imports

Compare with previous version

added 2 commits

• 52647e00 - Fixed formatting
• 124ae42b - fix missing/extra imports

Compare with previous version

requested review from @nskidmor

/ci-test LHCb!4259 (merged)

Started integration test build. Once done, check the results or the comparison to a reference build.

Throughput Test Moore_hlt2_fastest_reco: 481.9 Events/s -- change of -0.02% vs. reference

Throughput Test Moore_hlt2_pp_thor: 233.2 Events/s -- change of 0.11% vs. reference

Throughput Test Moore_spruce_all_lines: 368.7 Events/s -- change of -1.51% vs. reference . Total bandwidth 0 GB/s -- change of -100.00% vs. reference

Throughput Test Moore_hlt1_pp_default: 26030.4 Events/s -- change of -0.02% vs. reference

added ci-test-triggered label

• [2023-11-07 18:24] Validation started with lhcb-master-mr#9630
• [2023-11-09 14:03] Validation started with lhcb-master-mr#9643
• [2023-11-10 08:28] Validation started with lhcb-master-mr#9646
• [2023-11-11 13:41] Validation started with lhcb-master-mr#9649

mentioned in merge request MooreAnalysis!130 (closed)

added cleanup label

This is the wrong way around :) the prescaled lines should have all detector banks and the no prescale not

yes, I also noticed after committing. I have bunch of fixes to add.

changed this line in version 7 of the diff

This is a really valuable simplification of the code @sesen

added 1 commit

• 09c94ed7 - fix stream(s) updating, other small fixes

Compare with previous version

added 1 commit

• cde4ce8e - fix detectors in Sprucing settings for production

Compare with previous version

mentioned in merge request Allen!1371 (closed)

/ci-test LHCb!4259 (merged) Allen!1371 (closed) MooreAnalysis!130 (closed)

added 1 commit

• 185c4e74 - make sure stream names are unique, add get stream function

Compare with previous version

changed the description