clean up the Moore config, define Stream objects

The current Moore config file became too large to handle and maintain. This is now split into main configuration for moore/allen, report writers (creating sel/dec report banks) and stream writers (writing to file). Hlt1/hlt2/Spruce/pass configurations are made more explicit wherever needed.

A new Stream object (name, routing bit, lines, raw banks) is introduced to make stream configuration more clear. An additional Streams object holds the list of streams. This allows easy access to all lines in all streams when needed.

A new algorithm in LHCb (SimpleRawEventMover) is used to save the raw event to Event/DAQ/RawEvent when running Hlt2 by first moving the existing event to a different location, then writing the new event to default location. This is needed as online/mdf writers always write to this location so root writer can't do it without overwriting the input.

Goes with LHCb!4393 (merged) DaVinci!1009 (merged) lhcb-datapkg/PRConfig!357 (merged)

Closing #678 (closed) as a side benefit..

added 10 commits

• 04829391...2d0d8167 - 9 commits from branch master
• eb673ddf - clean up the Moore config, define Stream objects, split stream writing

Compare with previous version

added RTA label

added 1 commit

• 4e8d68c3 - fix tests, make stream_writer more specific

Compare with previous version

added 2 commits

• b335c233 - Fixed formatting
• b3254277 - remove unused imports

Compare with previous version

added 1 commit

• 87ff5a01 - Fixed formatting

Compare with previous version

/ci-test LHCb!4393 (merged)

added ci-test-triggered label

• [2023-12-14 21:14] Validation started with lhcb-master-mr#9933
• [2023-12-15 12:38] Validation started with lhcb-master-mr#9941
• [2023-12-18 08:51] Validation started with lhcb-master-mr#9955
• [2024-01-09 15:59] Validation started with lhcb-master-mr#10049
• [2024-01-10 15:58] Validation started with lhcb-master-mr#10063
• [2024-01-11 15:52] Validation started with lhcb-master-mr#10079
• [2024-01-15 11:46] Validation started with lhcb-master-mr#10116
• [2024-01-15 12:56] Validation started with lhcb-master-mr#10118
• [2024-01-16 09:14] Validation started with lhcb-master-mr#10127
• [2024-01-17 12:58] Validation started with lhcb-master-mr#10147
• [2024-01-18 05:32] Validation started with lhcb-master-mr#10157
• [2024-01-18 15:03] Validation started with lhcb-master-mr#10166
• [2024-01-22 22:18] Validation started with lhcb-master-mr#10204

added 1 commit

• f934da14 - clean up

Compare with previous version

added 18 commits

• f934da14...b2575910 - 12 commits from branch master
• 4fe21e4b - clean up the Moore config, define Stream objects, split stream writing
• 09162a0b - fix tests, make stream_writer more specific
• 62975c7c - Fixed formatting
• ed91e12a - remove unused imports
• 8115549f - Fixed formatting
• cbf19a3c - clean up

Compare with previous version

added 1 commit

• 36b36b3e - clean up

Compare with previous version

resolved all threads

/ci-test LHCb!4393 (merged) MooreAnalysis!130 (closed)

mentioned in merge request MooreAnalysis!130 (closed)

marked this merge request as ready

changed title from Draft: clean up the Moore config, define Stream objects, split stream writing to clean up the Moore config, define Stream objects

changed the description

mentioned in merge request !2736 (closed)

mentioned in merge request LHCb!4393 (merged)

added Persistency label