Next round of MC productions

This is a list of things to include for the next round of MC productions. As far as we know, none of the following changes is really "breaking" in the sense that all tests in master continue working with them.

Please open discussion threads if needed, and/or update the description directly (but do leave a comment/explanation unless it's trivial).

General

• Test that source IDs comply to online specs: Boole!406 (merged)
• Fix MCTrackInfo: Boole!411 (merged)
• Update MCTrackInfo for run 3 detectors Boole#10 (closed) !3767 (merged)

ODIN

• Use the latest v7: !3762 (merged)
• link to issue about different runs

Velo

• Produce both SP and Retina data in Boole: Boole!349 (merged)
• In MDF output keep only retina clusters: Boole!406 (merged)

Retina clusters

• v1 format: !3385 (merged) Allen!748 (merged) Rec!2695 (merged) Moore!1280 (merged)
  • The retina clustering can produce clusters with identical LHCbIDs: Allen#286 (closed). To be resolved with v1.
  • Make sure we use latest version (4)

Superpixels

• TELL40 v1 cluster output (default) and two sensor SP banks !3452 (merged) Allen!874 (merged)
  • Make sure we use latest version (4)
• Which bank type to use? Currently VP, but for real data it will be Velo?

UT

• Geometry and mapping lhcb-conddb/DDDB!79 (merged) lhcb-conddb/SIMCOND!143 (merged)
• Changes the detector part of UT LHCbIDs and geometry: !2995 (merged), Lbcom!550 (merged) Boole!334 (merged) Rec!2403 (merged) Moore!785 (merged)
• Clustering for UT TELL40 decoding: Allen!607 (closed)
• Allow configuration without UT (avoid errors from MCTrackInfo): Boole!391 (merged)

RICH

• Source ID fix, real data format: Boole!382 (merged)
  • Note that the MC raw data format is different and won't be aligned to the real data format for now.
• Source ID fix needed for DetDesc "streaming" format: Boole#11 (closed) Boole!409 (merged)
• Make sure DDDB has R2 updated detector plane position, see slide 13 here: lhcb-conddb/DDDB!102 (merged) lhcb-conddb/SIMCOND!174 (merged)

FT

• Link mapping: lhcb-conddb/SIMCOND!166 (merged)
  • add missing banks: lhcb-conddb/SIMCOND!190 (merged)
• CPU encoding/decoding v7 ready: !2942 (merged) Boole!379 (merged) Moore!1318 (merged)
• Allen decoding Allen!861 (merged)
• Encoding follow ups: Detector!202 (merged) !3572 (merged)
• Other Boole changes to include:
  • SciFi simulation effective noise model and spillover: Boole!335 (merged)
  • FT new crosstalk model Boole!366 (merged)
  • (likely won't make it) Scifi bias correction: Boole!384 (closed)

Calo

• CPU encoding/decoding !3287 (merged)
• Mapping: lhcb-conddb/SIMCOND!165 (merged)
• Use CaloFuture instead of Calo for encoding: Boole!390 (merged)
• Make sure we produce new data version in Boole.
  • Make sure CALO data version is bumped (instead of relying on changing the BankType): !3539 (merged)
• Allen decoding: Allen!691 (merged)
• Investigate warnings in some tests (Moore!1703 (merged)), related to the MC links with the new samples

Muon

• CPU encoding/decoding:
  • Changes in the muon-specific part of the LHCbID (okay!) part of first version of dd4hep geometry: Detector!184 (merged) !3529 (merged) Allen!822 (merged)
  • New encoding/decoding: !3133 (merged) Rec!2691 (merged) Boole!377 (merged)
• Ensure that Source ID is set correctly (not the case in the MRs above as of March 31), !3764 (merged)
• Mapping: lhcb-conddb/DDDB!104 (merged) lhcb-conddb/SIMCOND!182 (merged)
• Allen decoding Allen!895 (merged)

LHCbID

• Renumber the 4-bit detector IDs and remove Run 2 detectors: !3226 (merged)

Magnetic field map

• 2022-03-17 update
• 2022-06-23 update
  • physics validation is still needed with Run 2 (and likely Run 3 data when that's available) => updating the map for MC is not for this time.

/cc @gcorti @kreps @adavis @gcavalle @cattanem @gligorov @smenzeme @graven @erodrigu @pkoppenb @nskidmor

For downstream central processing

What is required to run a production chain DIGI -> HLT1 -> HLT2 -> Spruce:

• Create Hlt1 line name to number mapping within Allen - good to have this resolved
• New persistency configuration
• Embed encoding/decoding key / TCK in Hlt rawbanks
• Reduce memory usage when single threaded Moore#473 (closed)