Adding MC job configurations for HLT2 and Sprucing

Nicole Skidmorerequested to merge
MCopts into master

Will need backporting to patches for MC productions

Additions

If flagging adds the possibility to (for HLT2 and Sprucing)

  • persistreco (DST) or not (mDST)
  • persist rawbanks or not

If flagging adds the possibility to (in HLT2 only)

  • run the reconstruction only (has to be with persistreco, rawbanks optional)

Makes it so, if using flagging, the sprucing does not implement the FULL stream filter.

Comments

  • In LbMCSubmit we will need to make sure peoples job chains make sense, eg. if you ask for flagging and persistreco at HLT2 you also have it for Sprucing

  • We probably do not want to allow all these combinations, but thats not for me to decide ;)

Tests

Would rather not test every combination, even via reference blocks

Testing the following explicitly

  • test_lbexec_hlt2_pp_2024_flagging_mc --flagging with countErrorLines, findReferenceBlock, xml

  • test_lbexec_hlt2_pp_2024_noflagging_mc with countErrorLines, findReferenceBlock

  • test_lbexec_hlt2_pp_flagging_reco_only_mc --flagging --persistreco --reco-only with countErrorLines, findReferenceBlock

  • test_lbexec_hlt2_pp_flagging_presistreco_mc (DST) --flagging --persistreco with countErrorLines, findReferenceBlock

  • test_lbexec_hlt2_pp_flagging_reco_only_rawbanks_mc --flagging --persistreco --reco-only, rawbanks with dry-run

  • test_lbexec_spruce_pp_2024_flagging_mc --flagging with countErrorLines, findReferenceBlock and xml check (tests no FULL lines filter applied)

  • test_lbexec_spruce_pp_2024_noflagging_mc with countErrorLines, findReferenceBlock

  • test_lbexec_spruce_pp_default_flagging_persistreco_mc (DST) --flagging --persistreco with countErrorLines, findReferenceBlock

cc @amathad, @sstahl @cburr @decianm @mfontana

Edited by Nicole Skidmore

Merge request reports