[RTADPA BW Tests] Use new exp24 minbias for AllenInMoore_Hlt1_Bandwidth test

Requires: lhcb/Moore!2749 (merged)

---

Adds --digi flag to run_bw_test_jobs -> if args.digi download_digis_locally else download_mdfs_locally.
Changes EVENT_SIZE_UPPER_LIMIT to 400 now that we are using Digis.
Removes process-dependence on N_EVTS as the new sample has more than 1e5 events.
Removes muon_geometry_v2 from Hlt1 as is incorrect for new samples

---

Output + log (with build-locally) at /eos/lhcb/user/l/lugrazet/public/BWTesters/tmp-14-Nov/

---

ToDo:

• now using .digi again instead of .mdf, need to estimate the correct EVENT_SIZE_UPPER_LIMIT needed.

  • downloaded the first digi file, containing 1181 events and size of ls -lh <file.digi> = 364M
  • avg evtsize 308 kB/evt. -> Generously rounding to 400 to account for differences between files should be fine.
  • Double checking that this completes for N_EVTS=1e5 + -d locally and timing it. Finished successfully (taking 88:30/90:20 to run the job).

• HUGE RATES?!

  • Still using hlt1_pp_forward_then_matching_no_ut_no_gec, decided after some discussion with tim evans about the 'baseline' sequence before some post-Hlt1 BW Division-sequence has been implemented.
  • The Division should reduce this rate but still this is massive.
  • Attached screenshot of hlt1__rates_for_all_lines.html for reference.

• Review: Ross reviewed, MM channel had no comments on the message.

• ci-test

• TestFileDB addition @msaur requested

scripts/benchmark-scripts/Moore_bandwidth_test.sh

@@ -97,7 +97,8 @@ mkdir -p tmp/Output
 mkdir -p tmp/Output/Inter
 
 # Set configuration variables and check configuration makes sense
-# TODO: Remove Process Dependence on N_EVTS, see: https://gitlab.cern.ch/lhcb-datapkg/PRConfig/-/issues/12
+# ToDo: access n_evts from what was run over in the job, not N_EVTS i.e. evt_max as set here. see: https://gitlab.cern.ch/lhcb-datapkg/PRConfig/-/issues/12
+N_EVTS=1e5
 case $PROCESS in
     hlt1)
     MOORE_THREADS=1
@@ -107,7 +108,6 @@ case $PROCESS in
     STREAM_CONFIGS=( "streamless" )
     case $INPUTDATA in
         nominal)
-        N_EVTS=1e4
         CONFIG_FILE="${TEST_PATH_PREFIX}hlt1_bandwidth_input.yaml"
         EXTRA_OPTS="-e 1 $MOOREROOT/options/muon_geometry_v2.py" #Requires #EvtSlots==1 due to singlethreading on DIGIs.
         ;;
@@ -118,7 +118,6 @@ case $PROCESS in
     esac
     ;;
     hlt2)
-    N_EVTS=1e5
     MOORE_THREADS=$(nproc)
     TEST_PATH_PREFIX='$HLT2CONFROOT/tests/options/bandwidth/'
     EVENT_SIZE_UPPER_LIMIT=200
@@ -140,7 +139,6 @@ case $PROCESS in
     esac
     ;;
     spruce)
-    N_EVTS=1e5
     MOORE_THREADS=$(nproc)
     TEST_PATH_PREFIX='$HLT2CONFROOT/tests/options/bandwidth/'
     EVENT_SIZE_UPPER_LIMIT=300