Preparing options for sprucing 2025
Aim is to make exclusive sprucing behave like turbospruce in terms of input configs.
-
Note I tried to avoid this initially but doing all the stream assignments in
make_streams(the only way you can accessline.stream) was very inefficient. -
Before running the exclusive Sprucing now we save the SpruceLine config as demonstrated in
test_excl_spruce_2025_lineconfig.qmt. -
This is then input to the job just like is done for turbospruce.
-
Along with the hard-coded streaming json file the lineconfig is modified such that all lines are in the right stream.
-
The difference with turbospruce then comes with running the lines, the lineconfig here is only used for the streaming and the builders are invoked directly for the job (rather than remaking lines as done in turbospruce)
-
Note the change to
get_hlt2_streaming, we understand this as we are now requesting anoutput_fileand this changes the cf by here -
Have removed the tests
Hlt2Conf.sprucing.test_excl_spruce_2023_1_data, Hlt2Conf.sprucing.test_excl_spruce_2023_2_datawhich were failing as we no longer build the cache. But they are not required any longer in master/2025-patches
To go with !4832 (merged) and lhcb-datapkg/SprucingConfig!64 (merged)