Update Sprucing_production_pp to match turbospruce_2025
turbospruce_2025 further streams the WGs smaller subsets.
This matches what was done in production for the turbo sprucing campaigns 24cXa and the intended productions for 2025 turbo sprucing.
Sprucing_production_pp is now updated to have the same streaming logic.
This also improves the accuracy of the BW Tests (which use Sprucing_production_pp to configure the sprucing jobs)
Expected increase in Turbo Sprucing BW due to more fine streaming.
Changes
- Use options.input_streams_attributes_file rather than a hardcoded path
- Update Sprucing_production_pp with the new turbospruce_2025, and thus update BW's turbo_streams
- Remove now redundant turbospruce_2025 + update test to call straight from Sprucing_production_pp
- Refactors of turbospruce to match
Sprucing_production_ppand clarity/readability (doesn't change functionality of the existing script) - Minor BW Test changes
I've verified that Hlt2Conf.sprucing.test_turbospruce_2025 still passes with these changes locally, and ran a local BW Test
CI-tests
!4693 (comment 9382419) / lhcb-master-mr.13396, got a healthy BW Test without the 206 turbo lines that have no stream in master.
lhcb-master-mr.13396 hlt2_and_spruce vs reference
ToDo
-
Review from DPA -
Review from BW Tests -
This should not be merged until all the lines are fixed in master, else we kill the bw tests. #950 (closed)
Edited by Luke Grazette