Updates in preparation of 2025 alignment
This moves the FTMatCalibrationMonitor to the Alignment project such that the mat contraction calibration can be run as part of the alignment iterations. The essential parts are:
- FTMatCalibrationMonitor: this fills the data structure used for the calibration. Eventually, it calls the update either from finalize or when an incident is fired. This algorithm is the equivalent of AlignmentAlgorithm.
- FTMatCalibrationUpdateTool: this computes the new calibration from the input data and updates the geometry condition. This is the equivalent of AlignUpdateTool. It is called either from FTMatCalibrationMonitor or from AlignOnlineIterator.
To communicate the accumulated data from the Monitor (aka accumulator, aka analyzer) to the UpdateTool (aka iterator), there are two approaches:
- a. use Gaudi histogram file.
- b. use a dedicated file format.
Solution 'b' is the one used for the alignment, because storing the alignment data in histograms is not very flexible. For the mat calibration we have now implemented solution 'a' since that requires the fewest changes to MooreOnline. Solution 'b' is halfway implemented, and we can switch to it with a bit more development work in MooreOnline and a reasonably trivial update of AlignOnlineIterator.
As part of this update, also development work was done on the mat calibration algorithm itself:
- make the FTMatCalibrationMonitor an incident listener such that we can trigger an update from the alignment iteration loop
- use datasvc::update_condition to update the condition. This has the advantage that the yaml file will be written in the correct place by a call to datasvc::write_alignment. (No need to specify the path in the calibration alg.)
- turn the determination of the fit of slope and position per ASIC die into a real chi2 fit to the unbiased residuals, including their errors. This has the advantage that we get meaningful errors on the parameters.
Finally, some more maintenance was done.
This goes together with
Merge request reports
Activity
/ci-test Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Detector!653 Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
/ci-test Detector!653 Rec!4161 LHCb!4777 MooreOnline!529
Started integration test build. Once done, check the results or the comparison to a reference build.
Throughput Test MooreOnline_hlt2_pp_2024_data: 169.8 Events/s -- change of 0.65% vs. reference
Two MooreOnline tests still fail because of a time-out. These tests are new, but in an earlier stage of this MR the tests were fine, so I don't quite understand what happened. (I have done some timing tests and seems that the geometry update is slow, but I wouldn't know why.) @msaur, shall I just disable these tests again, or is there a way we can adjust. the time-out value?
Edited by Wouter HulsbergenIt is included it the %RTA 2025 Data taking milestone, so surely this will be merged before data taking. Just at this moment there are little too many tests ongoing. Or do you need to have this well before data taking for specific Alignment tests in the pit?
added RTA label
mentioned in merge request MooreOnline!529
added 7 commits
- 60ef2f41 - fix error in specifying survey
- de917e97 - extend ConvergenceStatus flag
- e931497e - remove filling of Alignment histograms (as it generates a lot of them)
- ec33180e - added upstream track selection
- 1ada7cf0 - remove FTMatCalibMonitor from alignment_tracking
- 1322f6b5 - move FTMatCalibrationMonitor from Rec to Alignment
- 05697d20 - include ft mat calib monitor
Toggle commit listmentioned in merge request Rec!4161
added ci-test-triggered label
- [2025-01-04 14:10] Validation started with lhcb-master-mr#12154
- [2025-01-05 20:53] Validation started with lhcb-master-mr#12157
- [2025-03-06 23:27] Validation started with lhcb-master-mr#12797
- [2025-03-07 09:10] Validation started with lhcb-master-mr#12799
- [2025-03-07 16:52] Validation started with lhcb-master-mr#12804
- [2025-03-08 06:59] Validation started with lhcb-master-mr#12807
- [2025-03-10 16:09] Validation started with lhcb-master-mr#12825
- [2025-03-16 09:29] Validation started with lhcb-master-mr#12898
Edited by Software for LHCbadded 1 commit
- b2891b4e - add topion to constrain the difference between parameters
added 33 commits
-
e3b7a1f6...8e0134ad - 22 commits from branch
master
- a34b9316 - 1 earlier commit
- 138e62d2 - fix error in specifying survey
- 2e683ca5 - extend ConvergenceStatus flag
- 82ab17c0 - remove filling of Alignment histograms (as it generates a lot of them)
- 52c4bfb3 - added upstream track selection
- 1f44b56d - remove FTMatCalibMonitor from alignment_tracking
- 6a27d2b3 - move FTMatCalibrationMonitor from Rec to Alignment
- 551db335 - include ft mat calib monitor
- 5f6d83ae - added more TrackMonitor histograms
- e8a67867 - add topion to constrain the difference between parameters
- dc0cbc34 - add counter per track type to AlEquations
Toggle commit list-
e3b7a1f6...8e0134ad - 22 commits from branch
mentioned in issue Moore#910 (closed)
added 25 commits
-
dc0cbc34...e576ca00 - 14 commits from branch
master
- 484f2b3f - 1 earlier commit
- 818b7a3a - fix error in specifying survey
- bb5978ea - extend ConvergenceStatus flag
- 83db2444 - remove filling of Alignment histograms (as it generates a lot of them)
- 5ae707e8 - added upstream track selection
- 1ed8eb93 - remove FTMatCalibMonitor from alignment_tracking
- 0a34d8c0 - move FTMatCalibrationMonitor from Rec to Alignment
- 0a690c3f - include ft mat calib monitor
- a83e24f8 - added more TrackMonitor histograms
- 10a8137f - add topion to constrain the difference between parameters
- 2b6250d4 - add counter per track type to AlEquations
Toggle commit list-
dc0cbc34...e576ca00 - 14 commits from branch
added 1 commit
- 0018226e - replaced std::map by unsorted_map in AlEquations
mentioned in issue Moore#915 (closed)
added 10 commits
- 74f5978a - include ft mat calib monitor
- 17aa0564 - added more TrackMonitor histograms
- ceec80b3 - add topion to constrain the difference between parameters
- baf59881 - add counter per track type to AlEquations
- 42a9d993 - update of FTMatCalibrationUpdateTool
- 10dc2dc4 - make sure surveychi2 computed in the right frame in AlignUpdateTool
- 384af416 - * add alignable for UT layers
- 381796d9 - disable FT halfmodule survey constraints since we cannot yet apply them
- 27d27490 - add counter for average PV position to alignlog
- 9b1204fe - introduce AlignmentConfig class to make configurations more homogeneous
Toggle commit listadded 1 commit
- bc2d599b - introduce AlignmentConfig class to make configurations more homogeneous
added 1 commit
- 16476194 - introduce AlignmentConfig class to make configurations more homogeneous
added 6 commits
- cca53d6f - update of FTMatCalibrationUpdateTool
- 31f1395a - make sure surveychi2 computed in the right frame in AlignUpdateTool
- 847d2c32 - * add alignable for UT layers
- f00f5103 - disable FT halfmodule survey constraints since we cannot yet apply them
- 96ca5137 - add counter for average PV position to alignlog
- 50fb63a5 - introduce AlignmentConfig class to make configurations more homogeneous
Toggle commit listadded 27 commits
-
50fb63a5...dbf64ea5 - 10 commits from branch
master
- dbf64ea5...1195a1f5 - 7 earlier commits
- a330bf2b - include ft mat calib monitor
- 139e3acf - added more TrackMonitor histograms
- 228a1667 - add topion to constrain the difference between parameters
- 7ca08649 - add counter per track type to AlEquations
- f82ff2d4 - update of FTMatCalibrationUpdateTool
- e4263e4e - make sure surveychi2 computed in the right frame in AlignUpdateTool
- 9282f543 - * add alignable for UT layers
- e1ffbb04 - disable FT halfmodule survey constraints since we cannot yet apply them
- c59c512f - add counter for average PV position to alignlog
- 836847bb - introduce AlignmentConfig class to make configurations more homogeneous
Toggle commit list-
50fb63a5...dbf64ea5 - 10 commits from branch
mentioned in merge request Detector!653
added 1 commit
- 648f9fbe - add AlignFTMat_Analyzer and Iterator for use in MooreOnline test
added 1 commit
- bcd0fb25 - add AlignFTMat_Analyzer and Iterator for use in MooreOnline test
added 8 commits
- 35b241a6 - update of FTMatCalibrationUpdateTool
- 498a83a5 - make sure surveychi2 computed in the right frame in AlignUpdateTool
- ec90fb86 - * add alignable for UT layers
- 1edc4314 - disable FT halfmodule survey constraints since we cannot yet apply them
- 0d8304aa - add counter for average PV position to alignlog
- a95c2bb1 - introduce AlignmentConfig class to make configurations more homogeneous
- adc6f3e1 - add AlignFTMat_Analyzer and Iterator for use in MooreOnline test
- ec05f259 - add replace_symlinks.py and copy_to_conditions_database.py
Toggle commit listmentioned in issue Moore#927 (closed)
mentioned in issue Moore#936
added 4 commits
- 7fde5d37 - introduce AlignmentConfig class to make configurations more homogeneous
- 4e5b56b8 - add AlignFTMat_Analyzer and Iterator for use in MooreOnline test
- 8564e7f4 - add replace_symlinks.py and copy_to_conditions_database.py
- 517c7fdd - added AlignSegmentExtracter: this can be used to extract T segments from long...
Toggle commit list