Skip to content

Add configuration for the residual algorithms

Peilian Li requested to merge peilian_testForResidual into master

Add configuration for the residual algorithms to remove redundancy between two long tracks and the downstream tracks.

Some more details can be found at https://indico.cern.ch/event/911373/ .

Part of https://gitlab.cern.ch/groups/lhcb/-/milestones/2 .

In details:

  • PrForwardTracking takes the residual Velo tracks, SciFi hits and UT hits of match tracks as inputs

  • PrLonglivedTracks takes the residual seed tracks, UT hits of match tracks as inputs

  • Add an option fast_reco for make_hlt2_tracks and standalone_hlt2_full_track_reco;

  • Add two option files for fast_reco: hlt2_fast_reco_tracking.py and hlt2_fast_reco_tracking_with_mcchecking.py accordingly.

To be merged after !517 (merged) cc @sstahl

Note:

  • Currently the fromTrackv2PrSeedingTrack algorithm takes relatively long time, this would be solved once the issue in Rec be addressed;
  • The residual tracks/hits of PrMatchNN are taken as inputs for PrForwardTracking and PrLonglivedTracks; if the residual of BestMatch are taken as inputs, the efficiencies would increase a little bit.

Efficiency & time comparisons between baseline_hlt2_reco and fast_reco: (run 100 Bs2PhiPhi evts):

++Efficiency `of BestLongTracks` in `baseline_hlt2_reco` 
BestLongTrackChecker                   INFO **** BestLong                            7567 tracks including           1069 ghosts [14.13 %], Event average 12.72 % ****
BestLongTrackChecker                   INFO   01_long                           :    5703 from     6643 [ 85.85 %]     11 clones [ 0.19 %], purity: 99.06 %, hitEff: 95.70 %
BestLongTrackChecker                   INFO   02_long_P>5GeV                    :    3839 from     4210 [ 91.19 %]      4 clones [ 0.10 %], purity: 99.11 %, hitEff: 97.15 %
BestLongTrackChecker                   INFO   03_long_strange                   :     263 from      322 [ 81.68 %]      0 clones [ 0.00 %], purity: 98.75 %, hitEff: 94.16 %
BestLongTrackChecker                   INFO   04_long_strange_P>5GeV            :     137 from      148 [ 92.57 %]      0 clones [ 0.00 %], purity: 98.80 %, hitEff: 97.15 %
BestLongTrackChecker                   INFO   05_long_fromB                     :     359 from      400 [ 89.75 %]      0 clones [ 0.00 %], purity: 99.24 %, hitEff: 96.56 %
BestLongTrackChecker                   INFO   06_long_fromB_P>5GeV              :     296 from      311 [ 95.18 %]      0 clones [ 0.00 %], purity: 99.18 %, hitEff: 97.12 %
BestLongTrackChecker                   INFO   07_long_electrons                 :     318 from      515 [ 61.75 %]      1 clones [ 0.31 %], purity: 98.10 %, hitEff: 92.73 %
BestLongTrackChecker                   INFO   08_long_fromB_electrons           :       7 from       11 [ 63.64 %]      0 clones [ 0.00 %], purity: 98.30 %, hitEff: 95.37 %
BestLongTrackChecker                   INFO   09_long_fromB_electrons_P>5GeV    :       5 from        6 [ 83.33 %]      0 clones [ 0.00 %], purity: 97.62 %, hitEff: 94.38 %
BestLongTrackChecker                   INFO   10_long_fromB_P>3GeV_Pt>0.5GeV    :     292 from      313 [ 93.29 %]      0 clones [ 0.00 %], purity: 99.13 %, hitEff: 97.00 %
BestLongTrackChecker                   INFO   11_UT_long_fromB_P>3GeV_Pt>0.5GeV :     292 from      312 [ 93.59 %]      0 clones [ 0.00 %], purity: 99.13 %, hitEff: 97.00 %

++Efficiency of BestLongTracks in fast_reco

BestLongTrackChecker                   INFO **** BestLong                            7217 tracks including            851 ghosts [11.79 %], Event average 10.72 % ****
BestLongTrackChecker                   INFO   01_long                           :    5626 from     6643 [ 84.69 %]      9 clones [ 0.16 %], purity: 99.09 %, hitEff: 95.61 %
BestLongTrackChecker                   INFO   02_long_P>5GeV                    :    3805 from     4210 [ 90.38 %]      4 clones [ 0.11 %], purity: 99.14 %, hitEff: 97.07 %
BestLongTrackChecker                   INFO   03_long_strange                   :     254 from      322 [ 78.88 %]      0 clones [ 0.00 %], purity: 98.87 %, hitEff: 94.19 %
BestLongTrackChecker                   INFO   04_long_strange_P>5GeV            :     133 from      148 [ 89.86 %]      0 clones [ 0.00 %], purity: 98.80 %, hitEff: 97.15 %
BestLongTrackChecker                   INFO   05_long_fromB                     :     355 from      400 [ 88.75 %]      0 clones [ 0.00 %], purity: 99.25 %, hitEff: 96.59 %
BestLongTrackChecker                   INFO   06_long_fromB_P>5GeV              :     293 from      311 [ 94.21 %]      0 clones [ 0.00 %], purity: 99.18 %, hitEff: 97.10 %
BestLongTrackChecker                   INFO   07_long_electrons                 :     291 from      515 [ 56.50 %]      0 clones [ 0.00 %], purity: 98.13 %, hitEff: 92.71 %
BestLongTrackChecker                   INFO   08_long_fromB_electrons           :       7 from       11 [ 63.64 %]      0 clones [ 0.00 %], purity: 98.30 %, hitEff: 95.37 %
BestLongTrackChecker                   INFO   09_long_fromB_electrons_P>5GeV    :       5 from        6 [ 83.33 %]      0 clones [ 0.00 %], purity: 97.62 %, hitEff: 94.38 %
BestLongTrackChecker                   INFO   10_long_fromB_P>3GeV_Pt>0.5GeV    :     288 from      313 [ 92.01 %]      0 clones [ 0.00 %], purity: 99.12 %, hitEff: 97.00 %
BestLongTrackChecker                   INFO   11_UT_long_fromB_P>3GeV_Pt>0.5GeV :     288 from      312 [ 92.31 %]      0 clones [ 0.00 %], purity: 99.12 %, hitEff: 97.00 %

++Time of all the reconstruction algorithms: (roughly estimated according to the record time in the test)

time of PrSeedingTracks + PrMatchNN + PrForwardTracking + PrLonglivedTracks+ PrResidualVeloTracks + PrResidualSciFi PrResidualPrUTHits + PrResiudalSeedTracks + PrResidualUTHits: 
baseline_hlt2_reco: 2.922 + 0.750 + 7.230 + 6.027 = 16.929
fast_reco: 2.922 + 0.750 + 2.372 + 1.676 + 0.014 + 0.113 + 0.017 + 0.011 + 0.373 = 8.248

Test for 100 KstEE events: ++Efficiency of BestLongTrack in baseline_hlt2_reco:

BestLongTrackChecker                   INFO **** BestLong                            6808 tracks including            897 ghosts [13.18 %], Event average 12.47 % ****
BestLongTrackChecker                   INFO   01_long                           :    5086 from     5858 [ 86.82 %]     20 clones [ 0.39 %], purity: 99.11 %, hitEff: 95.84 %
BestLongTrackChecker                   INFO   02_long_P>5GeV                    :    3348 from     3638 [ 92.03 %]      3 clones [ 0.09 %], purity: 99.23 %, hitEff: 97.38 %
BestLongTrackChecker                   INFO   03_long_strange                   :     212 from      266 [ 79.70 %]      1 clones [ 0.47 %], purity: 99.21 %, hitEff: 94.78 %
BestLongTrackChecker                   INFO   04_long_strange_P>5GeV            :     104 from      125 [ 83.20 %]      0 clones [ 0.00 %], purity: 99.41 %, hitEff: 97.41 %
BestLongTrackChecker                   INFO   05_long_fromB                     :     235 from      256 [ 91.80 %]      1 clones [ 0.42 %], purity: 99.48 %, hitEff: 96.96 %
BestLongTrackChecker                   INFO   06_long_fromB_P>5GeV              :     183 from      191 [ 95.81 %]      1 clones [ 0.54 %], purity: 99.46 %, hitEff: 97.60 %
BestLongTrackChecker                   INFO   07_long_electrons                 :     352 from      536 [ 65.67 %]      0 clones [ 0.00 %], purity: 98.41 %, hitEff: 93.90 %
BestLongTrackChecker                   INFO   08_long_fromB_electrons           :     121 from      144 [ 84.03 %]      0 clones [ 0.00 %], purity: 98.91 %, hitEff: 96.29 %
BestLongTrackChecker                   INFO   09_long_fromB_electrons_P>5GeV    :     114 from      133 [ 85.71 %]      0 clones [ 0.00 %], purity: 99.00 %, hitEff: 96.58 %
BestLongTrackChecker                   INFO   10_long_fromB_P>3GeV_Pt>0.5GeV    :     175 from      183 [ 95.63 %]      1 clones [ 0.57 %], purity: 99.52 %, hitEff: 97.47 %
BestLongTrackChecker                   INFO   11_UT_long_fromB_P>3GeV_Pt>0.5GeV :     175 from      183 [ 95.63 %]      1 clones [ 0.57 %], purity: 99.52 %, hitEff: 97.47 %

++Efficiency of BestLongTrack in fast_reco:

BestLongTrackChecker                   INFO **** BestLong                            6531 tracks including            727 ghosts [11.13 %], Event average 10.63 % ****
BestLongTrackChecker                   INFO   01_long                           :    5025 from     5858 [ 85.78 %]     14 clones [ 0.28 %], purity: 99.16 %, hitEff: 95.75 %
BestLongTrackChecker                   INFO   02_long_P>5GeV                    :    3317 from     3638 [ 91.18 %]      3 clones [ 0.09 %], purity: 99.25 %, hitEff: 97.29 %
BestLongTrackChecker                   INFO   03_long_strange                   :     208 from      266 [ 78.20 %]      1 clones [ 0.48 %], purity: 99.14 %, hitEff: 94.60 %
BestLongTrackChecker                   INFO   04_long_strange_P>5GeV            :     104 from      125 [ 83.20 %]      0 clones [ 0.00 %], purity: 99.38 %, hitEff: 97.30 %
BestLongTrackChecker                   INFO   05_long_fromB                     :     232 from      256 [ 90.62 %]      1 clones [ 0.43 %], purity: 99.46 %, hitEff: 96.74 %
BestLongTrackChecker                   INFO   06_long_fromB_P>5GeV              :     181 from      191 [ 94.76 %]      1 clones [ 0.55 %], purity: 99.43 %, hitEff: 97.41 %
BestLongTrackChecker                   INFO   07_long_electrons                 :     334 from      536 [ 62.31 %]      0 clones [ 0.00 %], purity: 98.41 %, hitEff: 93.81 %
BestLongTrackChecker                   INFO   08_long_fromB_electrons           :     119 from      144 [ 82.64 %]      0 clones [ 0.00 %], purity: 98.96 %, hitEff: 96.37 %
BestLongTrackChecker                   INFO   09_long_fromB_electrons_P>5GeV    :     112 from      133 [ 84.21 %]      0 clones [ 0.00 %], purity: 99.06 %, hitEff: 96.68 %
BestLongTrackChecker                   INFO   10_long_fromB_P>3GeV_Pt>0.5GeV    :     174 from      183 [ 95.08 %]      1 clones [ 0.57 %], purity: 99.49 %, hitEff: 97.28 %
BestLongTrackChecker                   INFO   11_UT_long_fromB_P>3GeV_Pt>0.5GeV :     174 from      183 [ 95.08 %]      1 clones [ 0.57 %], purity: 99.49 %, hitEff: 97.28 %

++Time of all the reconstruction algorithms: (roughly estimated according to the record time in the test)

time of PrSeedingTracks + PrMatchNN + PrForwardTracking + PrLonglivedTracks+ PrResidualVeloTracks + PrResidualSciFi PrResidualPrUTHits + PrResiudalSeedTracks + PrResidualUTHits: 
baseline_hlt2_reco: 2.274 + 0.683 + 5.820 + 5.433 = 14.21
fast_reco: 2.274 + 0.683 + 2.365 + 1.530 + 0.013 + 0.097 + 0.016 + 0.010 + 0.339 = 7.327

Reference files updated in !579 (merged)

Edited by Alexandre Brea Rodriguez

Merge request reports