Simplify and optimise PrLongLivedTracking
Simplify and optimise PrLongLivedTracking
Replace the old ghost-killing MLP model with a new one based on the new HLT2 NN framework (LHCb!4305 (merged)), in which the model is loaded from ParamFiles.
Requires lhcb-datapkg/ParamFiles!88 LHCb!4557
Checking results with fast_reco, which veto used SciFi seeds in PrMatchNN to avoid double reconstructing long tracks, the ghost rate reduce from ~50% to ~25%
- Using only chi2 criteria
ApplicationMgr INFO Application Manager Stopped successfully
DownstreamCheckerTrackChecker_5c... INFO Results
DownstreamCheckerTrackChecker_5c... INFO **** DownstreamChecker 270325 tracks including 155601 ghosts [57.56 %], Event average 49.64 % ****
DownstreamCheckerTrackChecker_5c... INFO 01_UT+T : 66823 from 929102 [ 7.19 %] 2 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.10 %
DownstreamCheckerTrackChecker_5c... INFO 02_UT+T_P>5GeV : 30058 from 571713 [ 5.26 %] 0 clones [ 0.00 %], purity: 99.37 %, hitEff: 98.98 %
DownstreamCheckerTrackChecker_5c... INFO 03_UT+T_strange : 28677 from 101376 [ 28.29 %] 1 clones [ 0.00 %], purity: 99.44 %, hitEff: 99.16 %
DownstreamCheckerTrackChecker_5c... INFO 04_UT+T_strange_P>5GeV : 15579 from 52577 [ 29.63 %] 0 clones [ 0.00 %], purity: 99.43 %, hitEff: 99.03 %
DownstreamCheckerTrackChecker_5c... INFO 05_noVelo+UT+T_strange : 25885 from 56196 [ 46.06 %] 1 clones [ 0.00 %], purity: 99.44 %, hitEff: 99.15 %
DownstreamCheckerTrackChecker_5c... INFO 06_noVelo+UT+T_strange_P>5GeV : 14785 from 30746 [ 48.09 %] 0 clones [ 0.00 %], purity: 99.43 %, hitEff: 99.03 %
DownstreamCheckerTrackChecker_5c... INFO 07_UT+T_fromDB : 5003 from 38792 [ 12.90 %] 0 clones [ 0.00 %], purity: 99.46 %, hitEff: 99.31 %
DownstreamCheckerTrackChecker_5c... INFO 08_UT+T_fromBD_P>5GeV : 3037 from 25796 [ 11.77 %] 0 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.25 %
DownstreamCheckerTrackChecker_5c... INFO 09_noVelo+UT+T_fromBD : 4160 from 9508 [ 43.75 %] 0 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.30 %
DownstreamCheckerTrackChecker_5c... INFO 10_noVelo+UT+T_fromBD_P>5GeV : 2715 from 5793 [ 46.87 %] 0 clones [ 0.00 %], purity: 99.50 %, hitEff: 99.25 %
DownstreamCheckerTrackChecker_5c... INFO 11_UT+T_SfromDB : 3769 from 10114 [ 37.27 %] 0 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.34 %
DownstreamCheckerTrackChecker_5c... INFO 12_UT+T_SfromDB_P>5GeV : 2537 from 6727 [ 37.71 %] 0 clones [ 0.00 %], purity: 99.50 %, hitEff: 99.28 %
DownstreamCheckerTrackChecker_5c... INFO 13_noVelo+UT+T_SfromDB : 3613 from 7177 [ 50.34 %] 0 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.34 %
DownstreamCheckerTrackChecker_5c... INFO 14_noVelo+UT+T_SfromDB_P>5GeV : 2485 from 4900 [ 50.71 %] 0 clones [ 0.00 %], purity: 99.50 %, hitEff: 99.26 %
DownstreamCheckerTrackChecker_5c... INFO - Using the new ghost-killing MLP
DownstreamCheckerTrackChecker_5c... INFO Results
DownstreamCheckerTrackChecker_5c... INFO **** DownstreamChecker 145396 tracks including 33469 ghosts [23.02 %], Event average 18.26 % ****
DownstreamCheckerTrackChecker_5c... INFO 01_UT+T : 61039 from 929102 [ 6.57 %] 2 clones [ 0.00 %], purity: 99.43 %, hitEff: 99.23 %
DownstreamCheckerTrackChecker_5c... INFO 02_UT+T_P>5GeV : 27509 from 571713 [ 4.81 %] 0 clones [ 0.00 %], purity: 99.43 %, hitEff: 99.08 %
DownstreamCheckerTrackChecker_5c... INFO 03_UT+T_strange : 25653 from 101376 [ 25.30 %] 1 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.26 %
DownstreamCheckerTrackChecker_5c... INFO 04_UT+T_strange_P>5GeV : 14254 from 52577 [ 27.11 %] 0 clones [ 0.00 %], purity: 99.48 %, hitEff: 99.11 %
DownstreamCheckerTrackChecker_5c... INFO 05_noVelo+UT+T_strange : 23041 from 56196 [ 41.00 %] 1 clones [ 0.00 %], purity: 99.50 %, hitEff: 99.26 %
DownstreamCheckerTrackChecker_5c... INFO 06_noVelo+UT+T_strange_P>5GeV : 13505 from 30746 [ 43.92 %] 0 clones [ 0.00 %], purity: 99.48 %, hitEff: 99.12 %
DownstreamCheckerTrackChecker_5c... INFO 07_UT+T_fromDB : 4758 from 38792 [ 12.27 %] 0 clones [ 0.00 %], purity: 99.49 %, hitEff: 99.40 %
DownstreamCheckerTrackChecker_5c... INFO 08_UT+T_fromBD_P>5GeV : 2922 from 25796 [ 11.33 %] 0 clones [ 0.00 %], purity: 99.50 %, hitEff: 99.32 %
DownstreamCheckerTrackChecker_5c... INFO 09_noVelo+UT+T_fromBD : 3937 from 9508 [ 41.41 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.38 %
DownstreamCheckerTrackChecker_5c... INFO 10_noVelo+UT+T_fromBD_P>5GeV : 2610 from 5793 [ 45.05 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.32 %
DownstreamCheckerTrackChecker_5c... INFO 11_UT+T_SfromDB : 3596 from 10114 [ 35.55 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.41 %
DownstreamCheckerTrackChecker_5c... INFO 12_UT+T_SfromDB_P>5GeV : 2447 from 6727 [ 36.38 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.33 %
DownstreamCheckerTrackChecker_5c... INFO 13_noVelo+UT+T_SfromDB : 3451 from 7177 [ 48.08 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.41 %
DownstreamCheckerTrackChecker_5c... INFO 14_noVelo+UT+T_SfromDB_P>5GeV : 2400 from 4900 [ 48.98 %] 0 clones [ 0.00 %], purity: 99.52 %, hitEff: 99.31 %
DownstreamCheckerTrackChecker_5c... INFO Edit May 14
After fixing the efficiency drop issue, now we are much better!
2024-patches (Baseline) without efficiency fix
DownstreamDefaultTrackChecker_ce... INFO **** DownstreamDefault 947274 tracks including 321661 ghosts [33.96 %], Event average 28.61 % ****
DownstreamDefaultTrackChecker_ce... INFO 01_UT+T : 544474 from 929102 [ 58.60 %] 11 clones [ 0.00 %], purity: 99.39 %, hitEff: 99.12 %
DownstreamDefaultTrackChecker_ce... INFO 02_UT+T_P>5GeV : 335626 from 571713 [ 58.71 %] 6 clones [ 0.00 %], purity: 99.35 %, hitEff: 98.89 %
DownstreamDefaultTrackChecker_ce... INFO 03_UT+T_strange : 54779 from 101376 [ 54.04 %] 1 clones [ 0.00 %], purity: 99.40 %, hitEff: 99.16 %
DownstreamDefaultTrackChecker_ce... INFO 04_UT+T_strange_P>5GeV : 28748 from 52577 [ 54.68 %] 1 clones [ 0.00 %], purity: 99.36 %, hitEff: 98.95 %
DownstreamDefaultTrackChecker_ce... INFO 05_noVelo+UT+T_strange : 26563 from 56196 [ 47.27 %] 0 clones [ 0.00 %], purity: 99.38 %, hitEff: 99.05 %
DownstreamDefaultTrackChecker_ce... INFO 06_noVelo+UT+T_strange_P>5GeV : 15191 from 30746 [ 49.41 %] 0 clones [ 0.00 %], purity: 99.35 %, hitEff: 98.92 %
DownstreamDefaultTrackChecker_ce... INFO 07_UT+T_fromDB : 22166 from 38792 [ 57.14 %] 0 clones [ 0.00 %], purity: 99.43 %, hitEff: 99.18 %
DownstreamDefaultTrackChecker_ce... INFO 08_UT+T_fromBD_P>5GeV : 14495 from 25796 [ 56.19 %] 0 clones [ 0.00 %], purity: 99.41 %, hitEff: 99.00 %
DownstreamDefaultTrackChecker_ce... INFO 09_noVelo+UT+T_fromBD : 4226 from 9508 [ 44.45 %] 0 clones [ 0.00 %], purity: 99.46 %, hitEff: 99.26 %
DownstreamDefaultTrackChecker_ce... INFO 10_noVelo+UT+T_fromBD_P>5GeV : 2666 from 5793 [ 46.02 %] 0 clones [ 0.00 %], purity: 99.44 %, hitEff: 99.17 %
DownstreamDefaultTrackChecker_ce... INFO 11_UT+T_SfromDB : 5387 from 10114 [ 53.26 %] 0 clones [ 0.00 %], purity: 99.47 %, hitEff: 99.21 %
DownstreamDefaultTrackChecker_ce... INFO 12_UT+T_SfromDB_P>5GeV : 3481 from 6727 [ 51.75 %] 0 clones [ 0.00 %], purity: 99.45 %, hitEff: 99.02 %
DownstreamDefaultTrackChecker_ce... INFO 13_noVelo+UT+T_SfromDB : 3592 from 7177 [ 50.05 %] 0 clones [ 0.00 %], purity: 99.47 %, hitEff: 99.29 %
DownstreamDefaultTrackChecker_ce... INFO 14_noVelo+UT+T_SfromDB_P>5GeV : 2414 from 4900 [ 49.27 %] 0 clones [ 0.00 %], purity: 99.46 %, hitEff: 99.16 %2024-patches (Baseline) after efficiency fix
DownstreamDefaultTrackChecker_ce... INFO **** DownstreamDefault 113863 tracks including 34200 ghosts [30.04 %], Event average 24.99 % ****
DownstreamDefaultTrackChecker_ce... INFO 01_UT+T : 70611 from 92327 [ 76.48 %] 3 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.59 %
DownstreamDefaultTrackChecker_ce... INFO 02_UT+T_P>5GeV : 47791 from 56536 [ 84.53 %] 2 clones [ 0.00 %], purity: 99.33 %, hitEff: 99.57 %
DownstreamDefaultTrackChecker_ce... INFO 03_UT+T_strange : 6757 from 10040 [ 67.30 %] 1 clones [ 0.01 %], purity: 99.36 %, hitEff: 99.47 %
DownstreamDefaultTrackChecker_ce... INFO 04_UT+T_strange_P>5GeV : 3926 from 5140 [ 76.38 %] 1 clones [ 0.03 %], purity: 99.32 %, hitEff: 99.50 %
DownstreamDefaultTrackChecker_ce... INFO 05_noVelo+UT+T_strange : 3366 from 5553 [ 60.62 %] 0 clones [ 0.00 %], purity: 99.35 %, hitEff: 99.38 %
DownstreamDefaultTrackChecker_ce... INFO 06_noVelo+UT+T_strange_P>5GeV : 2162 from 3056 [ 70.75 %] 0 clones [ 0.00 %], purity: 99.31 %, hitEff: 99.47 %
DownstreamDefaultTrackChecker_ce... INFO 07_UT+T_fromDB : 2978 from 3866 [ 77.03 %] 0 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.60 %
DownstreamDefaultTrackChecker_ce... INFO 08_UT+T_fromBD_P>5GeV : 2105 from 2516 [ 83.66 %] 0 clones [ 0.00 %], purity: 99.34 %, hitEff: 99.62 %
DownstreamDefaultTrackChecker_ce... INFO 09_noVelo+UT+T_fromBD : 565 from 976 [ 57.89 %] 0 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.67 %
DownstreamDefaultTrackChecker_ce... INFO 10_noVelo+UT+T_fromBD_P>5GeV : 394 from 574 [ 68.64 %] 0 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.84 %
DownstreamDefaultTrackChecker_ce... INFO 11_UT+T_SfromDB : 733 from 1032 [ 71.03 %] 0 clones [ 0.00 %], purity: 99.36 %, hitEff: 99.61 %
DownstreamDefaultTrackChecker_ce... INFO 12_UT+T_SfromDB_P>5GeV : 514 from 667 [ 77.06 %] 0 clones [ 0.00 %], purity: 99.38 %, hitEff: 99.71 %
DownstreamDefaultTrackChecker_ce... INFO 13_noVelo+UT+T_SfromDB : 490 from 724 [ 67.68 %] 0 clones [ 0.00 %], purity: 99.35 %, hitEff: 99.62 %
DownstreamDefaultTrackChecker_ce... INFO 14_noVelo+UT+T_SfromDB_P>5GeV : 357 from 483 [ 73.91 %] 0 clones [ 0.00 %], purity: 99.39 %, hitEff: 99.82 %This MR
DownstreamDefaultTrackChecker_ce... INFO **** DownstreamDefault 97942 tracks including 13341 ghosts [13.62 %], Event average 10.60 % ****
DownstreamDefaultTrackChecker_ce... INFO 01_UT+T : 73583 from 92327 [ 79.70 %] 4 clones [ 0.01 %], purity: 99.37 %, hitEff: 99.65 %
DownstreamDefaultTrackChecker_ce... INFO 02_UT+T_P>5GeV : 48903 from 56536 [ 86.50 %] 2 clones [ 0.00 %], purity: 99.33 %, hitEff: 99.63 %
DownstreamDefaultTrackChecker_ce... INFO 03_UT+T_strange : 6879 from 10040 [ 68.52 %] 2 clones [ 0.03 %], purity: 99.39 %, hitEff: 99.60 %
DownstreamDefaultTrackChecker_ce... INFO 04_UT+T_strange_P>5GeV : 3945 from 5140 [ 76.75 %] 1 clones [ 0.03 %], purity: 99.34 %, hitEff: 99.62 %
DownstreamDefaultTrackChecker_ce... INFO 05_noVelo+UT+T_strange : 3278 from 5553 [ 59.03 %] 1 clones [ 0.03 %], purity: 99.40 %, hitEff: 99.54 %
DownstreamDefaultTrackChecker_ce... INFO 06_noVelo+UT+T_strange_P>5GeV : 2127 from 3056 [ 69.60 %] 0 clones [ 0.00 %], purity: 99.35 %, hitEff: 99.63 %
DownstreamDefaultTrackChecker_ce... INFO 07_UT+T_fromDB : 3096 from 3866 [ 80.08 %] 0 clones [ 0.00 %], purity: 99.37 %, hitEff: 99.66 %
DownstreamDefaultTrackChecker_ce... INFO 08_UT+T_fromBD_P>5GeV : 2162 from 2516 [ 85.93 %] 0 clones [ 0.00 %], purity: 99.36 %, hitEff: 99.71 %
DownstreamDefaultTrackChecker_ce... INFO 09_noVelo+UT+T_fromBD : 581 from 976 [ 59.53 %] 0 clones [ 0.00 %], purity: 99.39 %, hitEff: 99.56 %
DownstreamDefaultTrackChecker_ce... INFO 10_noVelo+UT+T_fromBD_P>5GeV : 412 from 574 [ 71.78 %] 0 clones [ 0.00 %], purity: 99.40 %, hitEff: 99.89 %
DownstreamDefaultTrackChecker_ce... INFO 11_UT+T_SfromDB : 762 from 1032 [ 73.84 %] 0 clones [ 0.00 %], purity: 99.39 %, hitEff: 99.74 %
DownstreamDefaultTrackChecker_ce... INFO 12_UT+T_SfromDB_P>5GeV : 536 from 667 [ 80.36 %] 0 clones [ 0.00 %], purity: 99.41 %, hitEff: 99.92 %
DownstreamDefaultTrackChecker_ce... INFO 13_noVelo+UT+T_SfromDB : 506 from 724 [ 69.89 %] 0 clones [ 0.00 %], purity: 99.40 %, hitEff: 99.65 %
DownstreamDefaultTrackChecker_ce... INFO 14_noVelo+UT+T_SfromDB_P>5GeV : 375 from 483 [ 77.64 %] 0 clones [ 0.00 %], purity: 99.42 %, hitEff: 99.88 %