Skip to content
Snippets Groups Projects

Archive the Legacy TrkKalmanFitter. It is not MT safe or maintained.

Merged Christos Anastopoulos requested to merge ATLAS-EGamma/athena:Kalman_archive_legacy into master

Archive the Legacy TrkKalmanFitter implementation. IT is the only ATLAS fitter not being MT-safe or planned to become and has not be maintained for a few years

One can use

  1. The ActsKalmanFitter implementations class ActsKalmanFitter : virtual public Trk::ITrackFitter, public AthAlgTool or
  2. The MT-safe HLT DistributedKalman implementation class DistributedKalmanFilter : virtual public ITrackFitter, public AthAlgTool

ping @vcairo , @ncalace , @npetters

Edited by Christos Anastopoulos

Merge request reports

Loading
Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • added 1 commit

    Compare with previous version

  • Christos Anastopoulos changed the description

    changed the description

  • added 1 commit

    Compare with previous version

  • Thanks Christos! Adding also @gfacini and @pagessin

  • Christos Anastopoulos changed the description

    changed the description

  • This merge request affects 9 packages:

    • InnerDetector/InDetConfig
    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@rbianchi as watchers

  • This merge request affects 9 packages:

    • InnerDetector/InDetConfig
    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@rbianchi as watchers

  • This merge request affects 9 packages:

    • InnerDetector/InDetConfig
    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@rbianchi as watchers

  • :negative_squared_cross_mark: CI Result FAILURE (hash a5370373)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :o: Athena: number of compilation errors 2, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49720]

  • :negative_squared_cross_mark: CI Result FAILURE (hash ebaa9712)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :o: Athena: number of compilation errors 2, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49726]

  • :negative_squared_cross_mark: CI Result FAILURE (hash dd4dccba)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :o: :white_check_mark: :warning: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :o: Athena: number of compilation errors 2, warnings 1
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :warning: AthGeneration: number of compilation errors 0, warnings 1
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49728]

  • Hi @christos,

    there are two issues to be addressed in the compilation, see error messages below.

    /var/lib/jenkins/workspace/CI-MERGE-REQUEST-CC7/master/Tracking/TrkValidation/TrkValTools/src/DirectTrackNtupleWriterTool.cxx:22:10: fatal error: TrkFitterUtils/ProtoTrackStateOnSurface.h: No such file or directory
       22 | #include "TrkFitterUtils/ProtoTrackStateOnSurface.h"
          |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    /var/lib/jenkins/workspace/CI-MERGE-REQUEST-CC7/master/InnerDetector/InDetExample/InDetRecExample/python/InDetRecExampleConfig.py:3:1: warning: F401 'AthenaCommon.CfgGetter' imported but unused
    from AthenaCommon import CfgGetter
    ^
    /var/lib/jenkins/workspace/CI-MERGE-REQUEST-CC7/master/InnerDetector/InDetExample/InDetRecExample/python/InDetRecExampleConfig.py:13:9: warning: F811 redefinition of unused 'CfgGetter' from line 3
            from AthenaCommon import CfgGetter
            ^

    Jakub (L1 shifter)

  • added 1 commit

    Compare with previous version

  • This merge request affects 12 packages:

    • InnerDetector/InDetConfig
    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • InnerDetector/InDetRecTools/InDetDNASeparator
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • Tracking/TrkValidation/TrkValInterfaces
    • Tracking/TrkValidation/TrkValTools
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@rbianchi as watchers

  • Christos Anastopoulos changed the description

    changed the description

  • Christos Anastopoulos changed the description

    changed the description

  • :negative_squared_cross_mark: CI Result FAILURE (hash 448132f1)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49765]

  • I am adding the full labels as I am removing quite a few things. After discussing with @akraszna seems the "safe" thing to do

    Edited by Christos Anastopoulos
  • added 65 commits

    Compare with previous version

  • :pencil: :pushpin: build area is cleaned as MR is labeled as full-build

  • This merge request affects 11 packages:

    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • InnerDetector/InDetRecTools/InDetDNASeparator
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • Tracking/TrkValidation/TrkValInterfaces
    • Tracking/TrkValidation/TrkValTools
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@rbianchi as watchers

  • :negative_squared_cross_mark: CI Result FAILURE (hash 8bc79fe2)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49778]

  • Christos Anastopoulos changed the description

    changed the description

  • Hmmm

    2022-04-06 03:07:44,376  electronInViewAlgs_LRT                             FATAL  Exception with tag=TrigFastTrackFinder__electronLRT is caught  
    2022-Apr-06 03:07:44,376 FATAL [ at electronInViewAlgs_LRT:1205748223] electronInViewAlgs_LRT:  Exception with tag=TrigFastTrackFinder__electronLRT is caught  
    2022-04-06 03:07:44,376  electronInViewAlgs_LRT                             ERROR TrigFastTrackFinder__electronLRT 	 Failed to retrieve tool Trk::KalmanFitter/InDetTrackFitter	 StatusCode=FAILURE 
    2022-Apr-06 03:07:44,376 ERROR [ at electronInViewAlgs_LRT:2058270728] electronInViewAlgs_LRT: TrigFastTrackFinder__electronLRT 	 Failed to retrieve tool Trk::KalmanFitter/InDetTrackFitter	 StatusCode=FAILURE 
    2022-04-06 03:07:44,376  electronInViewAlgs_LRT                             ERROR AthenaBaseComps/AthenaBaseComps/AthCommonDataStore.icc:43 (StatusCode AthCommonDataStore<PBASE>::sysInitialize() [with PBASE = AthCommonMsg<Gaudi::Sequence>]): code FAILURE: PBASE::sysInitialize() 

    @sutt, @jmasik ,@tamartin I had the impression we do really use that, but only the MT safe fitters

    Indeed I see https://acode-browser1.usatlas.bnl.gov/lxr/source/athena/Trigger/TrigAlgorithms/TrigFastTrackFinder/src/TrigFastTrackFinder.cxx#0062

      m_disTrkFitter("Trk::KalmanFitter/InDetTrackFitter"),

    but this must be a "default" I assumed the actual one should be whatever the InDetTrigFlags.trackFitterType() say it should be.

    I am drafting this one. But if is really used I would assume we might be in MT trouble here ... I assume some chains leave the default on rather than Chi2 or the HLT distributed Kalman ? I double this Kalman was meant to be "default" even ... I assumed this was the Chi2

    0471 class trackFitterType(InDetFlagsJobProperty):
    0472     """ control which fitter to be used: 'KalmanFitter', 'KalmanDNAFitter', 'DistributedKalmanFilter', 'GlobalChi2Fitter', 'GaussianSumFilter' """
    0473     statusOn     = True
    0474     allowedTypes = ['str']
    0475     allowedValues= ['KalmanFitter', 'KalmanDNAFitter', 'DistributedKalmanFilter', 'GlobalChi2Fitter', 'GaussianSumFilter', 'ReferenceKalmanFitter']
    0476     StoredValue  = 'GlobalChi2Fitter'

    The issue is not "keeping" it for a bit more, that would be fine, the issue is that is the one not ever be checked for MT safety, with mutable, and not sure who maintains it the last few years. And was convinced the HLT uses a different default here. (chi2 or distributedKalman which is HLT oriented and MT safe)

    Edited by Christos Anastopoulos
  • Hi @christos, the primary fitter the FTF uses is the fitter from Trigger/TrigTools/TrigInDetTrackFitter The second instance of a fitter for the disappearing tracks was introduced by @nagano thus it may be more question to him if it was a random choice and can be replaced cheers Jiri

  • OK

    good to know is used only for special cases ... and is a relatively new feature as could not undrstand how/when it enters ...

    Anyhow, I think is not the 1st time and prb you all know it . But fitters checked to be thread safe

    • Chi2
    • Distributed Kalman
    • iPat
    • GSF
    • TrigInDetTrackFitter

    Not checked to be thread safe and not sure on if is maintained at all (pretty sure is not at the moment)

    • TrkKalmanFitter

    At least if is used in MT we should check things make sense there. Try to at least pass the basic checker. I was not expecting a non-MT fitter to be used in production without anyone having tried to make it thread safe but maybe I miss something .

    I hope @nagano can comment, I recall this being mentioned in a JIRA in the long past also but do not recall the outcome.

    Edited by Christos Anastopoulos
  • Christos Anastopoulos marked this merge request as draft

    marked this merge request as draft

  • In the meantime will try to "fix it"

    0281   // UTT tools
    0282   if( m_doDisappearingTrk ) {
    0283      ATH_CHECK(m_extrapolator.retrieve());
    0284      ATH_MSG_DEBUG("Retrieved tool " << m_extrapolator);
    0285 
    0286      ATH_CHECK(m_disTrkFitter.retrieve());
    0287      ATH_MSG_DEBUG("Retrieved tool " << m_disTrkFitter);
    0288   }

    in master one should call disable explicitly . Which prb explains the number of FATAL here ... even if m_doDisappearingTrk master will retrieve defaults which makes everything fail ... so lets see if now we can pass the tests

    Edited by Christos Anastopoulos
  • added 1 commit

    • 826799ad - disable Trk::Kalman if no disappearing

    Compare with previous version

  • Jenkins please retry a build

  • :warning: WARNING: big files (>100K) are found in the changeset

    :pencil: 140K in file Trigger/TrigAlgorithms/TrigFastTrackFinder/src/TrigFastTrackFinder.cxx

  • :pencil: :pushpin: build area is cleaned as MR is labeled as full-build

  • This merge request affects 12 packages:

    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • InnerDetector/InDetRecTools/InDetDNASeparator
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • Tracking/TrkValidation/TrkValInterfaces
    • Tracking/TrkValidation/TrkValTools
    • Trigger/TrigAlgorithms/TrigFastTrackFinder
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@nagano ,@rbianchi as watchers

  • added Trigger TriggerID labels and removed review-pending-level-1 label

  • :white_check_mark: CI Result SUCCESS (hash 826799ad)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view. Check the JIRA CI status board for known problems
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49865]

  • Christos Anastopoulos marked this merge request as ready

    marked this merge request as ready

  • Jenkins please retry a build

  • :warning: WARNING: big files (>100K) are found in the changeset

    :pencil: 140K in file Trigger/TrigAlgorithms/TrigFastTrackFinder/src/TrigFastTrackFinder.cxx

  • :pencil: :pushpin: build area is cleaned as MR is labeled as full-build

  • This merge request affects 12 packages:

    • InnerDetector/InDetExample/InDetAlignExample
    • InnerDetector/InDetExample/InDetRecExample
    • InnerDetector/InDetMonitoring/InDetPerformanceMonitoring
    • InnerDetector/InDetRecTools/InDetDNASeparator
    • Tracking/TrkFitter/TrkDynamicNoiseAdjustor
    • Tracking/TrkFitter/TrkFitterInterfaces
    • Tracking/TrkFitter/TrkFitterUtils
    • Tracking/TrkFitter/TrkKalmanFitter
    • Tracking/TrkValidation/TrkValInterfaces
    • Tracking/TrkValidation/TrkValTools
    • Trigger/TrigAlgorithms/TrigFastTrackFinder
    • graphics/VP1/VP1Algs

    Affected files list will not be printed in this case

    Adding @goetz ,@amorley ,@martis ,@sroe ,@nagano ,@rbianchi as watchers

  • :negative_squared_cross_mark: CI Result FAILURE

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make N/A N/A N/A N/A N/A N/A
    required tests N/A N/A N/A N/A N/A N/A
    optional tests N/A N/A N/A N/A N/A N/A

    :exclamation: Due to problems in externals build or cmake configuration the job is stopped, results are not available on the ATLAS CI monitor :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 49904]

  • Jenkins please retry a build

  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
Please register or sign in to reply
Loading