Skip to content
Snippets Groups Projects

Fix tau hypo configurations

Merged Edson Carquin Lopez requested to merge carquin/athena:master-fi-hypo-configuration into master
All threads resolved!

Trying to remove spurious selections applied after preselection step for tracktwo and track chains. Also removing selections applied after fast tracking (core, iso and isobdt) steps, all of these were not applied during Run 2 (AFAIK) I think this changes could also fix the phi modulation and other weird ET distributions seen during validation checks ATR-22883. I'm attaching HLT_tau25_mediumRNN_tracktwoMVA Run 2 chain configuration

HLT_tau25_mediumRNN_tracktwoMVA

Edited by Edson Carquin Lopez

Merge request reports

Pipeline #2441883 passed

Pipeline passed for d3db1832 on carquin:master-fi-hypo-configuration

Merged by Walter LamplWalter Lampl 3 years ago (Mar 29, 2021 1:40pm UTC)

Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Edson Carquin Lopez changed the description

    changed the description

  • Antonio De Maria
  • Naive question: Is there a way to test these changes to check if they're really responsible for the phi modulation and other weird ET distributions that you're seeing before it gets merged? I.e. running on a large-ish enough sample locally? Or do you need high stats for this?

  • Hi @bernius, I don't know whether these changes will fix the issues that we see in the validation or not, but these are the most likely suspects. In any case we need these changes even if they are not the fix since the configuration of these hypos was wrong. I'm running a large scale test on the grid to see whether the problems are gone or not with these changes. (And this MR is still WIP) Cheers, E

    Edited by Edson Carquin Lopez
  • This merge request affects 3 packages:

    • Trigger/TrigHypothesis/TrigTauHypo
    • Trigger/TrigValidation/TrigAnalysisTest
    • Trigger/TriggerCommon/TriggerMenuMT

    Affected files list will not be printed in this case

    Adding @sutt ,@martindl ,@ademaria ,@vmartin ,@okumura ,@carquin ,@dzanzi ,@bernius ,@hrussell ,@malconad as watchers

  • Very good, thanks for the info @carquin!

  • :negative_squared_cross_mark: CI Result FAILURE (hash 712d0a07)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :warning: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :cloud: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :warning: Athena: number of compilation errors 0, warnings 1
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 30392]

  • Daniele Zanzi
  • Edson Carquin Lopez changed the description

    changed the description

  • added 57 commits

    Compare with previous version

  • added 95 commits

    Compare with previous version

  • Jenkins please retry a build

  • This merge request affects 4 packages:

    • Trigger/TrigHypothesis/TrigTauHypo
    • Trigger/TrigValidation/TrigAnalysisTest
    • Trigger/TrigValidation/TriggerTest
    • Trigger/TriggerCommon/TriggerMenuMT

    Affected files list will not be printed in this case

    Adding @sutt ,@martindl ,@ademaria ,@vmartin ,@okumura ,@carquin ,@dzanzi ,@bernius ,@hrussell ,@malconad as watchers

  • :white_check_mark: CI Result SUCCESS (hash 6861c651)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 30592]

  • Hello @carquin, overall the MR looks good to me... just let me bring up something we discussed and still don't fully understand.

    I agree we should bypass the "TrigTrackPreSelHypo" (the one which is cutting on Iso track and Core Track) for tracktwoEF/tracktwoMVA/tracktwoMVABDT since for these chains we are not applying any preselection step. However, I'm still not getting why we should not apply these cuts on track/tracktwo chains.

    Looking at https://cds.cern.ch/record/2274201/files/ATLAS-CONF-2017-061.pdf (page 5), it mentions that these cuts have been applied after the two-stage fast tracking at least until 2017. Also looking at these notes (guess @martindl wrote this) :

    https://gitlab.cern.ch/atlas-perf-tau/perf-Tau-Documentation/tau-perf-supportNote-18-19/-/blob/master/sections/reco_id.tex#L167

    Dropping Iso track and Core Track cuts at FTF stage and move the ntrack cut at Precision track level was what brought the transition tracktwo -> tracktwoEF (2018).

    So if we want to reproduce the behaviour of track/tracktwo chains in data-taking until 2017, then I think the Iso track and Core Track cuts must be applied.

    Edited by Antonio De Maria
  • Hello @carquin, as this MR is fixing a bug for the tracktwoEF/tracktwoMVA/tracktwoMVABDT which are for now higher priority chain for validation, please go ahead with this MR. We still cannot claim we solved the phi efficiency modulation for track/tracktwo chains as the changes here are essentially turning off the Preselection step, but we can continue investigating this and place fix in another MR

  • Antonio De Maria resolved all threads

    resolved all threads

  • Edson Carquin Lopez added 146 commits

    added 146 commits

    Compare with previous version

  • Ok, thanks @ademaria I'll unWIP the MR now!

  • (after fixing the conflicts of course )

  • great, thanks .... make sure to remove the print messages so review will go smother ;)

    Also please do not remove the Hypo properties like

    Gaudi::Property m_tracksInCoreCut{ this, "tracksInCoreCut", 3, "" };

    Just make sure we by-pass the hypo but leave the code there so we can come back to this later in easier way

    Edited by Antonio De Maria
  • added 92 commits

    Compare with previous version

  • No worries, those lines are removed from the fully dummy hypo only

  • Edson Carquin Lopez marked this merge request as ready

    marked this merge request as ready

  • This merge request affects 4 packages:

    • Trigger/TrigHypothesis/TrigTauHypo
    • Trigger/TrigValidation/TrigAnalysisTest
    • Trigger/TrigValidation/TriggerTest
    • Trigger/TriggerCommon/TriggerMenuMT

    Affected files list will not be printed in this case

    Adding @sutt ,@martindl ,@ademaria ,@vmartin ,@okumura ,@carquin ,@dzanzi ,@bernius ,@hrussell ,@malconad as watchers

  • :white_check_mark: CI Result SUCCESS (hash d3db1832)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :cloud: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :white_check_mark: DetCommon: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 30788]

  • added urgent label

  • The optional test is failing because it spent its time quota (30 min).
    All changes look fine. Approving

    Cheers, Francisco (L1)

  • added review-approved label and removed review-pending-level-1 label

  • merged

  • Walter Lampl mentioned in commit a36c0287

    mentioned in commit a36c0287

  • Please register or sign in to reply
    Loading