Skip to content
Snippets Groups Projects

Master tmdb overlay

Merged Joao Gentil Mendes Saraiva requested to merge jmendes/athena:master-tmdb-overlay into master

MC Overlay included in TMDB for L1 Muon Simulation

Edited by Joao Gentil Mendes Saraiva

Merge request reports

Pipeline #2282492 passed

Pipeline passed for ab4d4775 on jmendes:master-tmdb-overlay

Merged by Walter LamplWalter Lampl 4 years ago (Feb 3, 2021 4:51pm UTC)

Loading

Activity

Filter activity
  • Approvals
  • Assignees & reviewers
  • Comments (from bots)
  • Comments (from users)
  • Commits & branches
  • Edits
  • Labels
  • Lock status
  • Mentions
  • Merge request status
  • Tracking
  • Tadej Novak
  • I have run the tests detailed in the following JIRA ticket https://its.cern.ch/jira/browse/ATLASSIM-3637 not easy for me to conclude if they are the same or not. Could though run the ones you ask above.

  • ./test_MCOverlay_ConfigTest_ttbar.sh > /tmp/jmendes/test1.out test1.out

    ./test_MCOverlay_ttbar_Old_vs_New.sh > /tmp/jmendes/test2.out test2.out

  • added 1 commit

    Compare with previous version

  • This merge request affects 1 package:

    • TileCalorimeter/TileSimAlgs

    Adding @pavol ,@solodkov ,@harkusha as watchers

  • :negative_squared_cross_mark: CI Result FAILURE (hash e40fc131)

    Athena AthSimulation AthGeneration AnalysisBase
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 22143]

  • There are errors in the OverlayTier0Test

    ERROR Py:diff-root INFO [TileDigitsContainer_p3_MuRcvDigitsCnt.m_cont.m_digits]: 107994 leaves differ

    ERROR Py:diff-root INFO [TileMuonReceiverContainer_p1_TileMuRcvCnt.m_data]: 4 leaves differ

    ERROR Py:diff-root INFO [TileRawChannelContainer_p1_MuRcvRawChCnt.m_cont.m_data]: 57600 leaves differ

  • added 1 commit

    • 3fc3e3f1 - MC Overlay implemented for the TMDB for Run 3 simulation of the L1 muon trigger.

    Compare with previous version

  • This merge request affects 2 files:

    • TileCalorimeter/TileSimAlgs/src/TilePulseForTileMuonReceiver.cxx
    • TileCalorimeter/TileSimAlgs/src/TilePulseForTileMuonReceiver.h

    Adding @pavol ,@solodkov ,@harkusha as watchers

  • Pushed a new version with m_mergeSvc initialization is controlled by an if statement. The leafs differences above reported looks to be from the specific test since I did not detect any difference on the containers on the normal path. This update is in fact to implement the MC overlay for simulations and there is no frozen result to compare with.

  • yes, difference is expected because up to now overlay for TMDB was not done at all, i.e. only signal was taken, background was ignored

  • :negative_squared_cross_mark: CI Result FAILURE (hash 3fc3e3f1)

    Athena AthSimulation AthGeneration AnalysisBase
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 22530]

  • Hi @jmendes ,

    this MR was not touched for a while, could you please have a look, and decide what to do with it ?

    Thanks, Pavol [as L2 MR shifter]

  • Bugs have been identified and as soon as local tests are concluded will push a new version.

  • added 5080 commits

    • 3fc3e3f1...0ca124bf - 5076 commits from branch atlas:master
    • 10e1401f - Merge remote-tracking branch 'upstream/master' into master-tmdb-overlay
    • 86de0ab5 - Merge remote-tracking branch 'upstream/master' into master-tmdb-overlay
    • 016a12a9 - Merge remote-tracking branch 'upstream/master' into master-tmdb-overlay
    • 25b29b02 - MC Overlay implemented for the TMDB for Run 3 simulation of the L1 muon trigger

    Compare with previous version

  • This merge request affects 1 package:

    • TileCalorimeter/TileSimAlgs

    This merge request affects 2 files:

    • TileCalorimeter/TileSimAlgs/src/TilePulseForTileMuonReceiver.cxx
    • TileCalorimeter/TileSimAlgs/src/TilePulseForTileMuonReceiver.h

    Adding @pavol ,@solodkov ,@harkusha as watchers

  • :negative_squared_cross_mark: CI Result FAILURE (hash 25b29b02)

    Athena AthSimulation AthGeneration AnalysisBase AthAnalysis
    externals :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    cmake :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    make :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    required tests :o: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:
    optional tests :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark: :white_check_mark:

    Full details available on this CI monitor view
    :white_check_mark: Athena: number of compilation errors 0, warnings 0
    :white_check_mark: AthSimulation: number of compilation errors 0, warnings 0
    :white_check_mark: AthGeneration: number of compilation errors 0, warnings 0
    :white_check_mark: AnalysisBase: number of compilation errors 0, warnings 0
    :white_check_mark: AthAnalysis: number of compilation errors 0, warnings 0
    :pencil: For experts only: Jenkins output [CI-MERGE-REQUEST-CC7 26551]

  • I'm still surprised to see the whole TileDigitsContainer_p3_MuRcvDigitsCnt to contain only 12. Is this expected?

  • DQ errors are related to an MR from yesterday (!39772 (merged)). investigating.

    Overlay errors look like a problem with this MR, moving back to user to investigate.

    -Mike (L1)

  • The digits are rounded and I confirm that the values I see are also close to each other of 12 and most of the time (not always) equal to 11.73. Tile_Pedestal and Tile_Noise are set to false so a fixed value is used from TileInfo.

    For the previous version I was not collecting correctly the digits for the different channels correctly and in fact, I was always setting a single set of digits for the different channels. There was in fact an error.

    For the current version, this was corrected.

    The test I did to avoid confusion with the very close (equal) values that when rounded would get the same value I used the (channel number + 1) to scale the value of the digit.

    From the test I saw that the old version would have e.g. 6digit for all channels while the new version would have 1digit, 2*digit, etc... I will attach some output from my side in a later post.

  • Not sure how usefull it is. Here is the snip for one event using the old (WRONG) snip_1evt_OldVersion

    and the new (CORRECT) snip_1evt_NewVersion

  • Hi @jmendes, if you are confident that your changes are correct, then the reference files will have to be updated. As there's another MR pending that also updates the references, we'll have to wait for that one to go in. I'll ping you then with the instructions on how to update them.

    In the meantime I'll also have another look at the changes.

    FYI @mhance, MRs should NOT be approved if the CI is failing.

  • Sorry, I meant to mark this as needing user attention, not sure how I marked as approved. Thanks for fixing it!

  • Hi @tadej, Just to know if it is already possible to close this issue? Thank you. Joao Gentil.

  • Yes, you can run RunTier0Tests.py -o locally and copy the outputs somewhere accessible.

  • I collected all the output in a folder at my cernbox (https://cernbox.cern.ch/index.php/s/I6ctBgEV45NWixo). There is an ERROR appearing?! This is expected ... or is there something that is wrong? And that I can do something about.


    d1592.log:Overlay 12:09:35 Py:ComponentAccumulator ERROR This ComponentAccumulator was never merged! d1592.log:Overlay 12:09:35 Py:ComponentAccumulator ERROR This CA contains 7 service, 0 conditions algorithms, 0 event algorithms and 0 public tools d1592.log:Overlay 12:09:35 Py:ComponentAccumulator ERROR This ComponentAccumulator was never merged! d1592.log:Overlay 12:09:35 Py:ComponentAccumulator ERROR This CA contains 29 service, 49 conditions algorithms, 30 event algorithms and 1 public tools d1592.log:PyJobTransforms.trfExe.validate 2021-02-01 12:09:37,036 ERROR Validation of return code failed: Non-zero return code from Overlay (1) (Error code 65)

  • No, something is wrong with your configuration. The log should tell you what if you go a bit up.

  • Ok.. I found this 12:09:35 RuntimeError: No such flag: Digitization.Pileup The name is likely incomplete.

  • You might have a mismatch between the nightly and the code you are using. This flag did get renamed recently.

  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Loading
  • Please register or sign in to reply
    Loading