Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • Moore Moore
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 216
    • Issues 216
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
    • Requirements
  • Jira
    • Jira
  • Merge requests 93
    • Merge requests 93
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
    • Test Cases
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Insights
    • Issue
    • Repository
  • Snippets
    • Snippets
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • LHCbLHCb
  • MooreMoore
  • Merge requests
  • !998

Spruce reports and streaming

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Nicole Skidmore requested to merge sprucereports into master Sep 15, 2021
  • Overview 51
  • Commits 18
  • Pipelines 20
  • Changes 23

Sprucing reports to rawbank

The Sprucing will output a ROOT file with rawbanks in. The sprucing reports must therefore be saved as a rawbank. This MR along with LHCb!3260 (merged) writes a HltDecReport for the sprucing using the sourceID "Spruce".

Unit test

This is tested in Hlt/Hlt2Conf/tests/qmtest/test_spruce_check.qmt

Streaming for Sprucing

The Sprucing will stream to different output files both in selection and passthrough mode. This is configured exactly the same as for Hlt2 as seen in Hlt/Hlt2Conf/options/Sprucing/spruce_test_streaming.py

Introduced Moore.streams_hlt2 and Moore.streams_spruce for stream definitions of both. This should move to another datapackage in the future.

Custom detector rawbanks for sprucing streams not implemented yet!

Unit test

This is tested in Hlt/Hlt2Conf/tests/qmtest/test_sprucing_streaming_check_{A,B}.qmt

Consolidation of options files to test streaming

Now only have stream_check.py which can be driven to check stream A/B on Hlt2/Sprucing

Unit tests

Hlt/Hlt2Conf/tests/qmtest/test_hlt2_streaming_check_{A,B}.qmt

Hlt/Hlt2Conf/tests/qmtest/test_sprucing_streaming_check_{A,B}.qmt

Other changes

In config.py _build_decision_ids now takes an offset so that there are no identical ints in the int->str relations of HltRawBankDecoderBase. Tested in Hlt/Hlt2Conf/tests/qmtest/test_spruce_check.qmt

Sprucing jobs now output a ROOT file with rawbanks. Tested in Hlt/Hlt2Conf/tests/qmtest/test_spruce_check.qmt

Tcks for sprucing are now handled better - one does not need the Hlt2 JSON file as well as the Sprucing JSON to read Sprucing output. Tested in Hlt/Hlt2Conf/tests/qmtest/test_spruce_check.qmt

tcks.py has a dump_passthrough_configuration method for passthrough Sprucing lines that persist the required PackedObjectLocations and Hlt2SelectionID from the Hlt2 job. Tested in Hlt2Conf.test_spruce_passthrough_check.qmt

See

  • https://gitlab.cern.ch/lhcb-dpa/project/-/issues/153
  • https://gitlab.cern.ch/lhcb-dpa/project/-/issues/125
Edited Sep 27, 2021 by Nicole Skidmore
Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: sprucereports