Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • athena athena
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Jira
    • Jira
  • Merge requests 147
    • Merge requests 147
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Repository
  • Activity
  • Graph
  • Jobs
  • Commits
Collapse sidebar
  • atlasatlas
  • athenaathena
  • Merge requests
  • !46579

improve LHE event counting

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Jan Kretzschmar requested to merge jkretz/athena:jk_check_gentf_mem into 21.6 Sep 17, 2021
  • Overview 3
  • Commits 1
  • Pipelines 0
  • Changes 2

Current way of Gen_tf to count events in LHE files pulls the full files into memory at once, which may bring jobs close to boundaries imposed by e.g. the grid if files are large.

Previously, @zmarshal had fixed the issue e5081205

However, when fixing an unrelated issue, @cgutscho brought back the old behaviour aa3aceb0

This patch effectively restores Zach's patch, while also working on LHE files that have extra bits after "<event" tags

Net effect is about 1GB less memory used in a job that showers MG FxFx Vjets files in Pythia8.

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: jk_check_gentf_mem