Skip to content
GitLab
Projects Groups Snippets
  • /
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • athena athena
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Jira
    • Jira
  • Merge requests 180
    • Merge requests 180
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Releases
  • Packages and registries
    • Packages and registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Repository
  • Activity
  • Graph
  • Jobs
  • Commits
Collapse sidebar
  • atlasatlas
  • athenaathena
  • Merge requests
  • !58393

AthenaPoolCnvSvc+OutputStreamAthenaPool: Update default AutoFlush settings for residual derived data formats

  • Review changes

  • Download
  • Email patches
  • Plain diff
Merged Alaettin Serhan Mete requested to merge amete/athena:master-update-autoflush into master Nov 14, 2022
  • Overview 12
  • Commits 1
  • Pipelines 2
  • Changes 2

Currently, when using SharedWriter w/ parallel compression, we default to using an event based AutoFlush setting of 500 (except for PHYS, PHYSLITE, and PHYSVAL, all of which have their own values). Especially for CP samples, this can be too generous. Therefore, tighten these for the time being to 100 events for any DAOD product other than those that are explicitly mentioned above, and go as low as 10 events to catch anything else (there ideally shouldn't be any but just in case). This should help reduce the memory usage of DAOD production jobs for the CP samples.

cc: @gemmeren @jcatmore @calpigia

Assignee
Assign to
Reviewers
Request review from
Time tracking
Source branch: master-update-autoflush