Skip to content

Add split local readout files

Laurent Petre requested to merge feature/split-local-readout-files into main

Description

As the title says, this MR introduces split local readout files, mainly for QC8 and QC8 DQM purposes. The feature is disabled by default and can be enabled via the new --max-events-per-file option. Additionally, it is now possible to write RAW output files not compressed with ZSTD via the --enable-compression false flag.

Related Issue

How Has This Been Tested?

Tested spying a Global run on the P5 system. All output files look nominal - using gem-raw-to-text and xxd -, without a missing event between files:

  • Unique file with ZSTD compression
  • Unique file without ZSTD compression
  • Split files with ZSTD compression (400 events per file)
  • Split files without ZSTD compression (400 events per file)

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)

Checklist:

  • My code follows the code style of this project.
  • My change requires a change to the documentation.
  • I have updated the documentation accordingly.
  • I have read the CONTRIBUTING document.
  • I have added tests to cover my changes.
  • All new and existing tests passed.
Edited by Laurent Petre

Merge request reports