[RTADPA BW Tests] Take account of compression changes at Hlt2/Sprucing
We use os.stat(fpath).st_size
to extract the size of the streams in Bytes. (For Hlt2 we also run zstd -5 {fpath}
to compress the Hlt2 output and extract that filesize too).
Then in line-and-stream-rates
we calculate the compression factor and use this when calculating the avg evt size / dstdata size per line and per stream.
- Hlt2: zstd compressed fsize / default fsize
- Spruce: default fsize / sum(size(rawbanks)) for file.
Locally evaluated changes
Evaluated ['these changes', 'these changes + forcing compression_factor=1'] with a reduced set of Hlt2 lines (to reduce load on local testing).
Can see:
ToDo:
-
Minimal changes to account for Hlt2 compression changes -
How do we want to handle Spruce compression changes? -
Discuss how best to report this on the pages.
Edited by Luke Grazette