Unpacked data storage
Summary
Currently unpacker just creates a pandas.DataFrame.
This data has to be compressed and stored. Possible options are:
- root with lz compression
- HDF5
parquet- other...
Although initially we were considering to store the events in ROOT format,
I don't think it makes much sense as the data will have to be converted back to pandas.DataFrame for subsequent analysis.
An interesting overview together with the performance tests can be found here
Please provide your opinion and/or present other options.