Unpacked data storage
Currently unpacker just creates a
This data has to be compressed and stored. Possible options are:
- root with lz compression
Although initially we were considering to store the events in
I don't think it makes much sense as the data will have to be converted back to
pandas.DataFrame for subsequent analysis.
An interesting overview together with the performance tests can be found here
Please provide your opinion and/or present other options.