Avoid using configured compression setting for scaling
The scaling step currently writes out PFlow-hybrid-resampled_scaled.h5
using the compression setting specified in the preprocessing config. This setting was intended to be used only for the final output file. Since the scaling is also not the precision flag, we get a PFlow-hybrid-resampled_scaled.h5
which is more than twice as large as either PFlow-hybrid-resampled.h5
or PFlow-hybrid-resampled_scaled_shuffled.h5
.
We just need to use compression="gzip"
in the scaling class to avoid this. Unless there was some reason why this was done? @mguth @alfroch