Add DXT Plot Generation
This PR adds plotting scripts for DXT data from the Darshan jobs. CSVs containing log data are not longer generated, instead the Darshan logs are archived directly and are unpacked when plotting. This means that data from previous runs might not be compatible with these changes.
These are the calls necessary to generate the new plots:
python create_sn_dxt.py -w $SPOT_RUN_ARCHIVE/eos_atlaspmb/archive/custom/ -d $days_to_plot -r DAOD_PHYSLITE.pool.root.1 --worker shared_writer --units KB -x write_durations -y write_lengths -c "rntuple,sw" -c "rntuple,pc" -c "ttree,sw" -c "ttree,pc" -o sn_write_durations_vs_lengths
python create_sn_dxt.py -w $SPOT_RUN_ARCHIVE/eos_atlaspmb/archive/custom/ -d $days_to_plot -r AOD.*\.pool\.root.1 --units KB -x read_durations -y read_lengths -c "rntuple,sw" -c "rntuple,pc" -c "ttree,sw" -c "ttree,pc" -o sn_read_durations_vs_lengths --worker worker_0 --worker worker_2 --worker worker_4 --worker worker_6 --worker worker_8 --worker worker_10 --worker worker_12
python create_sn_dxt.py -w $SPOT_RUN_ARCHIVE/eos_atlaspmb/archive/custom/ -d $days_to_plot -r .*DAOD_PHYSLITE\.pool\.root.1 --units KB -x write_lengths -c "rntuple,sw" -c "rntuple,pc" -c "ttree,sw" -c "ttree,pc" --distributions -o write_lengths_distribution_DAOD --worker shared_writer
python create_sn_dxt.py -w $SPOT_RUN_ARCHIVE/eos_atlaspmb/archive/custom/ -d $days_to_plot -r .*AOD.*\.pool\.root.1 --units KB -x read_lengths -c "rntuple,sw" -c "rntuple,pc" -c "ttree,sw" -c "ttree,pc" --distributions -o read_lengths_distribution_AOD --worker worker_0 --worker worker_2 --worker worker_4 --worker worker_6 --worker worker_8 --worker worker_10 --worker worker_12
Edited by Wesley Patrick Kwiecinski