Skip to content

WIP: Transform Helper Bash Scripts into Configurable Python Scripts and Use Ganga

Anthony Correia requested to merge use_ganga into master

Transform helper bash scripts into configurable python scripts

  • Implement YAML configuration files config_default.yaml and config.yml in setup/ directory
  • Convert shell script Moore/run.sh into a python script
  • Convert shell script Allen/run.sh into a python script
  • Convert shell script Allen/to_mdf.sh into a python script
  • Implement ability to provide Logical File Names (LFNs) and bookkeeping paths, eliminating the need for XML catalog
  • Implement ability to use Ganga
  • Implement ability to submit jobs to condor
  • Implement ability to compress output CSV files

New inputs

  • In jobs/, define configuration files for sim10aU1, Sim10b and SMOG2 samples
  • In data/, add local test samples

Documentation updating

  • Document YAML configuration files
  • Detail execution of the new scripts
  • Detail how to setup a valid grid proxy locally
  • Correct documentation to include ganga
  • Add CHANGELOG

Bug fixing

  • Resolve Allen algorithm bug: do not erase the CSV files every time the algorithm is executed
Edited by Anthony Correia

Merge request reports