Add simple CI that runs the complete analysis after each commit.
Generalizing Analysis Scritps
The file_lister.sh
script now takes the path to a BETSEE workspace as an optional argument. This is useful when running on computer that do no have access to the LBL shared network drive. For example, the CI uses input from EOS.
Both file_lister.sh
and run_analysis.sh
now create any directories assumed for the output.
Both scripts are now executable with a /bin/bash
shebang.
Continuous Integration
The CI runs the full analysis broken up into the following stages:
build
analyze
The defined jobs are:
-
build_env
: Prepare a Python virtual environment with all required (requirements.txt
) packages. The environment is created under.venv
and passed to subsequent jobs as an artifact. -
build_filelists
: Prepare the filelists corresponding to the March 2022 UCL data. They are passed to subsequent jobs as an artifact.
Edited by Karol Krizka