Skip to content
Snippets Groups Projects
Forked from faser / calypso
Source project has a limited visibility.

PowerTools Analysis Scripts

A series of Python scripts to help analyzing data from Powerboard test results. Consists of the following components:

  • pbv3 module to parse, calibrate and convert the test results
  • tools collection of helpful tools to manipulate and visualize test results
  • webreport generation of a web reporting using results from the ITk production database
  • studies a series of local dedicated studies

Dependecies

The code is based around Python 3. The following modules are used for different parts

  • pandas
  • numpy
  • matplotlib
  • jinja2 (web reporting)
  • dash
  • itkdb

Installation

The recommended method for using the reporting package is through a virtual Python environment. The following instructions target CentOS 7.

# Create and enter virtual environment at ~/venv/pwb (or other path of your choosing)
sudo yum install python36-virtualenv
python3.6 -m venv ~/venv/pwb
source ~/venv/pwb/bin/activate

# Install PB reporting package
git clone https://gitlab.cern.ch/berkeleylab/pbv3_test_adapter/reporting.git
pushd reporting
pip install -e .
popd

Don't forget to restory your virtual environment in new terminals before using the PB reporting package.

source ~/venv/pwb/bin/activate

Tools

pbv3_plot_monitor.py

Creates timeseries plots of all quantities monitored with the pbv3_monitor powertools program.

pbv3_convert.py

Converts test results from JSON files into a tabular CSV file. This is useful for large datasets, as loading the test results can take a long time. The resulting CSV file can be directly loaded with the main pbv3.tests.load_testresults function.