Add InfluxDB client dependency

See merge request !44

Update the VFAT DB query to support the Phase-II schema

See merge request !43

In order to include the new Phase-II VFAT3 plugin cards in the CMS DB a
new schema has been implemented in the CMS_GEM_MUON_VIEW.GEM_VFAT3_PROD_SUMMARY_V_RH
view. While it has the advantage of not modifying existing GE1/1 VFAT3
hybrids data, this change  creates additional complications in an
already messy database view.

This commit overhauls the VFAT DB query and sanitation function in order
to deal with the added complexity in the application logic code rather
than in the Oracle SQL query.

The GE1/1 entries are identical before and after this commit, modulo the
additional columns. The Phase-II entries match the expectations, based
on raw QC results files.

Cleanup of the legacy tools

See merge request !42

Only the file description/documentation is supposed to remain in the
Python file header. The file name is... the file name; the authors and
maintainers are listed in the CONTRIBUTORS file; and the date can be
retrieved from the Git commits. Adding such metadata in each file is
added maintenance burden.

The GEM Data Handler (GDH) features are now part of the C++ API in
cmsgemos (see cmsgemos!261). As such, remove the duplication in Python
from cmsgemos-analysis.

Note that this code should remain a reference of design, quality, and
good practices.

Speed-up plotting routines

Closes #37

See merge request !40

Daniel Estrada authored Dec 06, 2022 and Laurent Petre committed Dec 08, 2022

In addition to the parallelization of the plotting via the
multiprocessing module, the analysis routine itself has been optimized.
Indeed, it was possible to rewrite the analyze_scan function as an
helper function, avoiding the if-else statements.

Threshold scan analysis

Closes #42

See merge request !35

Fix crash while generating front-end configuation files

See merge request !39

The front-end configuration file generation routines were modifying
in-place its input DataFrame, created by GroupBy.apply(). This is
recommended against, and, in practice, caused crashes.

More specifically, some mismatches between the apparent DataFrame size
and the actual DataFrame size were noticed when the number of element
between a group/component and the next one was changing.

Copy the DataFrame for each group/component to avoid the issue.

Add a feature to produce OptoHybrid configurations with S-bit delays

See merge request !38

Make a routine to analyze the cluster mask rate scan

See merge request !37

Before this commit, if the input and output directories were different,
only the updated configuration files were present in the output. Ensure
that all input configuration files are first copied to the output path.

The mp.Pool methods send tasks to the workers by pickling them. Only
top-level defined functions are pickable.

Implement the following changes:

* Move analyze_scan.plot_scan_oh() to _plot_scan_oh()
* Print out the error messages, if any. Any exception thrown in a worker
  thread was previously discarded
* Close the PyPlot figure and trigger the Python garbage collector. This
  aims at minimizig the plotting memory usage

Set range in S-bit rate scan plot

See merge request !36

Return analysis output file names

See merge request !34

- For the analysis functions and the dump_database function, the return variable is the path of the analyzed scan file
- For the create-config functions, the return variable is a pandas Series with the fed, slot, oh keys and the output filenames as values

Add sanity check on VFAT config DB dump

Closes #41

See merge request !33

Update getting started information in README.md

See merge request !31

Daniel Estrada authored Mar 29, 2022 and Laurent Petre committed Apr 04, 2022

Update getting started information in README.md

Fix typo of getting started instructions in README.md

Apply 1 suggestion(s) to 1 file(s)

Fix the DAC scan warning plotting option

Closes #44

See merge request !30

Fix typo in vfat config latency

See merge request !29