razumov created page: CTests authored by Ivan Razumov's avatar Ivan Razumov
Tools available for the histograms comparison:
1. `${CMAKE_SOURCE_DIR}/cmake/scripts/yoda2root.cmake -DAIDA2ROOT=${AIDA2ROOT}`, example is
${CMAKE_SOURCE_DIR}/generators/reference/aida2root.py
-DPython_cmd=${Python_cmd}
-Dyoda_home=${yoda_home}
-DINPUT=filepath/filename.yoda
creates filename.root at filepath. In addition creates filename.aida
2. `${CMAKE_SOURCE_DIR}/generators/reference/reference.py`. The main mode of work:
reference.py file1.root file2.root "Path=name1" limit=0.05
or
reference.py file1.root file2.root "Path=name1,name2" "limit=0.05,0.05"
Compare histogram name1 in the two root files, Kolmogorov test, conf. limit 5%
If the path is "XS", the script will calculate chi2 and use `Tmath::Prob` to calculate probability.
Initially there was another mode of work:
reference.py file1.yoda file2.yoda "Path=XS" limit=0.05
But it is disabled now (will give an error). To use it, the code is to be further developed, adding extraction of scatter plot errors from yoda.
### How to make validation analyses and publish results
# Use -DVALIDATION=ON in CMake command (and not use LCG_IGNORE)
cmake -DVALIDATION=ON ...
# build 'validation' target. All required packages and tests will be built automatically
make validation # build validation tests for all avaiable packages
make validation.<package> # -//- for all versions of package
make validation.<package>-<version> # -//- for selected version of package
# publish results
make validation.publish # publish results to genser.cern.ch web interface. This step requires sftnight AFS token (will be asked if it isn't present)