Changes
Page history
razumov created page: CTests
authored
Sep 14, 2015
by
Ivan Razumov
Show whitespace changes
Inline
Side-by-side
CTests.md
0 → 100644
View page @
0fdfab96
Tools available for the histograms comparison:
1.
`${CMAKE_SOURCE_DIR}/cmake/scripts/yoda2root.cmake -DAIDA2ROOT=${AIDA2ROOT}`
, example is
${CMAKE_SOURCE_DIR}/generators/reference/aida2root.py
-DPython_cmd=${Python_cmd}
-Dyoda_home=${yoda_home}
-DINPUT=filepath/filename.yoda
creates filename.root at filepath. In addition creates filename.aida
2.
`${CMAKE_SOURCE_DIR}/generators/reference/reference.py`
. The main mode of work:
reference.py file1.root file2.root "Path=name1" limit=0.05
or
reference.py file1.root file2.root "Path=name1,name2" "limit=0.05,0.05"
Compare histogram name1 in the two root files, Kolmogorov test, conf. limit 5%
If the path is "XS", the script will calculate chi2 and use `Tmath::Prob` to calculate probability.
Initially there was another mode of work:
reference.py file1.yoda file2.yoda "Path=XS" limit=0.05
But it is disabled now (will give an error). To use it, the code is to be further developed, adding extraction of scatter plot errors from yoda.
### How to make validation analyses and publish results
# Use -DVALIDATION=ON in CMake command (and not use LCG_IGNORE)
cmake -DVALIDATION=ON ...
# build 'validation' target. All required packages and tests will be built automatically
make validation # build validation tests for all avaiable packages
make validation.
<package>
# -//- for all versions of package
make validation.
<package>
-
<version>
# -//- for selected version of package
# publish results
make validation.publish # publish results to genser.cern.ch web interface. This step requires sftnight AFS token (will be asked if it isn't present)