statistics.py doesn't count errors properly
When trying to run a fit with SFramework (see attached log.statistics), I noticed that the error count at the end is smaller than the number of errors thrown:
% ag ERROR log.statistics
12:SFramework/TSStatisticsManager: ERROR: workspace 'HeavyN_mN500GeV' already includes dataset named 'asimovData'
13:ERROR in TSStatisticsManager::perform(...) : unable to perform action 'MakeAsimovDataset'
53:SFramework/TSSignificanceCalculator: ERROR: fit error: Nll minimum for constrained fit better than for unconstrained: 90.022 < 90.023
95:SFramework/TSLimitCalculator: ERROR: unable to obtain dataset 'asimovData_1'!
96:SFramework/TSStatisticsManager: ERROR: HeavyN_mN500GeV: Limit calculation failed
104: ERROR: 1
For warnings, the number is correct:
% ag WARNING log.statistics
6:WARNING in TQFolder::importFromTextPrivate(...) : replacement ' bsm_model_name="$(~bsm_model_name)", parameters="$(~parameters)"' in '/.' contains unresolved variables, please double-check!
103: WARNING: 1
Edited by Jonas Neundorf