Test Should Fail when Encountering WARNING, ERROR or FATAL
This MR automatically adds FAIL_REGULAR_EXPRESSIONS
to all tests which check for the occurrence of any WARNING
, ERROR
, or FATAL
log messages - none of them should appear in the log output unless they are part of the PASS_REGULAR_EXPRESSION
of the test. This MR contains:
- Automatically add FAIL_EXPRESSION unless defined explictly by the test already
- Automatically add all of
WARNING
,ERROR
andFATAL
as fail expression unless they appear in thePASS_REGULAR_EXPRESSION
- New possibility to match across multiple lines by adding a
\n
tag to the expression - The user manual described the above functionality in detail
- Many tests have been fixed because they actually contained odd/wrong settings. Especially relevant for the examples.
This is a follow-up MR to !488 (merged) and should only be reviewed and merged once that is in.