Skip to content

Test Should Fail when Encountering WARNING, ERROR or FATAL

Simon Spannagel requested to merge fail_on_errors into master

This MR automatically adds FAIL_REGULAR_EXPRESSIONS to all tests which check for the occurrence of any WARNING, ERROR, or FATAL log messages - none of them should appear in the log output unless they are part of the PASS_REGULAR_EXPRESSION of the test. This MR contains:

  • Automatically add FAIL_EXPRESSION unless defined explictly by the test already
  • Automatically add all of WARNING, ERROR and FATAL as fail expression unless they appear in the PASS_REGULAR_EXPRESSION
  • New possibility to match across multiple lines by adding a \n tag to the expression
  • The user manual described the above functionality in detail
  • Many tests have been fixed because they actually contained odd/wrong settings. Especially relevant for the examples.

This is a follow-up MR to !488 (merged) and should only be reviewed and merged once that is in.

Merge request reports