Add hard limit on test stdout/err size

At the same time as we check for the test timeout we make sure stdout and stderr stay below a reasonable limit (100MB).

I also "fixed" a test that was effectively deactivated with the CMake modernization (!986 (merged)).

Closes #313 (closed)