CI: Updating collisions express processing test - use 13.6 TeV input + the latest settings

Tadej Novak authored 2 years ago and Atlas Nightlybuild committed 2 years ago

Initial CI artifacts copying prototype

See merge request !55014

(cherry picked from commit dcab599f)

fb775b13 Initial CI artifacts copying prototype

Pierre Antoine Delsart authored 2 years ago and Peter Berta committed 2 years ago

Merge branch 'ufoDeriv22' into 'master'

Support large-R UFO jets in PHYS derivation

See merge request !54413

(cherry picked from commit 6f320c16)

7af3413d Adding UFO jets to derivations
17c6323e Merge branch 'master-UFOs-derivations' of...
db9f5c9c Support large-R UFO jets in PHYS derivation
7759a3dd fix Reco_tf CI tests for UFO jets

Peter Berta authored 2 years ago and Julien Maurer committed 2 years ago

increased number of events to 500 for Run3Data test; removed ignoring muonSegment branches for q445; added express processing test; enabled diff-root compariosn for Run2Data test (currently not working)

CI: Updating Run3 data collisions test to use newer input + enabling diff-root comparison

Tadej Novak authored 2 years ago and Julien Maurer committed 2 years ago

Add Run 3 MC ESD/AOD comparison

Migrated two algorithms: EventInfoWriter and EventInfoReader.
Fixed relevant unit tests

Enable thread-safety checking.

Add the `DEPENDS_SUCCESS` keyword to define test dependencies that
require successful completion of the dependee(s). Change all tests to
use this instead of `DEPENDS` and `REQUIRED_FILES`. The latter was not
reliable as even a failed test can create a (corrupt) AOD file for
example.

Also remove the dedicated parsing of the `DEPENDS` keyword as that is
now supported by `atlas_add_test` itself.

Enable thread-safety checking.

Fix cleanup of test working directory. Move the wildcard outside of the
quoted path name (which may contain spaces).

Fixes ATLINFR-4482.

Change `nopost.sh` to fail if the original reference file is non-empty
but it becomes empty after applying the filtering rules (either default
or user provided patterns). This helps discovering cases where the user
(or changes in `post.sh`) accidentally filter the entire log and
reference file and cause tests to always succeed.

Add `grep_with_context` python function (and unit tests) to new
`logfiles` module. This is a combination of the `grep`, `head` and `tail`
command line utilities. It can e.g. be used to print the head, tail and
fixed number of lines around errors in a log file.

Ensure there is at least some output from unit test to avoid empty
reference file.

Remove dummy unit test. Not clear why this was needed.

Update the README and the text that is displayed at the start of each
CI test.