retried builds cause the same tests to be run multiple times
When a build is retried after an infrastructure failure, the "ready-builds" special entry in CouchDB (https://lhcb-couchdb.cern.ch/nightlies-nightly/ready-builds) contains multiple entries for the same test job (once per build).
I mitigated the problem with 226774b9, bf474a24 (and the fix 119f64e0), but we should:
-
clean the list of tests that are made obsolete by a restarted build (similar to what we do for the build logs) -
before running the test make sure it still make sense (test trigger time compatible with build completion time) -
before publishing the test results make sure they are not made obsolete by a retry (again. checking test and build times)