Draft: CITest: add test for WorkDir configuration
Add a minimal CI test to each project to make sure the WorkDir
package can be configured against the built release. This test only works when run within the CI and for MRs that affect the Build domain. Otherwise it will be marked as "Skipped" in the ctest
result.
This may help in discovering problems as seen with ATLINFR-5571 earlier.
Merge request reports
Activity
@akraszna, this is a bit experimental. There may be better ways of achieving the same. But let's see...
Yeah... We neither install the build, nor do we set up the environment with that installation in it.
If we wanted to do this, we'd need to dedicate some measurable additional resources to it in the CI. (I.e. the CI would have to become slower.) I agree that testing this would be great. But it might be just a little too difficult to do correctly.
You know what...? There might be a way of hitting two birds with one stone here.
🤔 It could be possible to make the CI install a project before building it. Since as long as all our infrastructure works correctly, installation even without any binary files (or outdated ones), should work.But that's not great either. On the second run there would already be binaries from the first run. So the installation would be just as slow as "in a normal setup" anyway.
🤔 So I don't think I have a good proposal for this after all.😦 Is installing really that slow? I remember it taking maybe a few minutes. If we would execute the
install
as part of the test itself, and only run the test if changes toProjects/
were made, it may not be that bad. What do you think?Edited by Frank Winklmeier
This merge request affects 1 package:
- AtlasTest/CITest
This merge request affects 6 files:
- AtlasTest/CITest/AnalysisBase.cmake
- AtlasTest/CITest/AthAnalysis.cmake
- AtlasTest/CITest/AthGeneration.cmake
- AtlasTest/CITest/AthSimulation.cmake
- AtlasTest/CITest/Athena.cmake
- AtlasTest/CITest/test/WorkDirConfig.sh
added Simulation Test analysis-review-required main labels
❌ CI Result FAILURE (hash 200c51c2)Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon externals ✅ ✅ ✅ ✅ ✅ ✅ cmake ✅ ✅ ✅ ✅ ✅ ✅ make ✅ ✅ ✅ ✅ ✅ ✅ tests ⭕ ⭕ ⭕ ⭕ ✅ ✅ Full details available on this CI monitor view. Check the JIRA CI status board for known problems
✅ Athena: number of compilation errors 0, warnings 0
✅ AthSimulation: number of compilation errors 0, warnings 0
✅ AthGeneration: number of compilation errors 0, warnings 0
✅ AnalysisBase: number of compilation errors 0, warnings 0
✅ AthAnalysis: number of compilation errors 0, warnings 0
✅ DetCommon: number of compilation errors 0, warnings 0
📝 For experts only: Jenkins output (remote access info)removed analysis-review-required label
added 244 commits
-
200c51c2...440bd0bc - 243 commits from branch
atlas:main
- 2d43edf8 - CITest: add CI test for WorkDir configuration
-
200c51c2...440bd0bc - 243 commits from branch
This merge request affects 1 package:
- AtlasTest/CITest
This merge request affects 6 files:
- AtlasTest/CITest/AnalysisBase.cmake
- AtlasTest/CITest/AthAnalysis.cmake
- AtlasTest/CITest/AthGeneration.cmake
- AtlasTest/CITest/AthSimulation.cmake
- AtlasTest/CITest/Athena.cmake
- AtlasTest/CITest/test/WorkDirConfig.sh
added analysis-review-required label
This merge request affects 1 package:
- AtlasTest/CITest
This merge request affects 6 files:
- AtlasTest/CITest/AnalysisBase.cmake
- AtlasTest/CITest/AthAnalysis.cmake
- AtlasTest/CITest/AthGeneration.cmake
- AtlasTest/CITest/AthSimulation.cmake
- AtlasTest/CITest/Athena.cmake
- AtlasTest/CITest/test/WorkDirConfig.sh
❌ CI Result FAILURE (hash 2d43edf8)Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon externals ✅ ✅ ✅ ✅ ✅ ✅ cmake ✅ ✅ ✅ ✅ ✅ ✅ make ✅ ✅ ✅ ✅ ✅ ✅ tests ⭕ ⭕ ⭕ ⭕ ✅ ✅ Full details available on this CI monitor view. Check the JIRA CI status board for known problems
✅ Athena: number of compilation errors 0, warnings 0
✅ AthSimulation: number of compilation errors 0, warnings 0
✅ AthGeneration: number of compilation errors 0, warnings 0
✅ AnalysisBase: number of compilation errors 0, warnings 0
✅ AthAnalysis: number of compilation errors 0, warnings 0
✅ DetCommon: number of compilation errors 0, warnings 0
📝 For experts only: Jenkins output (remote access info)❌ CI Result FAILURE (hash 324b6e13)Athena AthSimulation AthGeneration AnalysisBase AthAnalysis DetCommon externals ✅ ✅ ✅ ✅ ✅ ✅ cmake ✅ ✅ ✅ ✅ ✅ ✅ make ✅ ✅ ✅ ✅ ✅ ✅ tests ⭕ ⭕ ⭕ ⭕ ✅ ✅ Full details available on this CI monitor view. Check the JIRA CI status board for known problems
✅ Athena: number of compilation errors 0, warnings 0
✅ AthSimulation: number of compilation errors 0, warnings 0
✅ AthGeneration: number of compilation errors 0, warnings 0
✅ AnalysisBase: number of compilation errors 0, warnings 0
✅ AthAnalysis: number of compilation errors 0, warnings 0
✅ DetCommon: number of compilation errors 0, warnings 0
📝 For experts only: Jenkins output (remote access info)This merge request affects 1 package:
- AtlasTest/CITest
This merge request affects 6 files:
- AtlasTest/CITest/AnalysisBase.cmake
- AtlasTest/CITest/AthAnalysis.cmake
- AtlasTest/CITest/AthGeneration.cmake
- AtlasTest/CITest/AthSimulation.cmake
- AtlasTest/CITest/Athena.cmake
- AtlasTest/CITest/test/WorkDirConfig.sh