Public binary rpm distribution.
We should produce a binary rpm distribution of CTA installable solely using public repositories. Building and testing this should be automated in the CI.
More will come later as we will need to refine how we enforce/relax specific libraries versions needed for CTA.
Initial work be done in CTA CI and refined along the go in parallel to the standard internal CI workflow.
Designs
Relates to
- #104CI update push
Activity
assigned to @jleduc
ctadevviktor is available for @agounon as a CI dev environment.
added workflowIn Progress in CTA-old label
First build of cta-release package available, source is in CTA-ops repo:
https://gitlab.cern.ch/cta/operations/-/tree/master/cta-releaseThe issue with ceph mentioned this morning was linked to yum repo protection, I added a workaround.
All cta-* packages are installed properly with public repos (exept cta-migration-tool due to cx_Oracle issue).Dependencies Resolved ============================================================================================================================================================================================================================================== Package Arch Version Repository Size ============================================================================================================================================================================================================================================== Installing: cta-catalogueutils x86_64 0-2650565gitfc3e2601.el7.cern /cta-catalogueutils-0-2650565gitfc3e2601.el7.cern.x86_64 1.0 M cta-cli x86_64 0-2650565gitfc3e2601.el7.cern /cta-cli-0-2650565gitfc3e2601.el7.cern.x86_64 4.2 M cta-common x86_64 0-2650565gitfc3e2601.el7.cern /cta-common-0-2650565gitfc3e2601.el7.cern.x86_64 0.0 cta-debuginfo x86_64 0-2650565gitfc3e2601.el7.cern /cta-debuginfo-0-2650565gitfc3e2601.el7.cern.x86_64 169 M cta-frontend x86_64 0-2650565gitfc3e2601.el7.cern /cta-frontend-0-2650565gitfc3e2601.el7.cern.x86_64 5.5 M cta-fst-gcd x86_64 0-2650565gitfc3e2601.el7.cern /cta-fst-gcd-0-2650565gitfc3e2601.el7.cern.x86_64 23 k cta-immutable-file-test x86_64 0-2650565gitfc3e2601.el7.cern /cta-immutable-file-test-0-2650565gitfc3e2601.el7.cern.x86_64 84 k cta-lib x86_64 0-2650565gitfc3e2601.el7.cern /cta-lib-0-2650565gitfc3e2601.el7.cern.x86_64 15 M cta-lib-catalogue x86_64 0-2650565gitfc3e2601.el7.cern /cta-lib-catalogue-0-2650565gitfc3e2601.el7.cern.x86_64 5.7 M cta-lib-common x86_64 0-2650565gitfc3e2601.el7.cern /cta-lib-common-0-2650565gitfc3e2601.el7.cern.x86_64 1.4 M cta-objectstore-tools x86_64 0-2650565gitfc3e2601.el7.cern /cta-objectstore-tools-0-2650565gitfc3e2601.el7.cern.x86_64 998 k cta-rmcd x86_64 0-2650565gitfc3e2601.el7.cern /cta-rmcd-0-2650565gitfc3e2601.el7.cern.x86_64 79 k cta-smc x86_64 0-2650565gitfc3e2601.el7.cern /cta-smc-0-2650565gitfc3e2601.el7.cern.x86_64 54 k cta-systemtest-helpers x86_64 0-2650565gitfc3e2601.el7.cern /cta-systemtest-helpers-0-2650565gitfc3e2601.el7.cern.x86_64 56 k cta-systemtests x86_64 0-2650565gitfc3e2601.el7.cern /cta-systemtests-0-2650565gitfc3e2601.el7.cern.x86_64 33 M cta-tape-label x86_64 0-2650565gitfc3e2601.el7.cern /cta-tape-label-0-2650565gitfc3e2601.el7.cern.x86_64 819 k cta-taped x86_64 0-2650565gitfc3e2601.el7.cern /cta-taped-0-2650565gitfc3e2601.el7.cern.x86_64 2.8 M Installing for dependencies: cryptopp x86_64 5.6.2-10.el7 epel 1.0 M eos-client x86_64 4.8.45-1.el7.cern eos-citrine 23 M eos-folly x86_64 2019.11.11.00-1.el7.cern eos-citrine-depend 29 M eos-folly-deps x86_64 2019.11.11.00-1.el7.cern eos-citrine-depend 13 M eos-protobuf3 x86_64 3.5.1-5.el7.cern.eos eos-citrine-depend 753 k eos-xrootd x86_64 4.12.8-1.el7.cern eos-citrine-depend 2.7 M fuse-libs x86_64 2.9.2-11.el7 base 93 k grpc x86_64 1.19.0-1.el7 eos-citrine-depend 3.0 M gtest x86_64 1.6.0-2.el7 epel 108 k jsoncpp x86_64 0.10.5-2.el7 epel 82 k libaio x86_64 0.3.109-13.el7 base 24 k libibverbs x86_64 22.4-6.el7_9 updates 269 k libisa-l x86_64 2.26.0-2.el7.cern eos-citrine-depend 84 k libisa-l_crypto x86_64 2.21.0-3.el7.cern eos-citrine-depend 170 k libmacaroons x86_64 0.3.0-2.el7 epel 28 k librados2 x86_64 2:14.2.8-0.el7 Ceph 3.4 M libradosstriper1 x86_64 2:14.2.8-0.el7 Ceph 362 k librdmacm x86_64 22.4-6.el7_9 updates 64 k libsodium x86_64 1.0.18-1.el7 epel 147 k lttng-ust x86_64 2.4.1-4.el7 epel 176 k moreutils x86_64 0.49-2.el7 epel 76 k openpgm x86_64 5.2.122-2.el7 epel 171 k oracle-instantclient19.3-basic x86_64 19.3.0.0.0-1 oracle-instant-client 51 M pciutils x86_64 3.5.1-3.el7 base 93 k perl-IO-Tty x86_64 1.10-11.el7 base 42 k perl-IPC-Run noarch 0.92-2.el7 base 122 k perl-Time-Duration noarch 1.06-17.el7 epel 17 k postgresql-libs x86_64 9.2.24-6.el7_9 updates 235 k protobuf3 x86_64 3.3.1-1.el7.cern eos-citrine-depend 697 k rdma-core x86_64 22.4-6.el7_9 updates 51 k squashfs-tools x86_64 4.3-0.21.gitaae0aff4.el7 base 101 k userspace-rcu x86_64 0.7.16-1.el7 epel 73 k valgrind x86_64 1:3.15.0-11.el7 base 12 M voms x86_64 2.0.16-1.el7 epel 161 k xrootd-client-libs x86_64 1:4.12.6-1.el7 eos-citrine-depend 735 k xrootd-libs x86_64 1:4.12.6-1.el7 eos-citrine-depend 548 k xrootd-server x86_64 1:4.12.6-1.el7 eos-citrine-depend 327 k xrootd-server-libs x86_64 1:4.12.6-1.el7 eos-citrine-depend 614 k xxhash-libs x86_64 0.8.0-1.el7 epel 26 k zeromq x86_64 4.1.4-6.el7 epel 556 k Transaction Summary ============================================================================================================================================================================================================================================== Install 17 Packages (+40 Dependent packages)Edited by Aurelien Gounon-
Installing the cta-release package provides all the needed configuration to install cta-* packages, there is nothing else to do.
For now I didn't include any source for the cta packages but I'm not sure there is a "public" repo yet?
There is one thing to be aware of: installing the cta-release package erases the previous versionlock.list, but I don't think there is any alternative as we don't want to take the reisk to have different versions of a package mentioned there.I'm attaching the package I built here for reference. cta-release-0.1-0.el7.noarch.rpm
added workflowDone in CTA-old label and removed workflowIn Progress in CTA-old label
-
- Package cta-release is now included in CTA code tree and built by CI workflow.
- This package provides all the necessary configuration for CTA packages: repo files and keys (including for dependencies), versionlock requirements and versionlock tool to manage them.
- The versionlock tool is called at install/uninstall times (post% and preun%) and updates the versionlock.list file automatically.
- The CI workflow now includes a manual step called release_rpm (only available for tagged commits). This job copies tagged packages to the cta public repo.
- This new "cta-public-repo" is a webeos website owned by ctareg, and publishing the content under the folder "/eos/user/c/ctareg/www/public/cta-public-repo".
cta-public.repo
Edited by Aurelien Gounon unassigned @agounon
added Building and Packaging workflowDone labels
assigned to @afonso
The binary RPMs should be stored in a path that clearly defines the CTA major version (CTA versions v5.Y.Z use XRootD 5):
-
https://cta-public-repo.web.cern.ch/cta-4/el-$releasever/cta/$basearch/(not needed unless we want to publish CTA with XrootD 4 as well) https://cta-public-repo.web.cern.ch/cta-5/el-$releasever/cta/$basearch/
Edited by Julien Leduc-
-
RPMs for internal production use will all (xrootd4 and xrootd5) be published in the same repo, for now, as discussed with @jleduc .
https://cta-repo.web.cern.ch/cta-repo/RPMS/$basearch/
Edited by Joao Afonso
created branch
15-public-binary-rpm-distributionto address this issuementioned in merge request !59 (merged)
-
A CI test release has been completed and the RPMs can be found here: https://cta-public-repo.web.cern.ch/cta-5/el-7/cta/x86_64/
The merge request can be found here: !59 (merged)
