sync issueshttps://gitlab.cern.ch/unpacked/sync/-/issues2023-07-20T14:20:48+02:00https://gitlab.cern.ch/unpacked/sync/-/issues/12I can't edit the file recype.yaml2023-07-20T14:20:48+02:00Gianfranco VecchioI can't edit the file recype.yamlHi,
when I try to edit the recype.yaml file I get this error:
"Someone edited the file the same time you did. Please check out the file and make sure your changes will not unintentionally remove theirs."
Thank youHi,
when I try to edit the recype.yaml file I get this error:
"Someone edited the file the same time you did. Please check out the file and make sure your changes will not unintentionally remove theirs."
Thank youhttps://gitlab.cern.ch/unpacked/sync/-/issues/11Pull images from private repository with access token2023-05-24T11:12:31+02:00Davide Valsecchidavide.valsecchi@cern.chPull images from private repository with access tokenDear Unpacked maintainers,
Would it be possible to pull images from private repositories with a provided access token / deploy token?
I have just added to the recipe.yaml an image from the cms-analysis/general/ group which needs to r...Dear Unpacked maintainers,
Would it be possible to pull images from private repositories with a provided access token / deploy token?
I have just added to the recipe.yaml an image from the cms-analysis/general/ group which needs to remain private, (`https://gitlab-registry.cern.ch/cms-analysis/general/pocketcoffea:*`), but we would like to publish the images on unpacked.
Let us know what are you thoughts on this.
Thanks in advance,
Davidehttps://gitlab.cern.ch/unpacked/sync/-/issues/10Can't edit the recipe.yaml file2022-11-17T15:54:02+01:00Alessandra FortiCan't edit the recipe.yaml fileIt says
"Someone edited the file the same time you did. Please check out the file and make sure your changes will not unintentionally remove theirs. "
but this has been going on all day and I cannot believe it takes so long to add a l...It says
"Someone edited the file the same time you did. Please check out the file and make sure your changes will not unintentionally remove theirs. "
but this has been going on all day and I cannot believe it takes so long to add a line.
can you help?
thankshttps://gitlab.cern.ch/unpacked/sync/-/issues/9Symbolic links seem to be missing in converted images2022-09-14T11:36:52+02:00Manuel GiffelsSymbolic links seem to be missing in converted imagesDear all,
it seems that symbolic links are missing in the converted images.
For example the latest matterminers/wlcg-wn:latest container does not have it, while it is present in the underlying docker container.
```bash
ls -l /cvmfs...Dear all,
it seems that symbolic links are missing in the converted images.
For example the latest matterminers/wlcg-wn:latest container does not have it, while it is present in the underlying docker container.
```bash
ls -l /cvmfs/unpacked.cern.ch/registry.hub.docker.com/matterminers/wlcg-wn\:latest/
insgesamt 7
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 12. Sep 04:38 cvmfs
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 12. Sep 05:06 dev
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 36 12. Sep 05:06 environment -> .singularity.d/env/90-environment.sh
drwxr-xr-x 60 scc-sdm-hep-0001 hk-project-test-hep 38 12. Sep 05:06 etc
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 12. Sep 05:06 home
drwxr-xr-x 3 scc-sdm-hep-0001 hk-project-test-hep 19 12. Sep 05:03 opt
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 12. Sep 05:06 proc
drwxr-x--- 3 scc-sdm-hep-0001 hk-project-test-hep 18 12. Sep 05:02 root
drwxr-xr-x 5 scc-sdm-hep-0001 hk-project-test-hep 50 12. Sep 05:03 run
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 24 12. Sep 05:06 singularity -> .singularity.d/runscript
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 12. Sep 05:06 sys
drwxrwxrwx 3 scc-sdm-hep-0001 hk-project-test-hep 29 12. Sep 05:03 tmp
drwxr-xr-x 10 scc-sdm-hep-0001 hk-project-test-hep 19 12. Sep 05:06 usr
drwxr-xr-x 9 scc-sdm-hep-0001 hk-project-test-hep 17 12. Sep 05:04 var
```
The matterminers/wlcg-wn:testing from April still have it.
```bash
ls -l /cvmfs/unpacked.cern.ch/registry.hub.docker.com/matterminers/wlcg-wn\:testing/
insgesamt 23
-rw-r--r-- 1 scc-sdm-hep-0001 hk-project-test-hep 12114 13. Nov 2020 anaconda-post.log
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 7 27. Feb 2021 bin -> usr/bin
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 4. Apr 02:31 cvmfs
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 13. Nov 2020 dev
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 36 4. Apr 02:49 environment -> .singularity.d/env/90-environment.sh
drwxr-xr-x 80 scc-sdm-hep-0001 hk-project-test-hep 38 4. Apr 02:49 etc
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 11. Apr 2018 home
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 7 27. Feb 2021 lib -> usr/lib
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 9 27. Feb 2021 lib64 -> usr/lib64
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 11. Apr 2018 media
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 11. Apr 2018 mnt
drwxr-xr-x 3 scc-sdm-hep-0001 hk-project-test-hep 19 4. Apr 02:46 opt
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 13. Nov 2020 proc
drwxr-x--- 3 scc-sdm-hep-0001 hk-project-test-hep 18 4. Apr 02:45 root
drwxr-xr-x 14 scc-sdm-hep-0001 hk-project-test-hep 50 4. Apr 02:46 run
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 8 27. Feb 2021 sbin -> usr/sbin
lrwxrwxrwx 1 scc-sdm-hep-0001 hk-project-test-hep 24 4. Apr 02:49 singularity -> .singularity.d/runscript
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 11. Apr 2018 srv
drwxr-xr-x 2 scc-sdm-hep-0001 hk-project-test-hep 6 13. Nov 2020 sys
drwxrwxrwx 8 scc-sdm-hep-0001 hk-project-test-hep 29 4. Apr 02:46 tmp
drwxr-xr-x 13 scc-sdm-hep-0001 hk-project-test-hep 19 4. Apr 02:49 usr
drwxr-xr-x 19 scc-sdm-hep-0001 hk-project-test-hep 17 4. Apr 02:46 var
```
From our monitoring it seems that it occurred the first time between September, 7th and 8th.
Thanks and best regards,
Manuelhttps://gitlab.cern.ch/unpacked/sync/-/issues/2Containers for ARM642022-04-15T11:13:47+02:00Malik Shahzad MuzaffarContainers for ARM64Can we deploy images for ARM64 (aarch64) under unpacked.cern.ch repository?Can we deploy images for ARM64 (aarch64) under unpacked.cern.ch repository?https://gitlab.cern.ch/unpacked/sync/-/issues/4service accounts and push-type models?2022-01-14T13:19:44+01:00Giordon Holtsberg Starkservice accounts and push-type models?How do we allow the sync to have access to private projects on gitlab? I assume there's a service account associated that we can add as a reporter to give read-access to the project's gitlab registry.
Additionally, is there a way to for...How do we allow the sync to have access to private projects on gitlab? I assume there's a service account associated that we can add as a reporter to give read-access to the project's gitlab registry.
Additionally, is there a way to force a sync whenever a new image is pushed to the gitlab registry?https://gitlab.cern.ch/unpacked/sync/-/issues/3Remove `:` from paths2020-06-03T21:46:10+02:00Dan GuestRemove `:` from pathsThis is a minor nitpick but if it's possible it might be desirable to remove `:` from paths. It's easy enough to work around by quoting the path but it could get confusing / ugly if people write more complicated scripts.This is a minor nitpick but if it's possible it might be desirable to remove `:` from paths. It's easy enough to work around by quoting the path but it could get confusing / ugly if people write more complicated scripts.https://gitlab.cern.ch/unpacked/sync/-/issues/7Remove Old/Nonexistent Images2020-05-29T20:29:52+02:00Alexx PerloffRemove Old/Nonexistent ImagesWe have asked that [1] be synchronized and this is working beautifully. However, it seems that the system is not removing old images, which have been removed from DockerHub. For example, we previously had the tag latest-gpu-py3-singulari...We have asked that [1] be synchronized and this is working beautifully. However, it seems that the system is not removing old images, which have been removed from DockerHub. For example, we previously had the tag latest-gpu-py3-singularity, but this image was removed from DockerHub. I still see the folder in CVMFS, but of course not in DockerHub. Is it part of the system design that it will remove non-existent images or is this beyond its current capabilities? This would be a desirable feature. If it's not part of the plan, how else might we remove these old images?
[1]
https://gitlab.cern.ch/unpacked/sync/-/blob/master/recipe.yaml#L62https://gitlab.cern.ch/unpacked/sync/-/issues/8Broken Jenkins Link2020-04-30T23:41:40+02:00Alexx PerloffBroken Jenkins LinkThe link to the Jenkins jobs [1] seems to be broken. I'm not sure if this is temporary or permanent. I was just confused when I couldn't check the status of the synchronizations.
[1]
https://gitlab.cern.ch/unpacked/sync/-/blob/master/RE...The link to the Jenkins jobs [1] seems to be broken. I'm not sure if this is temporary or permanent. I was just confused when I couldn't check the status of the synchronizations.
[1]
https://gitlab.cern.ch/unpacked/sync/-/blob/master/README.md#L5https://gitlab.cern.ch/unpacked/sync/-/issues/6new image versions not showing at sites2020-04-22T11:43:06+02:00Alessandra Fortinew image versions not showing at sitesHi,
Lukas updated the latest tag of the folding image in docker yesterday at around lunch time. But I still cannot see it at my site. It should contain the 7.6.9 client but the image I'm accessing still sees 7.5.1
```
aforti@vm26>singu...Hi,
Lukas updated the latest tag of the folding image in docker yesterday at around lunch time. But I still cannot see it at my site. It should contain the 7.6.9 client but the image I'm accessing still sees 7.5.1
```
aforti@vm26>singularity exec /cvmfs/unpacked.cern.ch/registry.hub.docker.com/lukasheinrich/folding\:latest FAHClient --version
WARNING: underlay of /etc/localtime required more than 50 (69) bind mounts
7.5.1
```
can you help debugging please?https://gitlab.cern.ch/unpacked/sync/-/issues/5sync all tags newer than X2020-04-20T19:49:45+02:00Lukas Alexander Heinrichsync all tags newer than XHi,
we'd like to sync https://hub.docker.com/r/ucatlas/analysisbase/tags
but don't need all historical tags. At the same time it would be
nice to have auto-syncing of any new tags
(the images have significant overlap with the atlas/a...Hi,
we'd like to sync https://hub.docker.com/r/ucatlas/analysisbase/tags
but don't need all historical tags. At the same time it would be
nice to have auto-syncing of any new tags
(the images have significant overlap with the atlas/analysisbase ones since they
are built on top of them so would also be interesting to see whether the de-duping on the
file-level works0https://gitlab.cern.ch/unpacked/sync/-/issues/1Can we make the project public?2019-01-17T16:24:24+01:00Simone MosciattiCan we make the project public?I was planning to store into this same repository the recipe files like https://gitlab.cern.ch/unpacked/sync/blob/qa/recipe.yaml and then access those file using wget from the stratum0 of unpacked.cern.ch
However if the repository is pr...I was planning to store into this same repository the recipe files like https://gitlab.cern.ch/unpacked/sync/blob/qa/recipe.yaml and then access those file using wget from the stratum0 of unpacked.cern.ch
However if the repository is private everything gets more complex.
Is there any reason why this repository is private? Can we make it open?
If we cannot make it open, then what is the standard strategy to access the data?
Thanks,
Simone