From 0390fda990152293f0752a403ed5706e9a67e654 Mon Sep 17 00:00:00 2001 From: Giuseppe Lo Presti <giuseppe.lopresti@cern.ch> Date: Tue, 4 Mar 2025 09:12:20 +0000 Subject: [PATCH] Applied comments --- docs/advanced/large_copies.md | 11 +++++++---- docs/web/quota.fr.md | 2 +- docs/web/quota.md | 2 +- 3 files changed, 9 insertions(+), 6 deletions(-) diff --git a/docs/advanced/large_copies.md b/docs/advanced/large_copies.md index a853a4d..2aa0020 100644 --- a/docs/advanced/large_copies.md +++ b/docs/advanced/large_copies.md @@ -1,10 +1,13 @@ +--- +title: Large Data Transfers +--- # Dealing with Large Data Transfers -If you have to transfer a large amount of data (in the order of several tens of GBs), or a large amount of files (several thousands), to or from CERNBox, some precautions are in order, as interactive tools such as OS native file browsers or the CERNBox web interface may not be the best option. +If you have to transfer a large amount of data (in the order of several tens of GBs), or a large amount of files (several thousands), to or from CERNBox, some precautions are in order, as interactive tools such as OS native file browsers or the CERNBox Web UI may not be the most suitable options. ## Web Transfers -If you need to serve large files via web, whether anonymously or not, you should use [EOS web sites](web-pages/expose_files_in_website). Yet, we recommend to chunk very large files to help users downloading them in the absence of transfer recovery mechanisms. +If you need to serve large files via web, whether anonymously or not, you should use [EOS Web Sites](web-pages/expose_files_in_website.md). Yet, we recommend chunking very large files to help users download them in the absence of transfer recovery mechanisms. If you need to upload large files to EOS and are member of an Experiment, you are recommended to use HTTP Third-Party Copy (TPC) via the File Transfer Service. @@ -14,11 +17,11 @@ Note that if your recipient does not hold a CERN account, and you can only use C ## Other Data Transfers -The most efficient way to transfer data to/from CERNBox is to directly access the underlying storage. In case of EOS, you are recommended to [share the relevant folder(s) with the target account(s)](../web/sharing/auth-share/), not as a Public link, such that it can be accessed without passing through the CERNBox web UI. +The most efficient way to transfer data to/from CERNBox is to directly access the underlying storage. In case of EOS, you are recommended to [share the relevant folder(s)](../web/sharing/auth-share.md) with the target account(s), as opposed to ["Share publicly"](../web/sharing/public-share.md), such that it can be accessed without passing through the CERNBox Web UI. Depending on your OS, your options include: -* If you know how to use xrootd on a Linux-based systems, this is the best option as it offers checksum verification as well. +* If you know how to use XRootD on a Linux-based systems, this is the best option as it offers checksum verification as well. * If you have FUSE access (on Linux or MacOS), then a recommended tool is `rsync`, in particular with the following options: ``` diff --git a/docs/web/quota.fr.md b/docs/web/quota.fr.md index ea84166..7d34bd2 100644 --- a/docs/web/quota.fr.md +++ b/docs/web/quota.fr.md @@ -23,4 +23,4 @@ Le calcul de l'espace utilisé s'effectue de la manière suivante : ## Autres limites Comme mentionné, les fichiers ont une taille maximale de 50 GB, donc touts methodes d'accès (sync, FUSE, xrootd, network drive) produisent un erreur si on essaye de transferer un fichier plus grand. -En plus, pour les transferts via web la limite est 20 minutes de transfert. Vous pouvez consluter [Gestion des transferts de données volumineux](../advanced/large_copies) pour plus d'information. +En plus, pour les transferts via web la limite est 20 minutes de transfert. Vous pouvez consluter [Gestion des transferts de données volumineux](../advanced/large_copies.md) pour plus d'information. diff --git a/docs/web/quota.md b/docs/web/quota.md index cc321d5..02c38e5 100644 --- a/docs/web/quota.md +++ b/docs/web/quota.md @@ -23,7 +23,7 @@ Your quota is calculated as follows: ## Other limits As mentioned, files can be up to 50 GB in size, and any access method (sync, FUSE, xrootd, network drive) would raise an error if you attempt to overcome this limit. -Furthermore, web transfers have their limits reduced to 20 minutes of transfer time. See [dealing with large data transfers](../advanced/large_copies) for further information and alternate options. +Furthermore, web transfers have their limits reduced to 20 minutes of transfer time. See [dealing with large data transfers](../advanced/large_copies.md) for further information and alternate options. <!-- TO BE CHECKED --> <!-- how to find the space used for a project? --> -- GitLab