diff --git a/docs/advanced/large_copies.md b/docs/advanced/large_copies.md index a853a4d53e02bf6f80f659d3052fe414b55fb245..2aa00202379d9765b7b52168761f276c8957eb83 100644 --- a/docs/advanced/large_copies.md +++ b/docs/advanced/large_copies.md @@ -1,10 +1,13 @@ +--- +title: Large Data Transfers +--- # Dealing with Large Data Transfers -If you have to transfer a large amount of data (in the order of several tens of GBs), or a large amount of files (several thousands), to or from CERNBox, some precautions are in order, as interactive tools such as OS native file browsers or the CERNBox web interface may not be the best option. +If you have to transfer a large amount of data (in the order of several tens of GBs), or a large amount of files (several thousands), to or from CERNBox, some precautions are in order, as interactive tools such as OS native file browsers or the CERNBox Web UI may not be the most suitable options. ## Web Transfers -If you need to serve large files via web, whether anonymously or not, you should use [EOS web sites](web-pages/expose_files_in_website). Yet, we recommend to chunk very large files to help users downloading them in the absence of transfer recovery mechanisms. +If you need to serve large files via web, whether anonymously or not, you should use [EOS Web Sites](web-pages/expose_files_in_website.md). Yet, we recommend chunking very large files to help users download them in the absence of transfer recovery mechanisms. If you need to upload large files to EOS and are member of an Experiment, you are recommended to use HTTP Third-Party Copy (TPC) via the File Transfer Service. @@ -14,11 +17,11 @@ Note that if your recipient does not hold a CERN account, and you can only use C ## Other Data Transfers -The most efficient way to transfer data to/from CERNBox is to directly access the underlying storage. In case of EOS, you are recommended to [share the relevant folder(s) with the target account(s)](../web/sharing/auth-share/), not as a Public link, such that it can be accessed without passing through the CERNBox web UI. +The most efficient way to transfer data to/from CERNBox is to directly access the underlying storage. In case of EOS, you are recommended to [share the relevant folder(s)](../web/sharing/auth-share.md) with the target account(s), as opposed to ["Share publicly"](../web/sharing/public-share.md), such that it can be accessed without passing through the CERNBox Web UI. Depending on your OS, your options include: -* If you know how to use xrootd on a Linux-based systems, this is the best option as it offers checksum verification as well. +* If you know how to use XRootD on a Linux-based systems, this is the best option as it offers checksum verification as well. * If you have FUSE access (on Linux or MacOS), then a recommended tool is `rsync`, in particular with the following options: ``` diff --git a/docs/web/quota.fr.md b/docs/web/quota.fr.md index ea841662924c659b25a7e7de429e954b156f3aa4..7d34bd2e5be1d3d370b94325a5ea29272efd4c69 100644 --- a/docs/web/quota.fr.md +++ b/docs/web/quota.fr.md @@ -23,4 +23,4 @@ Le calcul de l'espace utilisé s'effectue de la manière suivante : ## Autres limites Comme mentionné, les fichiers ont une taille maximale de 50 GB, donc touts methodes d'accès (sync, FUSE, xrootd, network drive) produisent un erreur si on essaye de transferer un fichier plus grand. -En plus, pour les transferts via web la limite est 20 minutes de transfert. Vous pouvez consluter [Gestion des transferts de données volumineux](../advanced/large_copies) pour plus d'information. +En plus, pour les transferts via web la limite est 20 minutes de transfert. Vous pouvez consluter [Gestion des transferts de données volumineux](../advanced/large_copies.md) pour plus d'information. diff --git a/docs/web/quota.md b/docs/web/quota.md index cc321d54aaa6ed69740144f905690b5ddf7a7021..02c38e578974febe7b1610036583b94f9d086e6f 100644 --- a/docs/web/quota.md +++ b/docs/web/quota.md @@ -23,7 +23,7 @@ Your quota is calculated as follows: ## Other limits As mentioned, files can be up to 50 GB in size, and any access method (sync, FUSE, xrootd, network drive) would raise an error if you attempt to overcome this limit. -Furthermore, web transfers have their limits reduced to 20 minutes of transfer time. See [dealing with large data transfers](../advanced/large_copies) for further information and alternate options. +Furthermore, web transfers have their limits reduced to 20 minutes of transfer time. See [dealing with large data transfers](../advanced/large_copies.md) for further information and alternate options. <!-- TO BE CHECKED --> <!-- how to find the space used for a project? -->