Skip to content

protocols for shared filesystem redirection

Similar to #11 , I also did some testing with gfal/webdav.

The redirection works for xrdcp, but:

gfal-copy --verbose -t 90 -f davs://eos-mgm-0.wlcg-dev.uvic.ca:8443/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdir/test44682/gfal-testfile file:///dev/null
Copying 44 bytes davs://eos-mgm-0.wlcg-dev.uvic.ca:8443/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdir/test44682/gfal-testfile => file:///dev/null
event: [1734646813256] BOTH   GFAL2:CORE:COPY	LIST:ENTER	
event: [1734646813256] BOTH   GFAL2:CORE:COPY	LIST:ITEM	davs://eos-mgm-0.wlcg-dev.uvic.ca:8443/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdir/test44682/gfal-testfile => file:///dev/null
event: [1734646813256] BOTH   GFAL2:CORE:COPY	LIST:EXIT	
event: [1734646813257] BOTH   GFAL2:CORE:COPY:LOCAL	TRANSFER:ENTER	davs://eos-mgm-0.wlcg-dev.uvic.ca:8443/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdir/test44682/gfal-testfile => file:///dev/null
event: [1734646813257] BOTH   GFAL2:CORE:COPY:LOCAL	TRANSFER:TYPE	streamed
gfal-copy error: 113 (No route to host) - Result Domain name resolution failed after 1 attempts
gfal copy out file			 [ FAILED ]

curl --show-error --connect-timeout 300 --max-time 3600 --cacert /pilotdir/proxy --capath /cvmfs/atlas.cern.ch/repo/ATLASLocalRootBase/etc/grid-security-emi/certificates --cert /pilotdir/proxy --key /pilotdir/proxy -L https://eos-mgm-0.wlcg-dev.uvic.ca:8443/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdownloads/group.phys-higgs.00329780.r10203_p3399_p4165.25542036.PAOD_WH._000224.pool.root -o //pilotdir/group.phys-higgs.00329780.r10203_p3399_p4165.25542036.PAOD_WH._000224.pool.root -w %{url_effective}\n
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
curl: (6) Could not resolve host: file
http://file//localhost/eos-storage/eos-data/eos-fst-1/00000000/00000123:-1/eos/wlcg-dev.uvic.ca/data/atlas/atlasscratchdisk/rptaylor/testdownloads/group.phys-higgs.00329780.r10203_p3399_p4165.25542036.PAOD_WH._000224.pool.root?encURI=
curl download from WebDAV door			 [ FAILED ]

Both commands succeed if I disable the redirection feature. I am not sure what gfal-copy is getting confused on. The curl download might work with file://localhost/eos-storage instead of http://file//localhost/eos-storage , but either way, I think HTTP is typically used for WAN transfers so might not be suitable for redirection. Do you think it would make sense to only redirect for xrootd-based transfers?