cmssam merge requestshttps://gitlab.cern.ch/etf/cmssam/-/merge_requests2020-03-31T14:21:16+02:00https://gitlab.cern.ch/etf/cmssam/-/merge_requests/24Stop trying squids after one successful fn-req when script runs as pilot, add...2020-03-31T14:21:16+02:00Edita KizinevicStop trying squids after one successful fn-req when script runs as pilot, add FRONTIER_ID to fn-reqhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/23Skip failover check when running as a pilot2020-03-23T09:24:06+01:00Edita KizinevicSkip failover check when running as a pilothttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/22Replace host with getent function2020-02-24T10:42:19+01:00Edita KizinevicReplace host with getent functionhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/21Add check for IPv6 address2020-02-21T11:05:02+01:00Edita KizinevicAdd check for IPv6 addresshttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/20Include backup proxies for pilots tests and exclude backup proxies for SAM tests2020-02-17T13:38:22+01:00Edita KizinevicInclude backup proxies for pilots tests and exclude backup proxies for SAM testshttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/19replace missed jq-s with same grep as previous substitution2020-02-18T14:23:17+01:00Stephan Lammelreplace missed jq-s with same grep as previous substitutionreplace missed jq-s with same grep as previous substitutionreplace missed jq-s with same grep as previous substitutionhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/18Catch GitLab outages in org.cms.WN-basic2020-02-13T10:12:32+01:00John ThiltgesCatch GitLab outages in org.cms.WN-basicIn `fetch-from-web-GitLab`, add `--fail` flag to curl, giving a a non-zero return code for failed downloads.
When GitLab is down, the SAM test returns CRITICAL, rather than WARNING
Ex. http://wlcg-sam-cms.cern.ch/dashboard/request.py/m...In `fetch-from-web-GitLab`, add `--fail` flag to curl, giving a a non-zero return code for failed downloads.
When GitLab is down, the SAM test returns CRITICAL, rather than WARNING
Ex. http://wlcg-sam-cms.cern.ch/dashboard/request.py/metricOutput?host=red-gw2.unl.edu&time=2020-01-28T06:07:28Z&metricfqan=org.cms.WN-basic%20(_cms_Role_lcgadmin)
Adding the `--fail` flag to curl will result in a non-zero return code for failed GitLab requests, and should hopefully sort this out.
**Curl examples:**
A successful curl returns 0, as expected
```
$ curl http://t2.unl.edu/hello.txt
hello
$ echo $?
0
```
With an unsuccessful 404, curl also returns 0
```
$ curl http://t2.unl.edu/goodbye.txt
<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>404 Not Found</title>
</head><body>
<h1>Not Found</h1>
<p>The requested URL /goodbye.txt was not found on this server.</p>
</body></html>
$ echo $?
0
```
Adding the `--fail` flag causes a non-zero return code for the failed attempt
```
$ curl --fail http://t2.unl.edu/goodbye.txt
curl: (22) The requested URL returned error: 404 Not Found
$ echo $?
22
```https://gitlab.cern.ch/etf/cmssam/-/merge_requests/17Fixed bug that makes curl to fail on SLC6 nodes2019-10-22T11:07:43+02:00Andrea SciabaFixed bug that makes curl to fail on SLC6 nodesAndrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/16xrootd endpoint: Increase the read() request timeout from 30 to 90 seconds2019-10-07T14:50:21+02:00John Thiltgesxrootd endpoint: Increase the read() request timeout from 30 to 90 secondsIf a server fails to respond, the client waits until the stream timeout expires before retrying. The stream timeout uses the default of 60 seconds.
By increasing the request timeout to 90 seconds, it allows time for a retry. This will h...If a server fails to respond, the client waits until the stream timeout expires before retrying. The stream timeout uses the default of 60 seconds.
By increasing the request timeout to 90 seconds, it allows time for a retry. This will hopefully avoid spurious warnings.
Timeout diagram: https://xrootd.slac.stanford.edu/doc/xrdcl-docs/www/xrdcldocs.html#x1-580004.3.6Andrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/15Check failover list2019-09-23T14:37:23+02:00Edita KizinevicCheck failover listhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/14Update squid SAM test2019-09-09T19:03:13+02:00Edita KizinevicUpdate squid SAM testAndrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/13Update squid SAM test2019-09-02T13:11:04+02:00Edita KizinevicUpdate squid SAM testStop process any more proxyconfigurls after debug_output includes FindProxyForURL, run successfully if no proxies are found, remove test_squid.py fileStop process any more proxyconfigurls after debug_output includes FindProxyForURL, run successfully if no proxies are found, remove test_squid.py fileAndrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/12add xrootd version to trigger warning2019-09-27T10:12:31+02:00Marian Zvadaadd xrootd version to trigger warningAndrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/11Replacing jq for better test compatibility with native OS functions2019-05-06T11:08:44+02:00Maria Acosta FlechasReplacing jq for better test compatibility with native OS functionsWe noticed the test was not running as expected at some sites since jq is an atypical library. Changed it to grep and perl (most likely to be present at WNs) and updated date parsing since GitLab now attaches timezones.We noticed the test was not running as expected at some sites since jq is an atypical library. Changed it to grep and perl (most likely to be present at WNs) and updated date parsing since GitLab now attaches timezones.Andrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/10Use getent command instead of host2019-04-17T09:37:41+02:00Edita KizinevicUse getent command instead of hosthttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/9Give a warn if some addresses fail but other work2019-04-16T13:39:09+02:00Edita KizinevicGive a warn if some addresses fail but other workhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/8Correctly parse output of host command2019-04-16T10:14:31+02:00Edita KizinevicCorrectly parse output of host commandhttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/7Use fn-req instead of the python client2019-04-02T11:29:34+02:00Edita KizinevicUse fn-req instead of the python clientAndrea SciabaAndrea Sciabahttps://gitlab.cern.ch/etf/cmssam/-/merge_requests/6Improved logic/Disabled failures xrootd-fallback2019-03-01T10:09:03+01:00Maria Acosta FlechasImproved logic/Disabled failures xrootd-fallbackMinor fix to avoid timeouts before strictly necessary. Better logging.Minor fix to avoid timeouts before strictly necessary. Better logging.https://gitlab.cern.ch/etf/cmssam/-/merge_requests/5Timeout/logic improvements for xrootd-fallback test2019-02-22T09:57:53+01:00Maria Acosta FlechasTimeout/logic improvements for xrootd-fallback test* New logic introduces an individual timeout for cmsRun processes. If we hit an overloaded/unresponsive site, it won't waste the whole test trying to read from it, instead it will kill it after 150 seconds and try again.
* Overall probe...* New logic introduces an individual timeout for cmsRun processes. If we hit an overloaded/unresponsive site, it won't waste the whole test trying to read from it, instead it will kill it after 150 seconds and try again.
* Overall probe timeout was adjusted to 300 seconds.
* Re organized site list in order to not limit the attempts to a single region.
* Limited CMSSW to read a single event (We are only worried about the file being served and not corrupted)Andrea SciabaAndrea Sciaba