Skip to content

Fix upload retry mechanism in run_test.py

Chris Burr requested to merge test-upload-retry into master

I noticed some tests were failing to upload output due to a buggy retry mechnism:

Traceback (most recent call last):
  File "/tmp/663060165/run_test.py", line 416, in _uploader_loop
    await _run_uploader(*args, **kwargs)
  File "/tmp/663060165/run_test.py", line 455, in _run_uploader
    await asyncio.to_thread(_upload, path, job["s3"])
  File "/cvmfs/lhcbdev.cern.ch/conda/envs/DPA/analysis-productions/2022-08-24_15-23/linux-64/lib/python3.9/asyncio/threads.py", line 25, in to_thread
    return await loop.run_in_executor(None, func_call)
  File "/cvmfs/lhcbdev.cern.ch/conda/envs/DPA/analysis-productions/2022-08-24_15-23/linux-64/lib/python3.9/concurrent/futures/thread.py", line 58, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/tmp/663060165/run_test.py", line 492, in _upload
    _upload(path, retries=retries - 1)
TypeError: _upload() missing 1 required positional argument: 's3_data'

Merge request reports