Improve handling of file opening with xrootd in get_unprocessed_files.py
requested to merge 172-improve-handling-of-file-opening-with-xrootd-in-get_unprocessed_files-py into master
Closes #172 (closed)
This MR corrects the missing timeout when opening a file with xrootd, using a timeout of 30 seconds instead of xrootd's default value of 1.5 hours. In addition, it provides a skipbadfiles
argument, mimicking coffea
's implementation. This argument can be used to ignore xrootd's usual errors (such as timeout), automatically marking the bad files as unprocessed.