Skip to content

make merged summary XML downloadable

Ryunosuke O'Neil requested to merge provenance-and-counters into main

Merging summary XML files from logSE is working, but unfortunately takes too long for larger productions that the API call will often time out. I tried submitting chunks of xrdcp tasks using asyncio.gather but doesn't really make much of a difference.

Need to think about how to perform the merging operations without blocking API for too long. Perhaps using S3 to store the merged result and performing the merging operation in a celery task?

Merge request reports