Large HTCondor workloads triggering overuse of AFS volumes
We need to investigate more efficient ways of interacting with the AFS system, since large numbers of jobs cause too much load on the AFS and get automatically throttled. This unnecessarily restricts the number of running jobs and extends the total duration of the simulations.
Most likely the reason is the creation of a virtual environment in each jobs.
More on best practices: KB0003076