Memory Usage of Large Jobs
When running AP jobs on with many HLT2 lines for PIDCalib, I find high memory usage that can go over the limits. Previously I had to split the APs into sub-jobs to get around this (i.e. see lhcb-datapkg/AnalysisProductions!4188 (comment 10387842)).
I've tested this with the latest version of DaVinci, v66r6, (see https://lhcb-productions.web.cern.ch/ana-prod/pipelines/?id=22067), and find that the usage is still at the limit.
It would be good if there was an alternative to splitting the job in situations like this.