High memory usage in HLT2
High memory usage was encountered during processing fills 9568 to 9573. This is the first fill after the updated Plume calibration with the new mu = 5 which is 18% higher. Likely this is the highest mu that HLT2 has seen. Many nodes killed the HLT2 processing during memory deallocation and went offline: https://lblogbook.cern.ch/HLT/864 The number of HLT2 threads was changed to adapt to the available machine RAM https://lblogbook.cern.ch/HLT/868
Then we started to process the next fill and the situation deteriorated: https://lblogbook.cern.ch/HLT/870
Edited by Christopher Rob Jones