Make sure XGBoost doesn't use more than 1 thread (!1214) · Merge requests · LHCb / Rec

Marco Clemencic requested to merge disable-OpenMP-for-XGBoost into master Sep 21, 2018

it turned out that XGBoost (used in CaloTools) uses OpenMP to parallelize and that has a negative impact on HLT throughput (where we saturate the machine with multiple processes) and possibly on multithreaded jobs.

Setting OMP_THREAD_LIMIT=1 forces OpenMP to work sequentially, giving us back control of the use of CPUs.

CC: @sstahl

Make sure XGBoost doesn't use more than 1 thread

Merge request reports