Skip to content

Make sure XGBoost doesn't use more than 1 thread

Marco Clemencic requested to merge disable-OpenMP-for-XGBoost into master

it turned out that XGBoost (used in CaloTools) uses OpenMP to parallelize and that has a negative impact on HLT throughput (where we saturate the machine with multiple processes) and possibly on multithreaded jobs.

Setting OMP_THREAD_LIMIT=1 forces OpenMP to work sequentially, giving us back control of the use of CPUs.

CC: @sstahl

Merge request reports