Skip to content

Make sure XGBoost doesn't use more than 1 thread

it turned out that XGBoost (used in CaloTools) uses OpenMP to parallelize and that has a negative impact on HLT throughput (where we saturate the machine with multiple processes) and possibly on multithreaded jobs.

Setting OMP_THREAD_LIMIT=1 forces OpenMP to work sequentially, giving us back control of the use of CPUs.

CC: @sstahl

Merge request reports

Loading