Backport pile-up pretracking step to 24.0 as we may want to run a production-like validation of this workflow. Furthermore this may help some data overlay developments.
We will make sure future MRs target 24.0 instead.
/cc @jchapman @fatsai @mbandier @schaarsc