Fix jobs stuck in submitting
As flagged up by
lhcb-simulation/mc-requests!309 (merged)
There is a tendency for jobs to sometimes be stuck in submitting, which gives a false impression to the users on gitlab that its running whereas its actually not doing anything
It would be better if the system can check if something is stuck in submitting, retry it, and fail it if its gone past a couple of times.