As the description says, we now have --configOnly option used in HLT test job. Can/should be adopted in other JOs.
Tagging people @wlampl @tadej @emoyse @zmarshal discussing it. For now, no flag for this option.