[CI] Fix broken pipeline auto-cancel

It seems that auto-cancelling of pipelines is broken when a new commit is added. This should be fixed as we are wasting resources here.