Skip to content

GitLab

  • Menu
Projects Groups Snippets
    • Loading...
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
  • Sign in
  • training-dataset-dumper training-dataset-dumper
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
    • Locked Files
  • Issues 11
    • Issues 11
    • List
    • Boards
    • Service Desk
    • Milestones
    • Iterations
  • Jira
    • Jira
  • Merge requests 7
    • Merge requests 7
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Packages & Registries
    • Packages & Registries
    • Container Registry
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Code review
    • Issue
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • atlas-flavor-tagging-tools
  • training-dataset-dumpertraining-dataset-dumper
  • Merge requests
  • !217

Merged
Created Dec 01, 2021 by Samuel Van Stroud@svanstroDeveloper

Automated tagging of grid jobs

  • Overview 22
  • Commits 8
  • Pipelines 9
  • Changes 3

For reproducibility, a nice feature to have is to create a tag every time a significant production of training is run. This adds a CLI for submit-single-btag with the following args:

 -h: get help
 -c  path to config file to use
 -t  tag the current commit using the supplied string
 -d: perform a dry run (no submit)
 -f: force submit even if uncommited changes exist

A few convenience options, like overwriting the default config with -c or adding a readable description to the job out name with -d are provided. If the user specifies that they want the job to be tagged with -t, the script looks for a tag associated with HEAD. If one isn't found, a tag is created using the current date and the most recent commit hash. By default, the script does not allow the user to run -t if uncommitted changes exist in ./training-dataset-dumper.

Things to improve:

  • It would be nice to standardise this functionality to the other submit scripts too. I know @dguest has mentioned creating a wrapper job submission script, so we could move the CLI and tagging functionality there when that is done.
Edited Dec 02, 2021 by Samuel Van Stroud
Assignee
Assign to
Reviewer
Request review from
Time tracking
Source branch: svanstro/r22-tag-on-submit