Skip to content

Implementing a Gradient Cosine Similarity metric

Nikita Ivvan Pond requested to merge npond/salt:cosine_grad into main

Description

Takes work/code written by @isanai, which calculates the cosine similarity between the gradients of a given set of task pairs. This MR introduces this as a Callback, for hopefully easier use.

Review checklist:

  • CI Passing
  • Comments addressed
  • Source branch is up to date with target
Edited by Nikita Ivvan Pond

Merge request reports