Skip to content

Improve learning rate configs

Xiangyang Ju requested to merge xju/lr into dev
  • add monitor value and mode for ReduceLROnPlateau. New configuration:
    • metric_mode, default min
    • metric_to_monitor, default val_loss
  • add weight decay for AdamW, which can be optionally configured via lr_weight_decay.

Merge request reports