Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(pytorch): correct step-based learning rate decay #405

Merged
merged 1 commit into from
Feb 11, 2024

Commits on Feb 11, 2024

  1. fix(pytorch): correct step-based learning rate decay

    This commit addresses an issue with the step-based learning rate decay
    mechanism when `lr_decay_ref` is set to 'step'. Previously, the learning
    rate was decaying too rapidly due to a bug in the decay logic. This fix
    ensures that the learning rate decays at the correct pace as per the
    step-based decay configuration.
    rickstaa committed Feb 11, 2024
    Configuration menu
    Copy the full SHA
    e669a23 View commit details
    Browse the repository at this point in the history