KEMBAR78
[c++ Frontend] Make SGD match python by an-kumar · Pull Request #15840 · pytorch/pytorch · GitHub
Skip to content

Conversation

@an-kumar
Copy link
Contributor

@an-kumar an-kumar commented Jan 8, 2019

Fixes #15530


NoGradGuard guard;
p.add_(-update);
p.add_(-options.learning_rate_*update);
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: please add spaces around the *

Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@goldsborough has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@goldsborough
Copy link
Contributor

Looks good, just one comment.

@an-kumar
Copy link
Contributor Author

an-kumar commented Jan 9, 2019

Done. not sure why tests are failing after that change though.

Copy link
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@goldsborough is landing this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

c++ SGD and python SGD don't match

4 participants