KEMBAR78
[DDP] Remove SPMD from self.modules_buffers by rohan-varma · Pull Request #64474 · pytorch/pytorch · GitHub
Skip to content

[DDP] Remove SPMD from self.modules_buffers #64474

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 3 commits into from
Closed

[DDP] Remove SPMD from self.modules_buffers #64474

wants to merge 3 commits into from

Conversation

@rohan-varma
Copy link
Contributor

@rohan-varma rohan-varma commented Sep 3, 2021 •
edited
Loading

@rohan-varma
[DDP] Remove SPMD from self.modules_buffers
ed109e3 
No need for a nested list here.

Differential Revision: [D30745960](https://our.internmc.facebook.com/intern/diff/D30745960/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Sep 3, 2021 •
edited
Loading

🔗 Helpful links

💊 CI failures summary and remediations

As of commit c308dd3 (more details on the Dr. CI page):

  • 1/1 failures introduced in this PR

🕵️ 1 new failure recognized by patterns

The following CI failures do not appear to be due to upstream breakages:

See GitHub Actions build win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (1/1)

Step: "Run test scripts" (full log | diagnosis details | 🔁 rerun)

2021-09-08T00:37:14.4701607Z ERROR [0.005s]: test_poisson_sample (__main__.TestDistributions) 
2021-09-08T00:37:14.4691942Z   File "distributions/test_distributions.py", line 812, in _check_sampler_discrete
2021-09-08T00:37:14.4693080Z     chisq, p = scipy.stats.chisquare(counts[msk], pmf[msk] * num_samples)
2021-09-08T00:37:14.4694299Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6852, in chisquare
2021-09-08T00:37:14.4695379Z     return power_divergence(f_obs, f_exp=f_exp, ddof=ddof, axis=axis,
2021-09-08T00:37:14.4696565Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6694, in power_divergence
2021-09-08T00:37:14.4697529Z     raise ValueError(msg)
2021-09-08T00:37:14.4698866Z ValueError: For each axis slice, the sum of the observed frequencies must agree with the sum of the expected frequencies to a relative tolerance of 1e-08, but the percent differences are:
2021-09-08T00:37:14.4700208Z 0.008265582255680495
2021-09-08T00:37:14.4700484Z 
2021-09-08T00:37:14.4700888Z ======================================================================
2021-09-08T00:37:14.4701607Z ERROR [0.005s]: test_poisson_sample (__main__.TestDistributions)
2021-09-08T00:37:14.4702486Z ----------------------------------------------------------------------
2021-09-08T00:37:14.4703186Z Traceback (most recent call last):
2021-09-08T00:37:14.4704137Z   File "distributions/test_distributions.py", line 1352, in test_poisson_sample
2021-09-08T00:37:14.4705096Z     self._check_sampler_discrete(Poisson(rate),
2021-09-08T00:37:14.4706129Z   File "distributions/test_distributions.py", line 812, in _check_sampler_discrete
2021-09-08T00:37:14.4707267Z     chisq, p = scipy.stats.chisquare(counts[msk], pmf[msk] * num_samples)
2021-09-08T00:37:14.4708458Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6852, in chisquare
2021-09-08T00:37:14.4709540Z     return power_divergence(f_obs, f_exp=f_exp, ddof=ddof, axis=axis,
2021-09-08T00:37:14.4710727Z   File "c:\jenkins\miniconda3\lib\site-packages\scipy\stats\stats.py", line 6694, in power_divergence
2021-09-08T00:37:14.4711683Z     raise ValueError(msg)
This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

This was referenced Sep 3, 2021
Closed
Closed
rohan-varma added a commit that referenced this pull request Sep 3, 2021
@rohan-varma
[DDP] Remove SPMD from self.modules_buffers
a6f4a0d 
No need for a nested list here.

Differential Revision: [D30745960](https://our.internmc.facebook.com/intern/diff/D30745960/)

ghstack-source-id: 137361024
Pull Request resolved: #64474
@facebook-github-bot facebook-github-bot added the oncall: distributed Add this issue/PR to distributed oncall triage queue label Sep 3, 2021
@rohan-varma
Update on "[DDP] Remove SPMD from self.modules_buffers"
2a98426 
No need for a nested list here.

Differential Revision: [D30745960](https://our.internmc.facebook.com/intern/diff/D30745960/)

cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse agolynski @SciPioneer @H-Huang mrzzd cbalioglu gcramer23

[ghstack-poisoned]
This was referenced Sep 5, 2021
Closed
Closed
Closed
@rohan-varma
Update on "[DDP] Remove SPMD from self.modules_buffers"
c308dd3 
No need for a nested list here.

Differential Revision: [D30745960](https://our.internmc.facebook.com/intern/diff/D30745960/)

cc pietern mrshenli pritamdamania87 zhaojuanmao satgera rohan-varma gqchen aazzolini osalpekar jiayisuse agolynski @SciPioneer @H-Huang mrzzd cbalioglu gcramer23

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 1553259.

@facebook-github-bot
Copy link
Contributor

This pull request has been reverted by f1aaf8a.

@facebook-github-bot facebook-github-bot deleted the gh/rohan-varma/403/head branch September 12, 2021 14:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@zhaojuanmao zhaojuanmao zhaojuanmao approved these changes

@cbalioglu cbalioglu Awaiting requested review from cbalioglu

@H-Huang H-Huang Awaiting requested review from H-Huang

@mingzhe09088 mingzhe09088 Awaiting requested review from mingzhe09088

@mrshenli mrshenli Awaiting requested review from mrshenli

@pritamdamania87 pritamdamania87 Awaiting requested review from pritamdamania87

@wayi1 wayi1 Awaiting requested review from wayi1

Assignees

No one assigned

Labels

cla signed Merged oncall: distributed Add this issue/PR to distributed oncall triage queue Reverted

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@rohan-varma @facebook-github-bot @zhaojuanmao