KEMBAR78
Try to simplify FloorDiv axioms implications when needed during evaluations. by laithsakka · Pull Request #141267 · pytorch/pytorch · GitHub
Skip to content

Conversation

@laithsakka
Copy link
Contributor

@laithsakka laithsakka commented Nov 21, 2024

Summary:
This very much the same solution proposed by bobrenjc93 except that it restrict it to expressions and axioms that have FloorDiv, since those are the only ones that could have became CleanDiv. and the only one that can changes as shape env changes.

This also does not break torchrec benchmarks, it might be worth it to know why the generalization of this does break the torchrec benchmarks, but we could just be hitting another bug or NYI situation.

ovearhead?
None on

buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=1000

Differential Revision: D66307433

cc @ezyang @SherlockNoMad @EikanWang @jgong5 @wenzhe-nrv @voznesenskym @penguinwu @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @jiayisunx @chenyang78 @kadeng @chauhang @amjames

@pytorch-bot
Copy link

pytorch-bot bot commented Nov 21, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/141267

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (4 Unrelated Failures)

As of commit f3b78c1 with merge base 995e307 (image):

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

UNSTABLE - The following jobs failed but were likely due to flakiness present on trunk and has been marked as unstable:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added ciflow/inductor release notes: fx release notes category labels Nov 21, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@laithsakka
Copy link
Contributor Author

removing k.free_symbols.issubset(expr.free_symbols) remove the regression on torch rec. update the PR

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

laithsakka added a commit to laithsakka/pytorch that referenced this pull request Nov 23, 2024
…is changed. (pytorch#141267)

Summary:


This very much the same solution proposed by bobrenjc93 except that it restrict it to expressions and axioms that have FloorDiv, since those are the only ones that could have became CleanDiv. and the only one that can changes as shape env changes. 

This also does not break torchrec benchmarks, it might be worth it to know why the generalization of this does break the torchrec benchmarks, but we could just be hitting another bug or NYI situation.

ovearhead?

None on 

```
buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=2000

```

Differential Revision:
D66307433




cc ezyang SherlockNoMad EikanWang jgong5 wenzhe-nrv

D66307433

Test Plan:
run existing tests. 
```
 TORCH_LOGS="+dynamo" TORCHDYNAMO_VERBOSE=1 buck2 run mode/opt //minimal_viable_ai/fire:light -- -d ~/fbsource/fbcode/hpc/ -d ~/fbsource/fbcode/hammer -d ~/fbsource/fbcode/minimal_viable_ai/ minimal_viable_ai/new_format/preproc_ta/experimental/pt2_export_train_preproc_roo_for_umia.py --start-ts 2024-11-10+10:00:00 --end-ts 2024-11-10+11:00:00 --steps 1 --preproc-type TA_accel_cpu_eager --export-archive-path /home/lsakka
```
```
buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=10
```

Reviewed By: ezyang
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

…is changed. (pytorch#141267)

Summary:


This very much the same solution proposed by bobrenjc93 except that it restrict it to expressions and axioms that have FloorDiv, since those are the only ones that could have became CleanDiv. and the only one that can changes as shape env changes. 

This also does not break torchrec benchmarks, it might be worth it to know why the generalization of this does break the torchrec benchmarks, but we could just be hitting another bug or NYI situation.

ovearhead?

None on 

```
buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=2000

```

Differential Revision:
D66307433




cc ezyang SherlockNoMad EikanWang jgong5 wenzhe-nrv

D66307433

Test Plan:
run existing tests. 
```
 TORCH_LOGS="+dynamo" TORCHDYNAMO_VERBOSE=1 buck2 run mode/opt //minimal_viable_ai/fire:light -- -d ~/fbsource/fbcode/hpc/ -d ~/fbsource/fbcode/hammer -d ~/fbsource/fbcode/minimal_viable_ai/ minimal_viable_ai/new_format/preproc_ta/experimental/pt2_export_train_preproc_roo_for_umia.py --start-ts 2024-11-10+10:00:00 --end-ts 2024-11-10+11:00:00 --steps 1 --preproc-type TA_accel_cpu_eager --export-archive-path /home/lsakka
```
```
buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=10
```

Reviewed By: ezyang
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66307433

@laithsakka
Copy link
Contributor Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
…ations. (pytorch#141267)

Summary:
This very much the same solution proposed by bobrenjc93 except that it restrict it to expressions and axioms that have FloorDiv, since those are the only ones that could have became CleanDiv. and the only one that can changes as shape env changes.

This also does not break torchrec benchmarks, it might be worth it to know why the generalization of this does break the torchrec benchmarks, but we could just be hitting another bug or NYI situation.

ovearhead?
None on
```
buck2 run fbcode//mode/opt fbcode//torchrec/distributed/tests:pt2_compile_benchmark -- --num-features=1000
```

Differential Revision: D66307433

Pull Request resolved: pytorch#141267
Approved by: https://github.com/ezyang
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants