Enable trace through the collections module #159365

guilhermeleobas · 2025-07-29T14:33:21Z

Stack from ghstack (oldest at bottom):

cc @voznesenskym @penguinwu @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @chauhang @amjames @Lucaskabela

[ghstack-poisoned]

pytorch-bot · 2025-07-29T14:33:25Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/159365

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit 441c2a9 with merge base e299926 ():

FLAKY - The following job failed but was likely due to flakiness present on trunk:

inductor / cuda12.8-py3.10-gcc9-sm86 / test (inductor_torchbench, 2, 2, linux.g5.4xlarge.nvidia.gpu) (gh) (similar failure)
vision_maskrcnn

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ghstack-poisoned]

zou3519 · 2025-08-13T22:41:50Z

torch/_dynamo/convert_frame.py

+        if (
+            frame.f_code.co_filename == "<string>" and frame.f_code.co_name == "__new__"
+        ) or (
+            frame.f_code.co_filename.endswith("collections/__init__.py")
+            and frame.f_code.co_name == "_make"
+        ):
+            # nametuple constructor/_make


Is there a test for this? (will we catch if namedtuple changes file location?)

For some obscure reason, dynamo tries to trace the _make function after the original function was compiled.

will we catch if namedtuple changes file location?

Probably no but some of the tests in test_collection will fail.

zou3519

If it works then it works

[ghstack-poisoned]

pytorchmergebot · 2025-08-15T00:27:42Z

Starting merge as part of PR stack under #159483

pytorchmergebot · 2025-08-15T14:49:34Z

Starting merge as part of PR stack under #159368

[ghstack-poisoned]

pytorchmergebot · 2025-08-15T18:28:52Z

Starting merge as part of PR stack under #159483

…nNew` (#159366) Also add MutableMappingVariable to `call_or_` / `call_ior` Pull Request resolved: #159366 Approved by: https://github.com/zou3519 ghstack dependencies: #159365

Pull Request resolved: #159368 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366

Pull Request resolved: #159483 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368

#159902) Pull Request resolved: #159902 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483

…159864) Pull Request resolved: #159864 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483, #159902

…ts (#159865) Changes: (1) Replace UserDefinedSetVariable by UserDefinedObjectVariable in all binop calls Test plan: (1) The three tests from CPython `test_collections.py` ensures that Dynamo can trace through a dunder method (e.g. __add__, __ixor__, etc) defined in a user defined class Pull Request resolved: #159865 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483, #159902, #159864

Pull Request resolved: #159367 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483, #159902, #159864, #159865

Pull Request resolved: pytorch#159365 Approved by: https://github.com/zou3519

…nNew` (pytorch#159366) Also add MutableMappingVariable to `call_or_` / `call_ior` Pull Request resolved: pytorch#159366 Approved by: https://github.com/zou3519 ghstack dependencies: pytorch#159365

Pull Request resolved: pytorch#159368 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366

Pull Request resolved: pytorch#159483 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368

pytorch#159902) Pull Request resolved: pytorch#159902 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483

…ytorch#159864) Pull Request resolved: pytorch#159864 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902

…ts (pytorch#159865) Changes: (1) Replace UserDefinedSetVariable by UserDefinedObjectVariable in all binop calls Test plan: (1) The three tests from CPython `test_collections.py` ensures that Dynamo can trace through a dunder method (e.g. __add__, __ixor__, etc) defined in a user defined class Pull Request resolved: pytorch#159865 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902, pytorch#159864

Pull Request resolved: pytorch#159367 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902, pytorch#159864, pytorch#159865

Pull Request resolved: pytorch#159365 Approved by: https://github.com/zou3519

…nNew` (pytorch#159366) Also add MutableMappingVariable to `call_or_` / `call_ior` Pull Request resolved: pytorch#159366 Approved by: https://github.com/zou3519 ghstack dependencies: pytorch#159365

Pull Request resolved: pytorch#159368 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366

Pull Request resolved: pytorch#159483 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368

pytorch#159902) Pull Request resolved: pytorch#159902 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483

…ytorch#159864) Pull Request resolved: pytorch#159864 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902

…ts (pytorch#159865) Changes: (1) Replace UserDefinedSetVariable by UserDefinedObjectVariable in all binop calls Test plan: (1) The three tests from CPython `test_collections.py` ensures that Dynamo can trace through a dunder method (e.g. __add__, __ixor__, etc) defined in a user defined class Pull Request resolved: pytorch#159865 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902, pytorch#159864

Pull Request resolved: pytorch#159367 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366, pytorch#159368, pytorch#159483, pytorch#159902, pytorch#159864, pytorch#159865

Update

d38ed4e

[ghstack-poisoned]

pytorch-bot bot added ciflow/inductor module: dynamo labels Jul 29, 2025

This was referenced Jul 29, 2025

Change mutation type of MutableMappingVariable to AttributeMutationNew #159366

Closed

Fixes for collections.NamedTuple #159367

Closed

Fixes for collections.Counter #159368

Closed

guilhermeleobas added the topic: not user facing topic category label Jul 29, 2025

Update

c0f8273

[ghstack-poisoned]

pytorchbot added the open source label Jul 29, 2025

guilhermeleobas added the keep-going Don't stop on first failure, keep running tests until the end label Jul 29, 2025

guilhermeleobas mentioned this pull request Jul 30, 2025

Don't call _call_iter_tuple_list with UserDefinedObjectVariable arg #159402

Closed

Update

53415de

[ghstack-poisoned]

guilhermeleobas marked this pull request as ready for review August 1, 2025 14:29

guilhermeleobas mentioned this pull request Aug 1, 2025

Support next(iterator, default) #159483

Closed

Update

c48d56d

[ghstack-poisoned]

This was referenced Aug 5, 2025

Implement list(UserDefinedObject) via force_unpack_var_sequence #159864

Closed

[collections.abc] Ensure that binop calls works with UserDefinedObjects #159865

Closed

guilhermeleobas requested a review from anijain2305 August 5, 2025 14:10

Update

a0786e4

[ghstack-poisoned]

guilhermeleobas mentioned this pull request Aug 5, 2025

Wrap class definitions in set_fullgraph(False) in test_collections #159902

Closed

zou3519 reviewed Aug 13, 2025

View reviewed changes

zou3519 approved these changes Aug 13, 2025

View reviewed changes

guilhermeleobas added 2 commits August 14, 2025 17:09

Update

44585d2

[ghstack-poisoned]

Update

210bff0

[ghstack-poisoned]

Update

441c2a9

[ghstack-poisoned]

pytorchmergebot closed this in 0242d40 Aug 15, 2025

pytorchmergebot added the Merged label Aug 15, 2025

pytorchmergebot pushed a commit that referenced this pull request Aug 15, 2025

Fixes for collections.Counter (#159368)

e5621b4

Pull Request resolved: #159368 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366

pytorchmergebot pushed a commit that referenced this pull request Aug 15, 2025

Support next(iterator, default) (#159483)

b78968b

Pull Request resolved: #159483 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368

pytorchmergebot pushed a commit that referenced this pull request Aug 16, 2025

Wrap class definitions in set_fullgraph(False) in test_collections (

f1bc843

#159902) Pull Request resolved: #159902 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483

pytorchmergebot pushed a commit that referenced this pull request Aug 18, 2025

Fixes for collections.NamedTuple (#159367)

c6333f7

Pull Request resolved: #159367 Approved by: https://github.com/mlazos ghstack dependencies: #159365, #159366, #159368, #159483, #159902, #159864, #159865

can-gaa-hou pushed a commit to can-gaa-hou/pytorch that referenced this pull request Aug 22, 2025

Enable trace through the collections module (pytorch#159365)

0d3c31d

Pull Request resolved: pytorch#159365 Approved by: https://github.com/zou3519

can-gaa-hou pushed a commit to can-gaa-hou/pytorch that referenced this pull request Aug 22, 2025

Fixes for collections.Counter (pytorch#159368)

f026f14

Pull Request resolved: pytorch#159368 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366

github-actions bot deleted the gh/guilhermeleobas/214/head branch September 15, 2025 02:15

markc-614 pushed a commit to markc-614/pytorch that referenced this pull request Sep 17, 2025

Enable trace through the collections module (pytorch#159365)

41501de

Pull Request resolved: pytorch#159365 Approved by: https://github.com/zou3519

markc-614 pushed a commit to markc-614/pytorch that referenced this pull request Sep 17, 2025

Fixes for collections.Counter (pytorch#159368)

5c70975

Pull Request resolved: pytorch#159368 Approved by: https://github.com/mlazos ghstack dependencies: pytorch#159365, pytorch#159366

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Enable trace through the collections module #159365

Enable trace through the collections module #159365

Uh oh!

guilhermeleobas commented Jul 29, 2025 •

edited

Loading

Uh oh!

pytorch-bot bot commented Jul 29, 2025 •

edited

Loading

Uh oh!

zou3519 Aug 13, 2025

Uh oh!

guilhermeleobas Aug 14, 2025

Uh oh!

zou3519 left a comment

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

Enable trace through the collections module #159365

Enable trace through the collections module #159365

Uh oh!

Conversation

guilhermeleobas commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Jul 29, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/159365

✅ You can merge normally! (1 Unrelated Failure)

Uh oh!

zou3519 Aug 13, 2025

Choose a reason for hiding this comment

Uh oh!

guilhermeleobas Aug 14, 2025

Choose a reason for hiding this comment

Uh oh!

zou3519 left a comment

Choose a reason for hiding this comment

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

pytorchmergebot commented Aug 15, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

guilhermeleobas commented Jul 29, 2025 •

edited

Loading

pytorch-bot bot commented Jul 29, 2025 •

edited

Loading