-
Notifications
You must be signed in to change notification settings - Fork 25.7k
[EZ] Do not checkout builder for Linux builds #142282
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/142282
Note: Links to docs will display an error until the docs builds have been completed. ❗ 1 Active SEVsThere are 1 currently active SEVs. If your PR is affected, please view them below: ❌ 38 New FailuresAs of commit 4898673 with merge base 6e203ae ( NEW FAILURES - The following jobs have failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
|
@malfet Please rebase and also bring, check_binary.sh https://github.com/pytorch/pytorch/blob/main/.circleci/scripts/binary_linux_test.sh#L93 Probably good place is here: https://github.com/pytorch/pytorch/tree/main/.ci/pytorch |
It's not used from build step, and I plan to keep test as is for now |
|
@malfet builder is still used in test step. Why not eliminate dependency on builder completely ? I see we are still getting builder here: https://github.com/pytorch/pytorch/actions/runs/12240753927/job/34146607849?pr=142282#step:11:40 |
Yes, this is expected, I can do it in the followup PRs, this PR is specifically about |
|
@pytorchbot merge -f "Lint wheel builds are green" |
Merge startedYour change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
|
This broke rocm nightly builds. |
|
I believe this should take care of rocm breakage due to missing check_binary.sh script: #142482 |
Fixes #142485 The workflow check lint job timed out in trunk, i.e. https://github.com/pytorch/pytorch/actions/runs/12261226178/job/34207762939, and here was what happened: 1. #142294 landed yesterday to build ROCm on 3.13, but the PR had a landrace with #142282 in the generated workflow file 2. The trunk lint check caught that in https://github.com/pytorch/pytorch/blob/main/.github/scripts/report_git_status.sh#L2 3. However, the script also attempted to print the difference with `git diff .github/workflows`. This command was the one that stuck because `git diff` uses page by default and requires a prompt to display the next page ¯\_(ツ)_/¯ It took so long to debug this because a timeout Nova GHA doesn't print any progress. I'll create an issue for this. Bonus: I also fix the broken print from test tool lint job that confuses GitHub https://github.com/pytorch/pytorch/actions/runs/12261226178 with an annotation failure `Credentials could not be loaded, please check your action inputs` Pull Request resolved: #142476 Approved by: https://github.com/wdvr
All logic should have been migrated to .ci/manywheel folder from builder repo a while back Pull Request resolved: pytorch#142282 Approved by: https://github.com/atalman ghstack dependencies: pytorch#142276, pytorch#142277, pytorch#142382
Fixes pytorch#142485 The workflow check lint job timed out in trunk, i.e. https://github.com/pytorch/pytorch/actions/runs/12261226178/job/34207762939, and here was what happened: 1. pytorch#142294 landed yesterday to build ROCm on 3.13, but the PR had a landrace with pytorch#142282 in the generated workflow file 2. The trunk lint check caught that in https://github.com/pytorch/pytorch/blob/main/.github/scripts/report_git_status.sh#L2 3. However, the script also attempted to print the difference with `git diff .github/workflows`. This command was the one that stuck because `git diff` uses page by default and requires a prompt to display the next page ¯\_(ツ)_/¯ It took so long to debug this because a timeout Nova GHA doesn't print any progress. I'll create an issue for this. Bonus: I also fix the broken print from test tool lint job that confuses GitHub https://github.com/pytorch/pytorch/actions/runs/12261226178 with an annotation failure `Credentials could not be loaded, please check your action inputs` Pull Request resolved: pytorch#142476 Approved by: https://github.com/wdvr
Follow Up after: #142282 Remove Checkout pytorch/builder for Linux Binary Builds I believe we where not using builder already. Hence remove this checkout. We should be using scripts from this folder: ``` /pytorch/.ci/${{ inputs.PACKAGE_TYPE }}/build.sh ``` TODO: Will followup with removing BUILDER_ROOT everywhere from PyTorch repo Pull Request resolved: #143125 Approved by: https://github.com/kit1980
…43131) Follow Up after: #142282 Remove Checkout pytorch/builder for Linux Binary Builds I believe we where not using builder already. Hence remove this checkout. We should be using scripts from this folder: ``` /pytorch/.ci/${{ inputs.PACKAGE_TYPE }}/build.sh ``` TODO: Will followup with removing BUILDER_ROOT everywhere from PyTorch repo Pull Request resolved: #143125 Approved by: https://github.com/kit1980 Co-authored-by: atalman <atalman@fb.com>
All logic should have been migrated to .ci/manywheel folder from builder repo a while back Pull Request resolved: pytorch#142282 Approved by: https://github.com/atalman ghstack dependencies: pytorch#142276, pytorch#142277, pytorch#142382
Fixes pytorch#142485 The workflow check lint job timed out in trunk, i.e. https://github.com/pytorch/pytorch/actions/runs/12261226178/job/34207762939, and here was what happened: 1. pytorch#142294 landed yesterday to build ROCm on 3.13, but the PR had a landrace with pytorch#142282 in the generated workflow file 2. The trunk lint check caught that in https://github.com/pytorch/pytorch/blob/main/.github/scripts/report_git_status.sh#L2 3. However, the script also attempted to print the difference with `git diff .github/workflows`. This command was the one that stuck because `git diff` uses page by default and requires a prompt to display the next page ¯\_(ツ)_/¯ It took so long to debug this because a timeout Nova GHA doesn't print any progress. I'll create an issue for this. Bonus: I also fix the broken print from test tool lint job that confuses GitHub https://github.com/pytorch/pytorch/actions/runs/12261226178 with an annotation failure `Credentials could not be loaded, please check your action inputs` Pull Request resolved: pytorch#142476 Approved by: https://github.com/wdvr
Follow Up after: pytorch#142282 Remove Checkout pytorch/builder for Linux Binary Builds I believe we where not using builder already. Hence remove this checkout. We should be using scripts from this folder: ``` /pytorch/.ci/${{ inputs.PACKAGE_TYPE }}/build.sh ``` TODO: Will followup with removing BUILDER_ROOT everywhere from PyTorch repo Pull Request resolved: pytorch#143125 Approved by: https://github.com/kit1980
Stack from ghstack (oldest at bottom):
binary_macos_test.sh#142382All logic should have been migrated to .ci/manywheel folder from builder repo a while back