KEMBAR78
Upgrade ROCm wheels to manylinux2_28 - 2 of 2 (binaries) by jithunnair-amd · Pull Request #141423 · pytorch/pytorch · GitHub
Skip to content

Conversation

@jithunnair-amd
Copy link
Collaborator

@jithunnair-amd jithunnair-amd commented Nov 23, 2024

Depends on #140681 and #141609

Highlights:

  • Upgrade binaries to ROCm6.2.4 to use latest docker images
  • Remove pre-cxx11 builds for libtorch on ROCm
  • Use manylinux2_28 docker images for ROCm
  • Set DESIRED_DEVTOOLSET=cxx-abi (and hence _GLIBCXX_USE_CXX11_ABI=1) for ROCm manylinux2_28 wheels (ROCm RHEL8 packages also have GCC_ABI=1, so it keeps it consistent)

cc @jeffdaily @sunway513 @pruthvistony @ROCmSupport @dllehr-amd @jataylo @hongxiayang @naromero77amd

@pytorch-bot
Copy link

pytorch-bot bot commented Nov 23, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/141423

Note: Links to docs will display an error until the docs builds have been completed.

❌ 3 Cancelled Jobs

As of commit 19b6416 with merge base 6afcec0 (image):

CANCELLED JOBS - The following jobs were cancelled. Please retry:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added ciflow/rocm Trigger "default" config CI on ROCm module: rocm AMD GPU support for Pytorch topic: not user facing topic category labels Nov 23, 2024
@jithunnair-amd
Copy link
Collaborator Author

@pytorchbot rebase

@pytorchmergebot
Copy link
Collaborator

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

@pytorchmergebot
Copy link
Collaborator

Successfully rebased jnair/rocm_manylinux2_28_upgrade_binaries onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout jnair/rocm_manylinux2_28_upgrade_binaries && git pull --rebase)

@pytorchmergebot pytorchmergebot force-pushed the jnair/rocm_manylinux2_28_upgrade_binaries branch from 508c4ad to 24e1600 Compare November 26, 2024 02:14
@jithunnair-amd jithunnair-amd added the ciflow/binaries Trigger all binary build and upload jobs on the PR label Nov 26, 2024
@jeffdaily jeffdaily added ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR and removed ciflow/binaries Trigger all binary build and upload jobs on the PR labels Nov 26, 2024
@jeffdaily jeffdaily marked this pull request as ready for review December 2, 2024 21:32
@jeffdaily jeffdaily requested a review from a team as a code owner December 2, 2024 21:32
@jithunnair-amd jithunnair-amd force-pushed the jnair/rocm_manylinux2_28_upgrade_binaries branch from d9e30bc to f887db3 Compare December 3, 2024 20:46
@jithunnair-amd jithunnair-amd force-pushed the jnair/rocm_manylinux2_28_upgrade_binaries branch from f887db3 to 15fd5d7 Compare December 3, 2024 20:48
@jithunnair-amd jithunnair-amd force-pushed the jnair/rocm_manylinux2_28_upgrade_binaries branch from 4cb5762 to 19b6416 Compare December 4, 2024 01:05
@jithunnair-amd
Copy link
Collaborator Author

jithunnair-amd commented Dec 4, 2024

Build Triton wheels and binary manywheel jobs (including smoke tests) passed for ROCm. Merging

@jithunnair-amd
Copy link
Collaborator Author

@pytorchbot merge -f "ROCm CI jobs passed. Unrelated CI failures"

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
…er images) (pytorch#141609)

Upgrade gcc version from 9 to 11 on ROCm manylinux images.

Needed for pytorch#141423 since almalinux8-based manylinux2_28 images for ROCm (pytorch#140681) installs gcc-toolset-9, which installs [gcc 9.2.1](https://pkgs.org/download/gcc-toolset-9-gcc-c++). However, PyTorch CMakeLists.txt enforces a [minimum gcc version of 9.3](https://github.com/pytorch/pytorch/blob/5318bf8baf19fecda365c185cd81196e3cfb08e3/CMakeLists.txt#L61).

Pull Request resolved: pytorch#141609
Approved by: https://github.com/jeffdaily

Co-authored-by: Jithun Nair <jithun.nair@amd.com>
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
)

Depends on pytorch#140681 and pytorch#141609

Highlights:
* Upgrade binaries to ROCm6.2.4 to use latest docker images
* Remove pre-cxx11 builds for libtorch on ROCm
* Use manylinux2_28 docker images for ROCm
* Set `DESIRED_DEVTOOLSET=cxx-abi` (and hence `_GLIBCXX_USE_CXX11_ABI=1`) for ROCm manylinux2_28 wheels (ROCm RHEL8 packages also have GCC_ABI=1, so it keeps it consistent)

Pull Request resolved: pytorch#141423
Approved by: https://github.com/jeffdaily

Co-authored-by: Jeff Daily <jeff.daily@amd.com>
Co-authored-by: Pruthvi Madugundu <pruthvigithub@gmail.com>
AmdSampsa pushed a commit to AmdSampsa/pytorch that referenced this pull request Dec 9, 2024
)

Depends on pytorch#140681 and pytorch#141609

Highlights:
* Upgrade binaries to ROCm6.2.4 to use latest docker images
* Remove pre-cxx11 builds for libtorch on ROCm
* Use manylinux2_28 docker images for ROCm
* Set `DESIRED_DEVTOOLSET=cxx-abi` (and hence `_GLIBCXX_USE_CXX11_ABI=1`) for ROCm manylinux2_28 wheels (ROCm RHEL8 packages also have GCC_ABI=1, so it keeps it consistent)

Pull Request resolved: pytorch#141423
Approved by: https://github.com/jeffdaily

Co-authored-by: Jeff Daily <jeff.daily@amd.com>
Co-authored-by: Pruthvi Madugundu <pruthvigithub@gmail.com>
atalman added a commit to pytorch/test-infra that referenced this pull request Dec 23, 2024
Forward fix for #6099 which
removed pre-cxx-abi config for everything. Instead we skip generating it

Rocm builds pre-cxx11 removed by:
pytorch/pytorch#141423
atalman added a commit to pytorch/test-infra that referenced this pull request Jan 22, 2025
Forward fix for #6099 which
removed pre-cxx-abi config for everything. Instead we skip generating it

Rocm builds pre-cxx11 removed by:
pytorch/pytorch#141423
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR ciflow/rocm Trigger "default" config CI on ROCm Merged module: rocm AMD GPU support for Pytorch open source topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants