KEMBAR78
Refactor conda-builder -> almalinux-builder by atalman · Pull Request #140157 · pytorch/pytorch · GitHub
Skip to content

Conversation

@atalman
Copy link
Contributor

@atalman atalman commented Nov 8, 2024

This changes the conda-builder workflow to almalinux-builder and switches Docker file to almalinux.
Please note: Published conda-builder images will still be available, hence workflows that use these images will still work.
We will be switching workflows that use conda-builder images to almalinux-builder

@atalman atalman requested review from a team and jeffdaily as code owners November 8, 2024 17:42
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 8, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/140157

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 464cb0d with merge base 8d61add (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Nov 8, 2024
Copy link
Contributor

@malfet malfet left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Shouldn't base image be an argument then? So that we can still build old ones, if needed as well as new oens?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, wow, I see, you did git cp, was a bit confused by the pattern

test

test

test

test

test

tets

test

test

test

fix

test

test

test

test

fix

test
@atalman atalman force-pushed the refactor_conda_builder_image branch from b0e5cfb to 464cb0d Compare November 9, 2024 05:20
@atalman
Copy link
Contributor Author

atalman commented Nov 9, 2024

@pytorchmergebot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Nov 9, 2024
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

atalman added a commit to pytorch/test-infra that referenced this pull request Nov 12, 2024
Use image build by: pytorch/pytorch#140157
This should support both Manylinux 2.28 wheels and old glibc 2.26
wheels. Tested by pulling Docker images and running some test.

Test:
```
docker pull pytorch/almalinux-builder:cpu-main
```

Test Wheel build with Manylinux 2.28:
```
>>> import torch
>>> from torch._C import *
>>> torch.__version__
'2.6.0.dev20241106+cpu'
```

Test Wheel build with manylinux-builder:
```
>>> import torch
>>> torch.__version__
'2.5.1+cu124'
>>> from torch._C import *
```

Example of Glibc failure with wheels from 2024.11.06:
https://github.com/pytorch/tensordict/actions/runs/11708894033/job/32611711890#step:12:734
pytorchmergebot pushed a commit that referenced this pull request Nov 12, 2024
Something that was accidentally dropped by: #140157
Needs to be re-added. I believe its part of our Docker images. Please see: https://github.com/pytorch/pytorch/blob/main/.ci/docker/manywheel/Dockerfile#L21

Pull Request resolved: #140454
Approved by: https://github.com/seemethere, https://github.com/malfet
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
This changes the conda-builder workflow to almalinux-builder and switches Docker file to almalinux.
Please note: Published conda-builder images will still be available, hence workflows that use these images will still work.
We will be switching workflows that use conda-builder images to almalinux-builder

Pull Request resolved: pytorch#140157
Approved by: https://github.com/malfet
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
Something that was accidentally dropped by: pytorch#140157
Needs to be re-added. I believe its part of our Docker images. Please see: https://github.com/pytorch/pytorch/blob/main/.ci/docker/manywheel/Dockerfile#L21

Pull Request resolved: pytorch#140454
Approved by: https://github.com/seemethere, https://github.com/malfet
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants