KEMBAR78
Build magma for windows by afrittoli · Pull Request #139924 · pytorch/pytorch · GitHub
Skip to content

Conversation

@afrittoli
Copy link
Collaborator

@afrittoli afrittoli commented Nov 6, 2024

Copy the magma for windows job and script from pytorch/builder https://github.com/pytorch/builder/blob/c9aac65e12734a16d9c285c366bcbf6cc0c67e43/.github/workflows/build-magma-windows.yml

The linux version is moved here in #139888

Fixes #140001

@afrittoli afrittoli requested a review from a team as a code owner November 6, 2024 21:35
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 6, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/139924

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 0aac8a3 with merge base c1c94cb (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Nov 6, 2024
@afrittoli
Copy link
Collaborator Author

Will update this PR once #139888 is merged, to use the same upload script.

This is a first step towards removing builds dependency to conda.

Currently we build magma as a conda package in a pytorch conda channel,
implemented in https://github.com/pytorch/builder/tree/main/magma.

This commit adapts the logic from pytorch/builder as follows:
- use pytorch/manylinux-cuda<cuda-version> as base image
- apply patches and invoke the build.sh script directly
  (not anymore through conda build)
- stores license and build files along with the built artifact,
  in an info subfolder
- create a tarball file which resembles that created by conda,
  without any conda-specific metadata

A new matrix workflow is added, which runs the build for each
supported cuda version, and uploads the binaries to pyorch s3 bucket.

For the upload, define an upload.sh script, which will be used by
the magma windows job as well, to upload to s3://ossci-* buckets.

The build runs on PR and push, upload runs in DRY_RUN mode in case
of PR.

Signed-off-by: Andrea Frittoli <andrea.frittoli@uk.ibm.com>
Copy the magma for windows job and script from pytorch/builder
https://github.com/pytorch/builder/blob/c9aac65e12734a16d9c285c366bcbf6cc0c67e43/.github/workflows/build-magma-windows.yml

The linux version is moved here in pytorch#139888

Use the upload_aws_ossci.sh upload script used by the linux
magma builds as well.

Signed-off-by: Andrea Frittoli <andrea.frittoli@uk.ibm.com>
@colesbury colesbury added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Nov 8, 2024
Copy link
Contributor

@atalman atalman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@atalman
Copy link
Contributor

atalman commented Nov 8, 2024

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Nov 8, 2024
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

The merge job was canceled or timed out. This most often happen if two merge requests were issued for the same PR, or if merge job was waiting for more than 6 hours for tests to finish. In later case, please do not hesitate to reissue the merge command
For more information see pytorch-bot wiki.

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: Comment with id 2465845977 not found

Details for Dev Infra team Raised by workflow job

@afrittoli
Copy link
Collaborator Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged open source topic: not user facing topic category triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Move the magma the Windows builds as well to pytorch/pytorch

5 participants