Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Linux Wheel builds for Manylinux1. Use alternative to actions, checkout, upload #5941

Merged
merged 10 commits into from
Nov 21, 2024

Conversation

atalman
Copy link
Contributor

@atalman atalman commented Nov 19, 2024

This skip usage of for Manylinux1 images:
actions/checkout@v4
actions/download-artifact@v3
actions/upload-artifact@v3

Uses https://github.com/atalman/checkout-action which does not use nodejs to checkout.

This does not require full rewrite of the Build Linux Wheels at this point and will allow us to use Build Linux Wheels for both Manylinx 2.28 and Manylinx1 images. This should not disrupt any of the existing Domains, since workflow will be exactly the same. Basically instead of complete rewrite, we rewrite only part that failing in Github actions.

Test Workflow: https://github.com/pytorch/test-infra/actions/runs/11937438064/job/33273483586?pr=5941
Please note Linux jobs are using Manylinux2_28 while Rocm are using Manylinux1

This should also fix the SEV, since it bring back the support for both platforms: pytorch/pytorch#140631

Copy link

vercel bot commented Nov 19, 2024

@atalman is attempting to deploy a commit to the Meta Open Source Team on Vercel.

A member of the Team first needs to authorize it.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 19, 2024
@atalman atalman changed the title Try alternative to checkout Try alternative to checkout action Nov 19, 2024
@atalman atalman changed the title Try alternative to checkout action Linux Wheel builds. Use alternative to checkout action Nov 19, 2024
test

test

test

test

test

test

test

test

fix

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

test

fix

test
@@ -185,10 +194,12 @@ jobs:
repository: ${{ inputs.repository }}
ref: ${{ inputs.ref }}
submodules: ${{ inputs.submodules }}
setup-miniconda: ${{ inputs.setup-miniconda }}
setup-miniconda: false
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is not really required miniconda is already installed on these images now. However may need to use Install Miniforge step here for Linux as well in future

@atalman atalman changed the title Linux Wheel builds. Use alternative to checkout action Linux Wheel builds. Use alternative to actions, checkout, upload Nov 20, 2024
@atalman atalman changed the title Linux Wheel builds. Use alternative to actions, checkout, upload Linux Wheel builds for Manylinux1. Use alternative to actions, checkout, upload Nov 20, 2024
@atalman
Copy link
Contributor Author

atalman commented Nov 20, 2024

Test Workflow with Vision: https://github.com/pytorch/test-infra/actions/runs/11939993337/job/33281723865?pr=5949
Test PR: #5949
Please note 12.6 failures are expected.

with:
repository: ${{ inputs.repository }}
ref: ${{ inputs.ref }}
submodules: ${{ inputs.submodules }}
path: ${{ inputs.repository }}

- uses: atalman/checkout-action@main
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets keep both actions/checkout@v4 and atalman/checkout-action@main. I believe this action is run on Windows and MacOS. I see no reason to debug this on these OS's

@atalman atalman requested a review from malfet November 20, 2024 22:01
@atalman
Copy link
Contributor Author

atalman commented Nov 20, 2024

Please note moving https://github.com/atalman/checkout-action to script can be posted as BE followup PR. Advantage of the action is that it supports multiple Linux flavors: https://github.com/atalman/checkout-action/blob/main/main.sh#L81 . I am seeing this as temporary change to get us thru migration and 2.6/2.6.1 release

@atalman atalman merged commit 7b1ffef into pytorch:main Nov 21, 2024
50 of 56 checks passed
@atalman atalman deleted the modify_linux_wheels branch November 21, 2024 20:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants