[CD] Fix the libgomp twice load issue (#150084) #153518

chuanqi129 · 2025-05-14T05:35:46Z

Fixes #149422

pytorch-bot · 2025-05-14T05:35:50Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/153518

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 50 New Failures

As of commit c03a137 with merge base 924a247 ():

NEW FAILURES - The following jobs have failed:

linux-binary-manywheel / manywheel-py3_10-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_10-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_10-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_10-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_10-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_10-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_11-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_12-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_13t-xpu-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-cuda11_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-cuda12_6-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-cuda12_8-test / test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-rocm6_2_4-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-rocm6_3-test (gh)
Process completed with exit code 1.
linux-binary-manywheel / manywheel-py3_9-xpu-test (gh)
Process completed with exit code 1.
linux-s390x-binary-manywheel / manywheel-py3_10-cpu-s390x-build / build (gh)
Process completed with exit code 125.
linux-s390x-binary-manywheel / manywheel-py3_11-cpu-s390x-build / build (gh)
Process completed with exit code 125.
linux-s390x-binary-manywheel / manywheel-py3_12-cpu-s390x-build / build (gh)
Process completed with exit code 125.
linux-s390x-binary-manywheel / manywheel-py3_13-cpu-s390x-build / build (gh)
Process completed with exit code 125.
linux-s390x-binary-manywheel / manywheel-py3_9-cpu-s390x-build / build (gh)
Process completed with exit code 125.
pull / linux-focal-py3_9-clang9-xla / build (gh)
ninja: build stopped: subcommand failed
pull / linux-jammy-py3-clang12-executorch / build (gh)
Final attempt failed. Child_process exited with error code 1
windows-binary-wheel / wheel-py3_10-xpu-test (gh)
Process completed with exit code 1.
windows-binary-wheel / wheel-py3_11-cpu-build (gh)
C:\actions-runner\_work\pytorch\pytorch\pytorch\build\sleef\src\libm\dispavx.c(199): fatal error C1057: unexpected end of file in macro expansion
windows-binary-wheel / wheel-py3_11-xpu-test (gh)
Process completed with exit code 1.
windows-binary-wheel / wheel-py3_12-xpu-test (gh)
Process completed with exit code 1.
windows-binary-wheel / wheel-py3_13-xpu-test (gh)
Process completed with exit code 1.
windows-binary-wheel / wheel-py3_13t-xpu-test (gh)
Process completed with exit code 1.
windows-binary-wheel / wheel-py3_9-xpu-test (gh)
Process completed with exit code 1.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

atalman · 2025-05-15T15:22:15Z

@pytorchmergebot rebase -b release/2.7

pytorchmergebot · 2025-05-15T15:23:56Z

@pytorchbot started a rebase job onto refs/remotes/origin/release/2.7. Check the current status here

Fixes pytorch#149422 Pull Request resolved: pytorch#150084 Approved by: https://github.com/malfet, https://github.com/leslie-fang-intel, https://github.com/atalman Co-authored-by: LifengWang <lifeng.a.wang@intel.com>

pytorchmergebot · 2025-05-15T15:24:00Z

Successfully rebased cd_fix_gomp_2.7 onto refs/remotes/origin/release/2.7, please pull locally before adding more changes (for example, via git checkout cd_fix_gomp_2.7 && git pull --rebase)

atalman

lgtm

atalman · 2025-06-04T15:23:10Z

Validated with 2.7.0 vs 2.7.1:

Almalinux Release 2.7.0

omp_max_threads after loading libgomp.so and libtorch_cpu.so: 1
Traceback (most recent call last):
  File "/pytorch/.ci/pytorch/smoke_test/check_gomp.py", line 74, in <module>
    main()
  File "/pytorch/.ci/pytorch/smoke_test/check_gomp.py", line 68, in main
    raise RuntimeError(
RuntimeError: omp_max_threads is 1. Check whether libgomp.so is loaded twice.

Almalinux Release 2.7.1

python check_gomp.py 
omp_max_threads after loading libgomp.so and libtorch_cpu.so: 16

chuanqi129 requested a review from a team as a code owner May 14, 2025 05:35

pytorch-bot bot added the release notes: releng release notes category label May 14, 2025

chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 14, 2025

chuanqi129 mentioned this pull request May 14, 2025

[v2.7.1] Release Tracker #152627

Closed

pytorchbot added the open source label May 14, 2025

chuanqi129 requested review from atalman, leslie-fang-intel and malfet May 14, 2025 09:15

leslie-fang-intel approved these changes May 14, 2025

View reviewed changes

chuanqi129 force-pushed the cd_fix_gomp_2.7 branch from 44b97b2 to ef59995 Compare May 14, 2025 21:44

pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 14, 2025

chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 14, 2025

chuanqi129 force-pushed the cd_fix_gomp_2.7 branch from ef59995 to 932be30 Compare May 15, 2025 10:20

pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 15, 2025

chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 15, 2025

[CD] Fix the libgomp twice load issue (pytorch#150084)

c03a137

Fixes pytorch#149422 Pull Request resolved: pytorch#150084 Approved by: https://github.com/malfet, https://github.com/leslie-fang-intel, https://github.com/atalman Co-authored-by: LifengWang <lifeng.a.wang@intel.com>

pytorchmergebot force-pushed the cd_fix_gomp_2.7 branch from 932be30 to c03a137 Compare May 15, 2025 15:24

pytorch-bot bot removed the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 15, 2025

chuanqi129 added the ciflow/binaries_wheel Trigger binary build and upload jobs for wheel on the PR label May 16, 2025

atalman approved these changes May 20, 2025

View reviewed changes

atalman merged commit 70518b7 into pytorch:release/2.7 May 20, 2025
436 of 488 checks passed

atalman mentioned this pull request May 28, 2025

Release 2.7.1 validations checklist and cherry-picks #154512

Closed

49 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[CD] Fix the libgomp twice load issue (#150084) #153518

[CD] Fix the libgomp twice load issue (#150084) #153518

Uh oh!

chuanqi129 commented May 14, 2025

Uh oh!

pytorch-bot bot commented May 14, 2025 •

edited

Loading

Uh oh!

atalman commented May 15, 2025

Uh oh!

pytorchmergebot commented May 15, 2025

Uh oh!

pytorchmergebot commented May 15, 2025

Uh oh!

atalman left a comment

Uh oh!

Uh oh!

atalman commented Jun 4, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

[CD] Fix the libgomp twice load issue (#150084) #153518

[CD] Fix the libgomp twice load issue (#150084) #153518

Uh oh!

Conversation

chuanqi129 commented May 14, 2025

Uh oh!

pytorch-bot bot commented May 14, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/153518

❌ 50 New Failures

Uh oh!

atalman commented May 15, 2025

Uh oh!

pytorchmergebot commented May 15, 2025

Uh oh!

pytorchmergebot commented May 15, 2025

Uh oh!

atalman left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

atalman commented Jun 4, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

pytorch-bot bot commented May 14, 2025 •

edited

Loading