Describe the bug

This should be an old issue, but it appears again in version 0.35.0, maybe also in 0.35.1.
Maybe need to protect the import again if PyTorch 2.3.1 is still in the supporting list?

Reproduction

from diffusers import AutoencoderKL

import AutoencoderKL will lead to : AutoAttributeError: module 'torch.library' has no attribute 'custom_op'

Logs

System Info

Diffusers: 0.35.0
PyTorch: 2.3.1

Who can help?

No response