-
Notifications
You must be signed in to change notification settings - Fork 25.7k
Open
Labels
module: xpuIntel XPU related issuesIntel XPU related issuestriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Description
As of 21d4c48, the following aten ops are not implemented by XPU backend which are required by https://github.com/dvrogozh/optimum-quanto:
-
__lshift__.Scalar, Add aten::lshift/rshift/prelu and thieir variants intel/torch-xpu-ops#688 -
aten::_weight_int8pack_mm(requiresPYTORCH_ENABLE_XPU_FALLBACK=1) -
aten::_int_mm(requiresPYTORCH_ENABLE_XPU_FALLBACK=1) -
aten::_convert_weight_to_int4pack(requiresPYTORCH_ENABLE_XPU_FALLBACK=1), Add aten::_convert_weight_to_int4pack intel/torch-xpu-ops#1035
Support for XPU backend in quanto can be tried applying the following PRs:
- xpu: support sycl with torch.utils.cpp_extension APIs #132945
- feat: implement unpack sycl kernels with xpu extension huggingface/optimum-quanto#273
Metadata
Metadata
Assignees
Labels
module: xpuIntel XPU related issuesIntel XPU related issuestriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate moduleThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Type
Projects
Status
In Progress