-
Notifications
You must be signed in to change notification settings - Fork 3.1k
Closed
Description
After sgl-kernel 0.3.7, DeepGEMM's JIT has been changed to C++ JIT, and the DeepGEMM python interface has also been replaced with a new one, which is not compatible with previous versions.
- on cu124/cu126/cu128 hopper
pip install sgl-kernel==0.3.7
- on cu128 blackwell
pip3 install https://github.com/sgl-project/whl/releases/download/v0.3.7/sgl_kernel-0.3.7+cu128-cp310-abi3-manylinux2014_x86_64.whl --force-reinstall
- on cu129 blackwell
pip3 install https://github.com/sgl-project/whl/releases/download/v0.3.7/sgl_kernel-0.3.7+cu129-cp310-abi3-manylinux2014_x86_64.whl --force-reinstall
- on cu129 gb200
@ishandhanani
Please use the latest SGLang after #9708
ryang-max, zhyncs, Swipe4057 and seanmamasde