KEMBAR78
[BREAK CHANGE] SGLang, DeepGEMM, sgl-kernel upgrade · Issue #9710 · sgl-project/sglang · GitHub
Skip to content

[BREAK CHANGE] SGLang, DeepGEMM, sgl-kernel upgrade #9710

@zhyncs

Description

@zhyncs

After sgl-kernel 0.3.7, DeepGEMM's JIT has been changed to C++ JIT, and the DeepGEMM python interface has also been replaced with a new one, which is not compatible with previous versions.

  • on cu124/cu126/cu128 hopper
pip install sgl-kernel==0.3.7
  • on cu128 blackwell
pip3 install https://github.com/sgl-project/whl/releases/download/v0.3.7/sgl_kernel-0.3.7+cu128-cp310-abi3-manylinux2014_x86_64.whl --force-reinstall
  • on cu129 blackwell
pip3 install https://github.com/sgl-project/whl/releases/download/v0.3.7/sgl_kernel-0.3.7+cu129-cp310-abi3-manylinux2014_x86_64.whl --force-reinstall

Please use the latest SGLang after #9708

Metadata

Metadata

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions