I think this should go into 2.7.1. This was the reason that sglang had torch.compile caching issues and the fix is very simple.

cc @chauhang @penguinwu @ydwu4 @bdhirsh