sgl-project/sglang

SGLang is a Python-based serving framework that enables fast inference for large language and multimodal models. The GitHub repository, launched 8 January 2024, shows installation steps and benchmarks indicating low latency, though independent reproduction is not provided. It offers a ready‑to‑use API for developers building LLM services.