Nanbeige LLM Lab

Popular repositories Loading

1. Depth-Hybrid-Attention Depth-Hybrid-Attention Public

   Python 25 6

2. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   LLM inference in C/C++

   C++ 15 5

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 1 2

4. ollama ollama Public

   Forked from ollama/ollama

   Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.

   Go 1

5. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 1