aibrix

Popular repositories Loading

1. PrisKV PrisKV Public

   High Performance KV Cache Store for LLM

   C 59 8

2. ai-accelerator-tool ai-accelerator-tool Public

   Go 13 2

3. vllm vllm Public

   复刻ed from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 3 4

4. community community Public

   3 2

5. aibrix.github.io aibrix.github.io Public

   aibrix static site

   JavaScript 2 4

6. v6d v6d Public

   复刻ed from v6d-io/v6d

   vineyard (v6d): an in-memory immutable data manager. (Project under CNCF, TAG-Storage)

   C++ 1