awesomemap
Rising Tags GitHub stars

inference

4 projects tagged inference · ★ 154,918 combined

+0.41% +630 stars in 7d
  1. 1 vLLM AI ★ 90,095
  2. 2 DeepSpeed AI ★ 42,999
  3. 3 Triton Inference Server AI ★ 10,936
  4. 4 Text Generation Inference AI ★ 10,888