inference

13 projects tagged inference · ★ 383,167 combined

+0.22% +850 stars in 7d
  1. 1 vLLM AI ★ 90,095
  2. 2 yolov5 Data Science ★ 57,953
  3. 3 whisper.cpp AI ★ 53,231
  4. 4 DeepSpeed Data Science ★ 42,999
  5. 5 ColossalAI Data Science ★ 41,448
  6. 6 mediapipe Data Science ★ 36,803
  7. 7 nano-vllm Data Science ★ 15,258
  8. 8 Triton Inference Server AI ★ 10,936
  9. 9 Text Generation Inference AI ★ 10,888
  10. 10 runanywhere-sdks Mobile Dev ★ 10,282
  11. 11 jetson-inference IoT & Smart Home ★ 8,977
  12. 12 Rapid-MLX AI ★ 3,645
  13. 13 libonnx Data Science ★ 652