llm-serving

5 projects tagged llm-serving · ★ 165,813 combined

+0.29% +493 stars in 7d
  1. 1 vLLM AI ★ 90,095
  2. 2 Ray Data Science ★ 43,609
  3. 3 TensorRT-LLM AI ★ 14,479
  4. 4 bentoml Data Science ★ 8,824
  5. 5 BentoML AI ★ 8,806