awesomemap
Rising
Tags
Home
›
AI
›
LLM Infrastructure
›
LLM Frameworks & Runtimes
TensorRT-LLM
NVIDIA's toolbox for optimized large language model inference
7d
+0.42%
+61 stars in 7d
30d
Not tracked yet — first tracked 2026-08-14
90d
Not tracked yet — first tracked 2026-08-14
14,380 → 14,484 stars since Aug 14
★ 14,479 stars on GitHub
Visit site ↗
blackwell
cuda
llm-serving
moe
pytorch