TensorRT-LLM

NVIDIA's toolbox for optimized large language model inference

7d +0.42% +61 stars in 7d
30d Not tracked yet — first tracked 2026-08-14
90d Not tracked yet — first tracked 2026-08-14

14,380 → 14,484 stars since Aug 14

blackwellcudallm-servingmoepytorch