{"slug":"tensorrt-llm","name":"TensorRT LLM","kind":"tool","deliveryMethods":["tool"],"kindLabel":"Tool","grade":"A","score":88,"tagline":"TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.","description":"TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in a performant way.","tags":["nvidia","inference-optimization","gpu","quantization","pytorch"],"url":"https://way.space/tool/tensorrt-llm","stars":"—","category":"coding","categories":["coding","inference"],"repo":"https://github.com/nvidia/tensorrt-llm","website":"https://nvidia.github.io/TensorRT-LLM","license":"Other","maintainers":[{"login":"nvidia","url":"https://github.com/nvidia","isMember":false,"verified":false},{"login":"tensorrt-cicd","url":"https://github.com/tensorrt-cicd","isMember":false,"verified":false},{"login":"trtllm-agent","url":"https://github.com/trtllm-agent","isMember":false,"verified":false},{"login":"xinhe-nv","url":"https://github.com/xinhe-nv","isMember":false,"verified":false}],"scoreWhy":[{"label":"Contributors & bus-factor","detail":"50 recent contributors","direction":"positive"},{"label":"Commit recency","detail":"last commit 0d ago","direction":"positive"},{"label":"Commit cadence","detail":"2321 commits in 90 days","direction":"positive"},{"label":"Issue close ratio","detail":"84% of issues closed","direction":"positive"},{"label":"Release cadence","detail":"48 releases in 12 months","direction":"positive"},{"label":"Stars (log-damped)","detail":"14,917 stars (log-damped)","direction":"positive"},{"label":"Star authenticity","detail":"star-velocity check unavailable — GitHub no longer publishes stargazer timestamps for this repo","direction":"neutral"},{"label":"Engagement-to-star ratio","detail":"healthy engagement (1.58 per star)","direction":"positive"}]}