Pinned Loading

1. NVIDIA/TensorRT-LLM NVIDIA/TensorRT-LLM Public

   TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

   C++ 8.9k 1k

2. triton-inference-server/tensorrtllm_backend triton-inference-server/tensorrtllm_backend Public

   The Triton TensorRT-LLM Backend

   Python 724 109

3. CTC-decoder CTC-decoder Public

   A cpp reimplementation for CTC decoder

   C++ 5

4. ICDAR2COCO ICDAR2COCO Public

   A tool for the conversion from ICDAR to COCO dataset.

   Python 9