Pinned Loading

1. NVIDIA/TensorRT NVIDIA/TensorRT Public

   NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

   C++ 11k 2.1k

2. tensorrt-insight tensorrt-insight Public

   Deep insight tensorrt, including but not limited to qat, ptq, plugin, triton_inference, cuda

   C++ 14

3. xinfer xinfer Public

   AI infer engine

   C++ 6

4. llm-deploy llm-deploy Public

   AI Infra LLM infer/ tensorrt-llm/ vllm

   Python 11

5. ocr ocr Public

   OCR related, characters detection, character classification

   C++