This repo just for personal convert and deploy tensorrt models.
Mainly based on grpc and async_lib for deploy.
grpc: used for communication
async_lib: high performance lock free and multi threaded library for schedule and run work in graph mode
This repo just for personal convert and deploy tensorrt models.
Mainly based on grpc and async_lib for deploy.
grpc: used for communication
async_lib: high performance lock free and multi threaded library for schedule and run work in graph mode