Benefits of the C API compared to the HTTP / GRPC protocols ? #6032
Answered
by
nnshah1
MatthieuToulemont
asked this question in
Q&A
-
|
Hello, While reading the documentation I stumbled upon the C API, is there any performance benefits in using it over the HTTP/GRPC protocols ? Best, |
Beta Was this translation helpful? Give feedback.
Answered by
nnshah1
Jul 7, 2023
Replies: 1 comment
-
|
Yes - with the C API you can essentially embed Triton within your application and remove any overhead from the HTTP / GRPC protocols. In essence you create your own Triton based serving application. The HTTP / GRPC server components of Triton also use the C API internally. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
dyastremsky
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes - with the C API you can essentially embed Triton within your application and remove any overhead from the HTTP / GRPC protocols. In essence you create your own Triton based serving application. The HTTP / GRPC server components of Triton also use the C API internally.