Skip to content

Issues: triton-inference-server/client

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

34 Open 13 Closed
34 Open 13 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Read back data written in cuda shared memory in python
#816 opened Dec 16, 2024 by MaximeDebarbat
Performance Discrepancy Between Triton Client SDK and perf_analyzer
#815 opened Dec 10, 2024 by wensimin
1
InferenceServerHttpClient::Create() failed with error: std::bad_alloc
#806 opened Nov 13, 2024 by megadl
Incorrect grpcio version Python client
#804 opened Nov 8, 2024 by tigersoldier
[GRPC_CLIENT] LoadModel with serialized model raise an error: "Poll failed for model directory" on native windows triton.
#803 opened Nov 6, 2024 by FilipLeja
The dependency information of the Python package needs to be updated
#796 opened Oct 16, 2024 by penguin-wwy
[Question] numpy 2 support
#792 opened Oct 10, 2024 by m3at
1
Potential memory leak
#791 opened Oct 8, 2024 by prasannagn16
2
Tritonclient CUDA shared memory set_shared_memory_region_from_dlpack fails with non-set stream for Torch tensor.
#789 opened Oct 5, 2024 by piotrm-nvidia
genai-perf exception offline-mode
#785 opened Sep 24, 2024 by sochiseung
原始是byte[]的数据，没法传。会报triton.client.InferenceException: [request id: <id_unknown>] inference input data-type is 'INT8', model expects 'BYTES' for 'xxxxx'
#784 opened Sep 24, 2024 by freeleeq
1
Re-use client or create new one each time?
#783 opened Sep 19, 2024 by datdo-msft
KV-cache of Tensorrt_llm
#782 opened Sep 16, 2024 by huynguyen-bku
Use try-with-resources for InferenceServerClient to handle resource management and potential TimeoutException
#780 opened Sep 7, 2024 by 1ComputerMaster
tensorrtllm and vllm backend results are different using genai-perf
#779 opened Sep 5, 2024 by upskyy
1
Unexpected Behavior: ModelInferRequest Fields Overwritten with Incorrect Values in Triton C++ Client
#778 opened Sep 5, 2024 by fighterhit
Failing with Generic Error message: Failed to obtain stable measurement.
#777 opened Aug 20, 2024 by Kanupriyagoyal
@ganeshku1
11
Allow client to request subset of ensemble model outputs
#763 opened Jul 24, 2024 by Vincouux
1
Decreased Accuracy in Text Detection and Recognition Models after Upgrading to tritonclient 23.04-py3
#738 opened Jul 8, 2024 by ashlinghosh
Benchmarking VQA Model with Large Base64-Encoded Input Using perf_analyzer question Further information is requested
#736 opened Jul 5, 2024 by pigeonsoup
2
Memory leak from grpcio
#731 opened Jul 2, 2024 by AlexanderKomarov
1
Bug in grpc client
#726 opened Jun 28, 2024 by gerasim13
How to write cmakelist to use grpcclient?
#714 opened Jun 26, 2024 by lyp741
[QUESTION] - Tensorflow python infer to triton client
#711 opened Jun 20, 2024 by eyalhir74
tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] Unable to open shared memory region: '/output_simple'
#710 opened Jun 19, 2024 by CodeDuoGun
ProTip! no:milestone will show everything without a milestone.