triton gpu deploy suddenly become very slow from 0.03s to 12s, how to solve it ?

[yiluzhuimeng]

Description
A clear and concise description of what the bug is.

Triton Information
What version of Triton are you using?

Are you using the Triton container or did you build it yourself?

To Reproduce
Steps to reproduce the behavior.

Describe the models (framework, inputs, outputs), ideally include the model configuration file (if using an ensemble include the model configuration file for that as well).

Expected behavior
A clear and concise description of what you expected to happen.

[oandreeva-nv]

Hi @yiluzhuimeng , Could you please feel out the question template, this will help us tremendously in assisting you with the issue