Code

GenAI-Perf goodput support#772

Code

Closed

AndyDai-nv wants to merge 9 commits intomaintriton-inference-server/client:mainfrom andy-goodput-devtriton-inference-server/client:andy-goodput-devCopy head branch name to clipboard

+194-4

Commits

Commits on Jul 30, 2024

• PoC Goodput Support in GenAI-Perf

  AndyDai-nv

  committed
  0406750

Commits on Aug 1, 2024

• Goodput support PoC

  AndyDai-nv

  committed
  542b3d0

• Clean up PoC

  AndyDai-nv

  committed
  a122356

• [Clean up] remove duplicate methods

  AndyDai-nv

  committed
  1ede234

Commits on Aug 2, 2024

• PoC Goodput: Changed to another design

  AndyDai-nv

  committed
  b58fd8a

Commits on Aug 6, 2024

• Re-implementation after design review

  AndyDai-nv

  committed
  a991d1f

• Line-length clean up

  AndyDai-nv

  committed
  803dc18

• fix line length

  AndyDai-nv

  committed
  b1d0de3

• Change doc accordingly

  AndyDai-nv

  committed
  cffbfd5