Code

Llm testing live run#778

Code

Merged

nv-braf merged 12 commits intoadd-llm-modetriton-inference-server/model_analyzer:add-llm-modefrom llm-testing-live-runtriton-inference-server/model_analyzer:llm-testing-live-runCopy head branch name to clipboardOct 19, 2023

+105-22

Commits

Commits on Oct 18, 2023

• Created a new class ConfigRangeNumeric and using it for periodic-concurrency

  nv-braf

  committed
  9cca38d

  Copy full SHA for 9cca38d

• Fixes and defaults for periodic concurrency

  nv-braf

  committed
  995eb73

  Copy full SHA for 995eb73

• First unit test passing

  nv-braf

  committed
  dbae59c

  Copy full SHA for dbae59c

• PACG chagnes complete. Unit tests updated and passing

  nv-braf

  committed
  cc777f1

  Copy full SHA for cc777f1

• Removing uneeded class

  nv-braf

  committed
  21c7b2c

  Copy full SHA for 21c7b2c

• Changes to fix live run

  nv-braf

  committed
  bca684c

  Copy full SHA for bca684c

• Minor refactor and cleanup

  nv-braf

  committed
  fdd4d58

  Copy full SHA for fdd4d58

• Removing json files

  nv-braf

  committed
  c99d507

  Copy full SHA for c99d507

• Changing to use f-string

  nv-braf

  committed
  d6e7c74

  Copy full SHA for d6e7c74

• More cleanup from hwoo CR

  nv-braf

  committed
  51aedfa

  Copy full SHA for 51aedfa

• Removing stale code for request period

  nv-braf

  committed
  b7cfeef

  Copy full SHA for b7cfeef

Commits on Oct 19, 2023

• Fix nit

  nv-braf

  committed
  f24ebbf

  Copy full SHA for f24ebbf