Code

Add MVP LLM support to MA#783

Code

Merged

nv-braf merged 12 commits intomaintriton-inference-server/model_analyzer:mainfrom add-llm-modetriton-inference-server/model_analyzer:add-llm-modeCopy head branch name to clipboardNov 3, 2023

+1,828-462

Commits

Commits on Oct 3, 2023

• Adding new options for LLM (#768)

  Show description for c9d467f
  

  nv-braf

  and

  mc-nv

  authored
  c9d467f

Commits on Oct 12, 2023

• Add LLM support to Brute Search (#769)

  Show description for 1b7aee0
  

  nv-braf

  and

  nv-hwoo

  authored
  1b7aee0

• New LLM record types (#770)

  Show description for 14ea528
  nv-braf

  authored
  14ea528

Commits on Oct 17, 2023

• New config options based on live run (#775)

  Show description for 6e0fc24
  nv-braf

  authored
  6e0fc24

• Capture LLM metrics from PA (#774)

  Show description for e81a369
  nv-braf

  authored
  e81a369

Commits on Oct 18, 2023

• Correct how periodic concurrency works in PACG (#777)

  Show description for efea104
  nv-braf

  authored
  efea104

Commits on Oct 19, 2023

• Llm testing live run (#778)

  Show description for b3aba30
  nv-braf

  authored
  b3aba30

Commits on Oct 20, 2023

• Changes to get LLM summary reports working (#779)

  Show description for f508625
  nv-braf

  authored
  f508625

Commits on Oct 31, 2023

• Adding illegal LLM checks w/ unit testing + some minor cleanup (#781)

  Show description for 8854589
  nv-braf

  authored
  8854589

• Misc LLM cleanup (#782)

  Show description for d9e075b
  nv-braf

  authored
  d9e075b

Commits on Nov 1, 2023

• Fix for non-LLM breaking bug introduced.

  nv-braf

  committed
  f229273

• summary table in progress

  nv-braf

  committed
  709531b