Code

Merge LLM Metrics changes to main#855

Code

Merged

nv-braf merged 7 commits intomaintriton-inference-server/model_analyzer:mainfrom use-llm-metrics-in-matriton-inference-server/model_analyzer:use-llm-metrics-in-maCopy head branch name to clipboardApr 8, 2024

+2,329-285

Commits

Commits on Apr 8, 2024

• New Records for LLM metrics (#839)

  Show description for 737a756
  nv-braf

  committed
  737a756

• Add --llm-mode option (#842)

  Show description for e2418f7
  nv-braf

  committed
  e2418f7

• Capture LLM metrics from genai-perf in MA (#844)

  Show description for 6284f52
  nv-braf

  committed
  6284f52

• Update constraints for LLMs (#845)

  Show description for 9bbc0d1
  nv-braf

  committed
  9bbc0d1

• Adding new output fields for LLM (#846)

  nv-braf

  committed
  6063f17

• Profiling model using genai-perf (#849)

  Show description for db55ca4
  

  nv-braf

  and

  root

  committed
  db55ca4

• Add genai_perf CLI options to MA (#854)

  Show description for 064f1e3
  nv-braf

  committed
  064f1e3