Update sample output

triton-inference-server · Oct 3, 2023 · 6644398 · 6644398
1 parent bf8a85c
commit 6644398
Showing 1 changed file with 3 additions and 3 deletions.
diff --git a/src/c++/perf_analyzer/docs/llm.md b/src/c++/perf_analyzer/docs/llm.md
@@ -122,7 +122,7 @@ python profile.py -m vllm --prompt-size-range 100 500 200 --max-tokens 256 --ign
 
 # Sample output
 # [ Benchmark Summary ]
-#   Prompt size: 100, Average first-token latency: 0.0436 sec, Average token-token latency: 0.0070 sec
-#   Prompt size: 300, Average first-token latency: 0.0311 sec, Average token-token latency: 0.0071 sec
-#   Prompt size: 500, Average first-token latency: 0.0875 sec, Average token-token latency: 0.0073 sec
+#   Prompt size: 100, Average first-token latency: 0.0388 sec, Average token-token latency: 0.0066 sec
+#   Prompt size: 300, Average first-token latency: 0.0431 sec, Average token-token latency: 0.0071 sec
+#   Prompt size: 500, Average first-token latency: 0.0400 sec, Average token-token latency: 0.0070 sec
 ```