Updated tutorial, goodput is printed inside table

triton-inference-server · Aug 22, 2024 · c0e3b1f · c0e3b1f
1 parent dbdf8f6
commit c0e3b1f
Showing 1 changed file with 8 additions and 8 deletions.
diff --git a/genai-perf/docs/goodput.md b/genai-perf/docs/goodput.md
@@ -130,12 +130,12 @@ genai-perf profile \
 Example output:
 
 ```
-                           Embeddings Metrics
-┏━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━┓
-┃            Statistic ┃   avg ┃   min ┃   max ┃   p99 ┃   p90 ┃   p75 ┃
-┡━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━┩
-│ Request latency (ms) │ 22.23 │ 21.67 │ 31.96 │ 22.90 │ 22.48 │ 22.31 │
-└──────────────────────┴───────┴───────┴───────┴───────┴───────┴───────┘
-Request throughput (per sec): 44.73
-Request goodput (per sec): 40.28
+                     NVIDIA GenAI-Perf | Embeddings Metrics
+┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━━┳━━━━━━━┳━━━━━━━┳━━━━━━━┓
+┃                    Statistic ┃   avg ┃   min ┃    max ┃   p99 ┃   p90 ┃   p75 ┃
+┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━━╇━━━━━━━╇━━━━━━━╇━━━━━━━┩
+│         Request latency (ms) │ 23.23 │ 21.98 │ 147.53 │ 23.74 │ 22.75 │ 22.52 │
+│ Request throughput (per sec) │ 42.95 │   N/A │    N/A │   N/A │   N/A │   N/A │
+│    Request goodput (per sec) │ 30.40 │   N/A │    N/A │   N/A │   N/A │   N/A │
+└──────────────────────────────┴───────┴───────┴────────┴───────┴───────┴───────┘
 ```