Skip to content

Commit

Permalink
Fixing typo
Browse files Browse the repository at this point in the history
  • Loading branch information
nv-braf committed Oct 16, 2023
1 parent e109116 commit 53f1c0f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion model_analyzer/perf_analyzer/perf_analyzer.py
Original file line number Diff line number Diff line change
Expand Up @@ -550,7 +550,7 @@ def _calculate_avg_token_to_token_latency(self, llm_output: Dict) -> float:
total_response_to_response_latency = 0
prev_response = request["response_timestamps"][0]
for response in request["response_timestamps"][1:]:
total_response_to_reponse_latency = response - prev_response
total_response_to_response_latency = response - prev_response
prev_response = response

total_token_to_token_latency += total_response_to_response_latency / len(
Expand Down

0 comments on commit 53f1c0f

Please sign in to comment.