From b5118f34e0608426464c943a9aac46d864ab3fd2 Mon Sep 17 00:00:00 2001 From: Baiju Meswani Date: Thu, 6 Jun 2024 14:53:25 -0700 Subject: [PATCH] Fix documentation of temperature (#20960) --- docs/genai/reference/config.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/genai/reference/config.md b/docs/genai/reference/config.md index 6b8218bb965fb..4da4ed9898b63 100644 --- a/docs/genai/reference/config.md +++ b/docs/genai/reference/config.md @@ -146,7 +146,7 @@ Then for each model in the pipeline there is one section, named by the model. * **_top_p_**: Only includes the most probable tokens with probabilities that add up to `P` or higher. Defaults to `1`, which includes all of the tokens. Range is 0 to 1, exclusive of 0. -* **_temperature_**: The temperature value scales the probability of each token so that probable tokens become more likely while less probable ones become less likely. This value can have a range 0 < `temperature` ≤ 1. When temperature is equal to `1`, it has no effect. +* **_temperature_**: The temperature value scales the scores of each token so that lower a temperature value leads to a sharper distribution. * **_repetition_penalty_**: Discounts the scores of previously generated tokens if set to a value greater than `1`. Defaults to `1`.