Skip to content

Commit

Permalink
Updated config definitions
Browse files Browse the repository at this point in the history
  • Loading branch information
natke committed Mar 14, 2024
1 parent adec8d4 commit 31cd665
Showing 1 changed file with 21 additions and 9 deletions.
30 changes: 21 additions & 9 deletions docs/genai/reference/config.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,17 +124,29 @@ Then For each model in the pipeline there is one section, named by the model.
### Search section

* _max_length_: The maximum length that the model will generate.

* _min_length_: The minimum length that the model will generate.

* _do_sample_:
* _num_beams_: The number of beams to apply when generating the output sequence using beam search.

* _num_beams_: The number of beams to apply when generating the output sequence using beam search. If num_beams=1, then generation is performed using greedy search.

* _early_stopping_ : Whether to stop the beam search when at least num_beams sentences are finished per batch or not. Defaults to false.

* _num_sequences_: The number of sequences to generate. Returns the sequences with the highest scores in order.
words are repeated.
* _temperature_:
* _top_k_:
* _top_p_:
* _early_stopping_ :
* _repetition_penalty_: The penalty to apply when
* _length_penalty_:

* _temperature_: The temperature value scales the probability of each token so that probable tokens become more likely while less probable ones become less likely. This value can have a range 0 < `temperature` ≤ 1. When temperature is equal to `1`, it has no effect.

* _top_k_: Only includes tokens that do fall within the list of the `K` most probable tokens.

* _top_p_: Only includes the most probable tokens with probabilities that add up to `P` or higher. Defaults to `1`, which includes all of the tokens.

* _repetition_penalty_: Discounts the scores of previously generated tokens if set to a value greater than `1`. Defaults to `1`.

* _length_penalty_: Controls the length of the output generated. Value less than `1` encourages the generation to produce shorter sequences. Values greater than `1` encourages longer sequences. Defaults to `1`.

* _diversity_penalty_:

* _no_repeat_ngram_size_:
* _past_present_share_buffer_:

* _past_present_share_buffer_: If set to true, the past and present buffer are shared for efficiency.

0 comments on commit 31cd665

Please sign in to comment.