Skip to content

Commit

Permalink
[docs] Minor wording updates
Browse files Browse the repository at this point in the history
Co-authored-by: Ryan McCormick <[email protected]>
  • Loading branch information
kthui and rmccorm4 authored Dec 4, 2024
1 parent 17ae25c commit c38a798
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions docs/additional_outputs.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,15 +57,15 @@ point value will be sent on the `cumulative_logprob` output tensor.

### Log Probabilities

The log probabilities of the top probability words at each position if the
The log probabilities of the top probability tokens at each position of the
[logprobs](https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/sampling_params.py#L146-L152)
are requested. Only the log probabilities of the new tokens generated since the
last response are returned on each new response. See
[here](https://github.com/vllm-project/vllm/blob/v0.6.3.post1/vllm/outputs.py#L24-L25)
for more details on the log probabilities.

To enable, set `return_logprobs` input tensor to `True`. The log probabilities
will be sent on the `logprobs` output tensor as JSON.
will be sent on the `logprobs` output tensor as a serialized JSON string.

### Number of Input Tokens

Expand Down

0 comments on commit c38a798

Please sign in to comment.