Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
### Description This PR sets `pad_token_id` in `genai_config.json` to a single value when a model does not specify a pad token id but it specifies a list of EOS token ids. ### Motivation and Context When the pad token id is not specified, `pad_token_id` in `genai_config.json` stores the same value that `eos_token_id` in `genai_config.json` contains. When `eos_token_id` has a list of EOS token ids, then `pad_token_id` also has a list of pad token ids. This causes a parsing issue in ONNX Runtime GenAI because it expects only one pad token id. This PR also fixes [this issue](#384).
- Loading branch information