Skip to content

Commit

Permalink
[Whisper] Nit converting the tokenizer (huggingface#27349)
Browse files Browse the repository at this point in the history
* `nospeech` instead of `nocaption` for the no speech token

* oups
  • Loading branch information
ArthurZucker authored Nov 7, 2023
1 parent cc9f27b commit 8f840ed
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/transformers/models/whisper/convert_openai_to_hf.py
Original file line number Diff line number Diff line change
Expand Up @@ -235,7 +235,7 @@ def convert_tiktoken_to_hf(
"<|transcribe|>",
"<|startoflm|>",
"<|startofprev|>",
"<|nocaptions|>",
"<|nospeech|>",
"<|notimestamps|>",
]
# these are special tokens, not normalized
Expand Down

0 comments on commit 8f840ed

Please sign in to comment.