the model continuously outputs repeated tokens

[Yhw109]

Hello,

I am using the Qwen2.5_coder_3B model, and I have noticed that if I do not use the prompt format specified in Qwen2.5-Coder/evaluation/text_to_sql, the model continuously outputs repeated tokens until it reaches the max_tokens limit. For example, when using the prompt from Qwen2.5-Coder/examples/Qwen2.5-Coder.py to "#write a quick sort algorithm."

Do I need to use special tokens to organize my prompt in order to resolve the issue of the model producing repeated outputs?

Thank you!

[huybery]

Please pull the latest version of the model and provide a full prompt for us to reproduce if you still have problems.