The generated code has a special mark. <|endoftext|> <|cursor|>

[gaomeng20241028]

I use the following template：

prompt_template = "<|fim_prefix|>{prefix}<|fim_suffix|>{suffix}<|fim_middle|>"

[cyente]

you could simply remove the " <|cursor|>" and end the outputs at the "<|endoftext|>" .

By the way, which model you are using? and could you give as an example of this bad case?

[gaomeng20241028]

you could simply remove the " <|cursor|>" and end the outputs at the "<|endoftext|>" .

By the way, which model you are using? and could you give as an example of this bad case?

this one, qwen2.5-coder:32b-instruct-q8_0. I use the code completion tool tabby to access the model, and the content of code completion includes " <|cursor|>" and "<|endoftext|>"

[gaomeng20241028]

[cyente]

you could simply remove the " <|cursor|>" and end the outputs at the "<|endoftext|>" .
By the way, which model you are using? and could you give as an example of this bad case?

this one, qwen2.5-coder:32b-instruct-q8_0. I use the code completion tool tabby to access the model, and the content of code completion includes " <|cursor|>" and "<|endoftext|>"

We recommend using the base model rather than the instruct model for code completion.

[cyente]

Where is your input text located in the picture? and where is the output?

[gaomeng20241028]

Where is your input text located in the picture? and where is the output?

Only output is shown here. Input is a comment. Write a quick line.