Skip to content

Commit

Permalink
修复chatglm异步计算可能没加special token的问题
Browse files Browse the repository at this point in the history
  • Loading branch information
黄宇扬 committed Jun 7, 2024
1 parent b1346b1 commit 6559c43
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/models/basellm.cpp
Original file line number Diff line number Diff line change
Expand Up @@ -709,6 +709,7 @@ printf("%d / %d\n", endingCount, batch);
handles.push_back(it.first);

if (it.second->preTokens == 0) {
it.second->intParams["add_special_tokens"] = it.second->generationConfig.add_special_tokens;
it.second->intParams["promptLen"] = it.second->currentTokens.size();
it.second->intParams["index"] = 0;
} else {
Expand Down

0 comments on commit 6559c43

Please sign in to comment.