Skip to content

Commit

Permalink
[llm_perf] fix merge bug.
Browse files Browse the repository at this point in the history
  • Loading branch information
suisiyuan committed Jun 18, 2024
1 parent 660f7b4 commit 18eb8b1
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions byte_infer_perf/llm_perf/server/endpoint.py
Original file line number Diff line number Diff line change
Expand Up @@ -49,10 +49,6 @@ def __init__(self, xpu_cfg) -> None:
def __del__(self):
self.scheduler.stop()

def __del__(self):
self.scheduler.stop()


def warmup(self, max_batch_size):
prompt = "中国的首都是哪里?"
generate_config = {
Expand Down

0 comments on commit 18eb8b1

Please sign in to comment.