Skip to content

Commit

Permalink
import bugfix
Browse files Browse the repository at this point in the history
  • Loading branch information
rishsriv committed Dec 6, 2023
1 parent 4a9ec72 commit fb2e918
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions defog/serve.py
Original file line number Diff line number Diff line change
Expand Up @@ -9,7 +9,8 @@
import os
import json
import sqlparse
import tqdm
from tqdm import tqdm
import sys

try:
from llama_cpp import Llama
Expand Down Expand Up @@ -41,7 +42,8 @@

llm = Llama(model_path=filepath, n_gpu_layers=1)
except Exception as e:
print("")
print("An error occured when trying to load the model!")
sys.exit(1)


app = FastAPI()
Expand Down

0 comments on commit fb2e918

Please sign in to comment.