Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error while running triton-server docker with fil backed on MacOS 14.3 #400

Open
suvratjain1995 opened this issue Aug 21, 2024 · 0 comments

Comments

@suvratjain1995
Copy link

Getting following error when running xgboost model (fil backend) with triton container on MacOS14.3

Error
UNAVAILABLE: Invalid argument: unable to find 'libtriton_fil.so' or 'fil/model.py' for model 'xgboost_model', in /opt/tritonserver/backends/fil

Docker File

FROM nvcr.io/nvidia/tritonserver:23.12-py3
ARG MODEL_REPOSITORY=/models/
RUN mkdir -p ${MODEL_REPOSITORY}
COPY ./src ${MODEL_REPOSITORY}
EXPOSE 8000 8001 8002
USER 4000 
ENTRYPOINT ["tritonserver", "--model-repository", "/models", "--strict-model-config=false"]

Folder Structure :-

 xgboost_model
│       ├── 1
│       │   └── xgboost.json
│       └── config.pbtxt

config.pbtxt

backend: "fil"
max_batch_size: 32768
input [
 {
    name: "input__0"
    data_type: TYPE_FP32
    dims: [ 2294 ]
  }
]
output [
 {
    name: "output__0"
    data_type: TYPE_FP32
    dims: [ 2 ]
  }
]
instance_group [{
 kind: KIND_CPU
}]
parameters [
  {
    key: "model_type"
    value: { string_value: "xgboost_json" }
  },
  {
    key: "output_class"
    value: { string_value: "true" }
  },
  {
      key: "predict_proba"
      value: { string_value: "true" }
  },
  {
      key: "threshold"
      value: { string_value: "0.5" }
  },
  {
      key: "storage_type"
      value: { string_value: "AUTO" }
  }
]
dynamic_batching {}

Image version :- nvcr.io/nvidia/tritonserver:23.12-py3

Model is able to load successfully in Linux

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant