This repo serves/wraps databricks/dolly-v2-3b with Jsonformer.

If your running locally:

pip install -r requirements.txt
python app.py

you may want to change the port if there is something else running on that port. Inside the Magick AIDE Jsonformer node you can specify a port.

If your deploying to banana fork this repo and deploy it from their app.

Runpod serverless instructions coming soon