Prerequisites

• Python 3.11 or above
• Google Cloud Platform (GCP) account
• GCLoud CLI

Local Installation

1. Clone the repository:

git clone <repository-url>

2. Install the required dependencies:

#/bin/bash
pipx install poetry
poetry lock
poetry install

Authenticate to the GCLOUD CLI and set a default project.

#/bin/bash
gcloud auth login
gcloud auth application-default login
gcloud auth application-default set-quota-project $MY_PROJECT_ID
gcloud config set project $MY_PROJECT_ID

Start the FastAPI server.

uvicorn main:app

You can now make some API calls to the REST API. Source the tesh.sh file for some examples.

. test.sh

If you are authenticated with Google Cloud, you can deploy the container using the script deploy.sh

source deploy.sh

You can debug with streamlit, posting input to the localhost API:

poetry run streamlit run chat.py