README.md

LLM Scheduler API

Prerequisite

Slurm engine was installed. Reference: Slurm Installation

Installation

1. Install dependency： Python 3.10+

pip install -r requirements.txt

2. API

python main.py

or

uvicorn main:app --host 0.0.0.0 --port 3000

API document

http://localhost:3000/docs