Simple Stable Diffusion Server

Welcome to Simple Stable Diffusion Server, your go-to solution for AI-powered image generation and manipulation!

Features

• Local Deployment: Run locally for style transfer, art generation and inpainting.
• Production Mode: Save images to cloud storage and retrieve links to Google Cloud Storage.
• Versatile Applications: Perfect for AI art generation, style transfer, and image inpainting. Bring any SDXL/diffusers model.
• Easy to Use: Simple interface for generating images in Gradio locally and easy to use FastAPI docs/server for advanced users.

For a hosted AI Art Generation experience, check out our AI Art Generator and Search Engine, which offers advanced features like video creation and 2K upscaled images.

Quick Start

Setup

1. Create a virtual environment (optional):

pip install uv
uv venv
source .venv/bin/activate

2. Install dependencies:

uv pip install -r requirements.txt
uv pip install -r dev-requirements.txt

3. Clone necessary models (or point to your own SDXL models in main.py)

cd models
git clone [email protected]:/stabilityai/stable-diffusion-xl-base-1.0
git clone [email protected]:/dataautogpt3/ProteusV0.2

# Optional for line based style transfer
git clone [email protected]:/diffusers/controlnet-canny-sdxl-1.0

4. Install NLTK stopwords:

python -c "import nltk; nltk.download('stopwords')"

Running the Gradio UI

Launch the user-friendly Gradio interface:

python gradio_ui.py

Go to http://127.0.0.1:7860

Server setup

Edit settings

download your Google cloud credentials to secrets/google-credentials.json

Images generated will be stored in your bucket

Run the server

GOOGLE_APPLICATION_CREDENTIALS=secrets/google-credentials.json gunicorn  -k uvicorn.workers.UvicornWorker -b :8000 main:app --timeout 600 -w 1 

with max 4 requests at a time This will drop a lot of requests under load instead of taking on too much work and causing OOM Errors.

GOOGLE_APPLICATION_CREDENTIALS=secrets/google-credentials.json PYTHONPATH=. uvicorn --port 8000 --timeout-keep-alive 600 --workers 1 --backlog 1 --limit-concurrency 4 main:app

Make a Request

http://localhost:8000/create_and_upload_image?prompt=good%20looking%20elf%20fantasy%20character&save_path=created/elf.webp

Response

{"path":"https://storage.googleapis.com/static.netwrck.com/static/uploads/created/elf.png"}

http://localhost:8000/swagger-docs

Check to see that "good Looking elf fantasy character" was created

Testing

GOOGLE_APPLICATION_CREDENTIALS=secrets/google-credentials.json pytest .

Running under supervisord

edit ops/supervisor.conf

install the supervisor apt-get install -y supervisor

sudo cat >/etc/supervisor/conf.d/python-app.conf << EOF
[program:sdif_http_server]
directory=/home/lee/code/sdif
command=/home/lee/code/sdif/.env/bin/uvicorn --port 8000 --timeout-keep-alive 12 --workers 1 --backlog 1 --limit-concurrency 2 main:app
autostart=true
autorestart=true
environment=VIRTUAL_ENV="/home/lee/code/sdif/.env/",PATH="/opt/app/sdif/.env/bin",HOME="/home/lee",GOOGLE_APPLICATION_CREDENTIALS="secrets/google-credentials.json",PYTHONPATH="/home/lee/code/sdif"
stdout_logfile=syslog
stderr_logfile=syslog
user=lee
EOF

sudo supervisorctl reread
sudo supervisorctl update

run a manager process to kill/restart if the server if it is hanging

Sometimes the server just stops working and needs a hard restart

This command will kill the server if it is hanging and restart it (must be running under supervisorctl)

python3 manager.py

hack restarting without supervisor

run the server in a infinite loop

while true; do GOOGLE_APPLICATION_CREDENTIALS=secrets/google-credentials.json PYTHONPATH=. uvicorn --port 8000 --timeout-keep-alive 600 --workers 1 --backlog 1 --limit-concurrency 4 main:app; done

windows setup

py -3.11 -m venv .wvenv . .wvenv/Scripts/activate python -m pip install uv python -m uv pip install -r requirements.txt

contributing guidelines

Please help in any way.

Shameless Plug from Maintainers

Checkout Voiced AI Characters to chat with at netwrck.com

Characters are narrated and written by many GPT models trained on 1000s of fantasy novels and chats.

For Vision LLMs for making Text - Checkout Text-Generator.io for a Open Source text generator that uses many AI models to generate the best along with image understanding and OCR networks.