NOTE: An RTX video card is likely needed with support for CUDA 12.5
This repo is using docker to pull an image from Nvidia for pytorch support
https://docs.nvidia.com/deeplearning/frameworks/pytorch-release-notes/rel-24-06.html
Release 24.06 is based on NVIDIA CUDA 12.5.0.23, which requires NVIDIA Driver release 545 or later. However, if you are running on a data center GPU (for example, T4 or any other data center GPU), you can use NVIDIA driver release 470.57 (or later R470), 525.85 (or later R525), 535.86 (or later R535), or 545.23 (or later R545).
The CUDA driver’s compatibility package only supports particular drivers. Thus, users should upgrade from all R418, R440, R450, R460, R510, and R520 drivers, which are not forward-compatible with CUDA 12.3. For a complete list of supported drivers, see the CUDA Application Compatibility topic. For more information, see CUDA Compatibility and Upgrades.
-
git clone https://github.com/joshchernoff/ai_scripts.git -
cd ai_scripts
You may need to setup your auth key for hugging face
-
[ ! -f .env ] && touch .env; echo 'HUGGINGFACE_TOKEN="your_key"' >> .env -
docker compose up
In another term
-
docker compose exec pytorch /bin/bash -
pip install diffusers transformers accelerate peft -
python sdxl-turbo-text-to-image.py
These are WIP
Start flask
cd code_helperpython app.py
Start vue
cd code_helper/code-chat-appnpm run dev
Start flask
cd cascade_helperpython app.py
Start vue
cd cascade_helper/cascase-image-generatornpm run dev