Skip to content

Major Version Upgrades, Model Optimizations
Compare
Choose a tag to compare
@skier233 skier233 released this 28 Aug 19:45
· 13 commits to main since this release
1.3.7
5553346

IMPORTANT: After upgrading to this version from a previous version, you may need to run start.ps1/start.sh after running the upgrade script due to a bug with upgrades in conda.

Changes:

  • Update Python to 3.12
  • Update Pytorch to 2.4
  • Update Cuda to 12.4
  • Optimization to prefer batch sizes of 8 when possible leading to significant performance increases
  • Optimization to fill batches to the max batch size, significantly increasing performance especially after server startup and initial model runs
  • Add optimization to use multiple different models at once without running out of GPU VRAM
Assets 3
Loading