v0.3.1-rc2
Pre-release
Pre-release
What's Changed
- Added support for bitsandbytes quantization of models by @AyushSawant18588 in #33
- Added support for hf_token as an environment variable by @AyushSawant18588 in #34
- Refresh request map for every process by @gavrishp in #38
Full Changelog: v0.3...v0.3.1-rc2