🚀 Streaming v0.9.1
Streaming v0.9.1 is released! Install via pip:
pip install --upgrade mosaicml-streaming==0.9.1
What's New
1. Streaming is added to Gurubase (#805)
- Streaming now has an AI assistant available to help users with their questions! Try out Streaming Guru which uses the data from this repo and data from the docs to answer questions by leveraging the LLM.
Improvements
1. Permission Issue Resolution (#813)
- Resolved read permission issues occurring when shared memory files are created in shared computing environments. We added retry conditions to allow the creation of new shared memory files upon encountering permission errors.
- Prefix Integrity for Shared Memory Files: When creating shared memory files, both LOCALS and FILELOCKS are now validated to ensure no overlap with existing files, and they are matched with consistent prefix identifiers.
- Handling Non-Normal Program Exits: Enhanced cleanup procedures to address cases where non-normal program exits left some shared memory files uncleared. All files in SHM_TO_CLEAN are now checked to prevent duplicates.
These changes improve shared memory management and reliability in shared environments.
2. Fix Shard Eviction Hanging (#795)
- Changed the search for coldest shard to avoid looping over remote shards by considering local shards only as possible candidates for eviction.
What's Changed
- Bump pydantic from 2.9.1 to 2.9.2 by @dependabot in #785
- Bump fastapi from 0.114.2 to 0.115.0 by @dependabot in #786
- Bump uvicorn from 0.30.6 to 0.31.0 by @dependabot in #793
- Fixed broken links in README.md by @LukaszSztukiewicz in #794
- Shard evict fix by @snarayan21 in #795
- Update huggingface-hub requirement from <0.25,>=0.23.4 to >=0.23.4,<0.26 by @dependabot in #787
- Fix dataset.size() typo in docs by @snarayan21 in #798
- Warning -> info about defaults from v0.7.0 by @snarayan21 in #799
- Bump uvicorn from 0.31.0 to 0.31.1 by @dependabot in #803
- Bump fastapi from 0.115.0 to 0.115.2 by @dependabot in #804
- Introducing Streaming Guru on Gurubase.io by @kursataktas in #805
- Add better error message for shared prefix by @XiaohanZhangCMU in #806
- Bump uvicorn from 0.31.1 to 0.32.0 by @dependabot in #809
- Bump pytest-split from 0.9.0 to 0.10.0 by @dependabot in #810
- Fix logo png by @XiaohanZhangCMU in #808
- Update huggingface-hub requirement from <0.26,>=0.23.4 to >=0.23.4,<0.27 by @dependabot in #814
- Bump fastapi from 0.115.2 to 0.115.4 by @dependabot in #815
- Fix shared memory permission issue in a shared pod environment by @XiaohanZhangCMU in #813
New Contributors
- @LukaszSztukiewicz made their first contribution in #794
- @kursataktas made their first contribution in #805
Full Changelog: v0.9.0...v0.9.1
Contributors
kursataktas, dependabot, and 3 other contributors