v0.4.1
🚀 Streaming v0.4.1
Streaming v0.4.1
is released! Install via pip
:
pip install --upgrade mosaicml-streaming==0.4.1
New Feature
- Support of Torch 2.0. (#234)
- Addition of two new sample shuffling algorithm. (#223)
- Support of AWS S3 requester payers bucket permission for streaming. (#231)
Documentation
- Added a streaming installation guide and a streaming environment guide. (#221)
- Added a instruction guide for converting a multimodal dataset into a MDS format. (#220)
- Streaming documentation now support Algolia search. (#224)
What's Changed
- Refactor StreamingDataset shared memory prefix setup by @knighton in #218
- Bump pytest from 7.2.2 to 7.3.0 by @dependabot in #222
- Add two shuffling algos: naive (globally) and py1b (fixed-size blocks). by @knighton in #223
- Add installation and environments documentation by @karan6181 in #221
- Add a readme for multimodal convert script modal type by @karan6181 in #220
- Bump sphinx-copybutton from 0.5.1 to 0.5.2 by @dependabot in #229
- Bump pytest from 7.3.0 to 7.3.1 by @dependabot in #230
- Bump sphinxext-opengraph from 0.8.1 to 0.8.2 by @dependabot in #228
- Bump fastapi from 0.95.0 to 0.95.1 by @dependabot in #227
- Virtually split the repeats of repeated shards by @knighton in #226
- Switch documentation search to use Algolia by @bandish-shah in #224
- Add a requester pays bucket permission args to boto3 for s3 download file by @karan6181 in #231
- Bump yamllint from 1.30.0 to 1.31.0 by @dependabot in #233
- Support of torch 2.0 by @karan6181 in #234
- Removed pushing auto release branch due to GH action permission by @karan6181 in #235
- Fixed local directory check by @karan6181 in #238
- Skip distributed all_gather test since CI non-deterministically hangs by @karan6181 in #240
- Bump version to 0.4.1 by @karan6181 in #239
Full Changelog: v0.4.0...v0.4.1