1.6.0

Overview

Upgrades

MLServer supports Pydantic V2.

Features

MLServer supports streaming data to and from your models.

Streaming support is available for both the REST and gRPC servers:

• for the REST server is limited only to server streaming. This means that the client sends a single request to the server, and the server responds with a stream of data.
• for the gRPC server is available for both client and server streaming. This means that the client sends a stream of data to the server, and the server responds with a stream of data.

See our docs and example for more details.

What's Changed

• fix(ci): fix typo in CI name by @sakoush in #1623
• Update CHANGELOG by @github-actions in #1624
• Re-generate License Info by @github-actions in #1634
• Fix mlserver_huggingface settings device type by @geodavic in #1486
• fix: Adjust HF tests post-merge of PR #1486 by @sakoush in #1635
• Update README.md w licensing clarification by @paulb-seldon in #1636
• Re-generate License Info by @github-actions in #1642
• fix(ci): optimise disk space for GH workers by @sakoush in #1644
• build: Update maintainers by @jesse-c in #1659
• fix: Missing f-string directives by @jesse-c in #1677
• build: Add Catboost runtime to Dependabot by @jesse-c in #1689
• Fix JSON input shapes by @ReveStobinson in #1679
• build(deps): bump alibi-detect from 0.11.5 to 0.12.0 by @jesse-c in #1702
• build(deps): bump alibi from 0.9.5 to 0.9.6 by @jesse-c in #1704
• Docs correction - Updated README.md in mlflow to match column names order by @vivekk0903 in #1703
• fix(runtimes): Remove unused Pydantic dependencies by @jesse-c in #1725
• test: Detect generate failures by @jesse-c in #1729
• build: Add granularity in types generation by @jesse-c in #1749
• Migrate to Pydantic v2 by @jesse-c in #1748
• Re-generate License Info by @github-actions in #1753
• Revert "build(deps): bump uvicorn from 0.28.0 to 0.29.0" by @jesse-c in #1758
• refactor(pydantic): Remaining migrations for deprecated functions by @jesse-c in #1757
• Fixed openapi dataplane.yaml by @RobertSamoilescu in #1752
• fix(pandas): Use Pydantic v2 compatible type by @jesse-c in #1760
• Fix Pandas codec decoding from numpy arrays by @lhnwrk in #1751
• build: Bump versions for Read the Docs by @jesse-c in #1761
• docs: Remove quotes around local TOC by @jesse-c in #1764
• Spawn worker in custom environment by @lhnwrk in #1739
• Re-generate License Info by @github-actions in #1767
• basic contributing guide on contributing and opening a PR by @bohemia420 in #1773
• Inference streaming support by @RobertSamoilescu in #1750
• Re-generate License Info by @github-actions in #1779
• build: Lock GitHub runners' OS by @jesse-c in #1765
• Removed text-model form benchmarking by @RobertSamoilescu in #1790
• Bumped mlflow to 2.13.1 and gunicorn to 22.0.0 by @RobertSamoilescu in #1791
• Build(deps): Update to poetry version 1.8.3 in docker build by @sakoush in #1792
• Bumped werkzeug to 3.0.3 by @RobertSamoilescu in #1793
• Docs streaming by @RobertSamoilescu in #1789
• Bump uvicorn 0.30.1 by @RobertSamoilescu in #1795
• Fixes for all-runtimes by @RobertSamoilescu in #1794
• Fix BaseSettings import for pydantic v2 by @RobertSamoilescu in #1798
• Bumped preflight version to 1.9.7 by @RobertSamoilescu in #1797
• build: Install dependencies only in Tox environments by @jesse-c in #1785
• Bumped to 1.6.0.dev2 by @RobertSamoilescu in #1803
• Fix CI/CD macos-huggingface by @RobertSamoilescu in #1805
• Fixed macos kafka CI by @RobertSamoilescu in #1807
• Update poetry lock by @RobertSamoilescu in #1808
• Re-generate License Info by @github-actions in #1813
• Fix/macos all runtimes by @RobertSamoilescu in #1823
• fix: Update stale reviewer in licenses.yml workflow by @sakoush in #1824
• ci: Merge changes from master to release branch by @sakoush in #1825

New Contributors

• @paulb-seldon made their first contribution in #1636
• @ReveStobinson made their first contribution in #1679
• @vivekk0903 made their first contribution in #1703
• @RobertSamoilescu made their first contribution in #1752
• @lhnwrk made their first contribution in #1751
• @bohemia420 made their first contribution in #1773

Full Changelog: 1.5.0...1.6.0