Releases: flyteorg/flytekit
Releases · flyteorg/flytekit
v1.13.9 Patches for instance generics and mapped union
What's Changed
- Instance generic empty case by @wild-endeavor in #2802
- More instance generic checks (#2813) by @eapolinario in #2817
- fix is_optional_type or not return true for all union types (#2824) by @eapolinario in #2825
- Run tests on merges to release branches by @eapolinario in #2826
Full Changelog: v1.13.8...v1.13.9
[Beta] Run active LPs by default, msgpack idl support, async type engine, improvements to register output
[Beta] Run active LPs by default, msgpack idl support, async type engine, improvements to register output
Pre-release
Pre-release
The next beta release in the 1.14 cycle... the official 1.14 release will probably warrant a bit of a longer testing process given the nature of these changes.
- Support default label/annotation for the default launch plan creating from workflow definition by @Mecoli1219 in #2776
- [FlyteClient][FlyteDeck] Get Downloaded Artifact Signed URL via Data Proxy by @Future-Outlier in #2777
- Expose Options in Flytekit for Direct User Access by @Mecoli1219 in #2785
- Adds a simple async utilitiy that managers an async loop in another thread by @thomasjpfan in #2784
- Adds a random DOCSEARCH_API_KEY to get monodocs build to succeed by @thomasjpfan in #2787
- Binary IDL With MessagePack by @Future-Outlier in #2760
- Pickle remote task for Jupyter Notebook Environment by @Mecoli1219 in #2733
- Fix getting started link, remove extra parenthesis by @deepyaman in #2788
- update bigquery plugin reqs by @dansola in #2790
- Related to flyteorg/flyte#5805 [Flyte Deck] Extras has been added by @101rakibulhasan in #2786
- Async type engine by @wild-endeavor in #2752
- add support for mapping over remote launch plans by @pvditt in #2761
- Fixes boundary conditions for literal convertor by @kumare3 in #2596
- Fix assertion in test_type_engine_binary_idl by @thomasjpfan in #2801
- Add unit test for pickling by @wild-endeavor in #2805
- Update task.py by @RaghavMangla in #2791
- Instance generic empty case (#2802) by @wild-endeavor in #2807
- ensure a space is added if both args are set in ImageSpec by @blaketastic2 in #2806
- add links to register by @dansola in #2804
- Fix mypy errors caught in 1.11.2 by @eapolinario in #2808
- Fix dependabot alerts as of 2024-10-11 by @eapolinario in #2809
- Run active launchplan when available to launch, else run the latest one by @kumare3 in #2796
Full Changelog: v1.14.0b0...v1.14.0b1
v1.13.8
What's Changed
- Backport to v1.13 - Fix array node map task for offloaded literal (#2772) by @eapolinario in #2793
Full Changelog: v1.13.7...v1.13.8
v1.14.0b0
What's Changed
- Fix array node map task for offloaded literal by @pmahindrakar-oss in #2772
Full Changelog: v1.13.7...v1.14.0b0
v1.13.7
What's Changed
- eager workflow: use event loop instead of asyncio.run by @cosmicBboy in #2737
- [Flyte Deck] Fix Lazy Import Error for Pandas and Plotly by @Future-Outlier in #2783
- Fixes for fast register by @wild-endeavor in #2782
- Use uv in agent image by @eapolinario in #2780
Full Changelog: v1.13.6...v1.13.7
v1.13.6
What's Changed
- Core/fix register remote by @novahow in #2303
- Deprecate scopes by @pingsutw in #2671
- Move vscode plugin to flytekit by @pingsutw in #2689
- Add Perian Job Platform agent by @otarabai in #2537
- Fix
test_real_config
func by unsetFLYTE_AWS_ENDPOINT
env by @Future-Outlier in #2722 - Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
- Streamline fast register options with new flag by @wild-endeavor in #2690
- fix local test
test_list_containing_multiple_annotated_pandas_dataframes
fail by @Mecoli1219 in #2725 - add motherduck support for duckdb plugin by @dansola in #2680
- Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
- Better error for min_success_ratio<1 by @pingsutw in #2724
- Fix backfill command by @pingsutw in #2730
- Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
- Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
- Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
- fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
- Imgspec/copy auto by @wild-endeavor in #2731
- GH-5732: Make
TypeEngine.lazy_import_transformers()
thread safe by @Tom-Newton in #2735 - Revert #2303 by @pingsutw in #2746
- reference lp example for flyteremote by @dansola in #2747
- Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
- Types/generic alias - assert fix only by @wild-endeavor in #2743
- Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
- add ollama to flytekit-inference by @samhita-alla in #2677
- pin duckdb version in plugin by @dansola in #2739
- feat(image_spec): validate container registry names by @pingsutw in #2748
- add resources to input downloader in the ollama plugin by @samhita-alla in #2754
- Read offloaded literals by @eapolinario in #2685
- Fix: Make flyte-iap catch when trying to generate token for service account from user credentials by @fg91 in #2738
- [Bug] Set bindings for ArrayNode by @pvditt in #2742
- [flyteagent] All agents return dict instead of literal map by @Future-Outlier in #2762
- GH-5768: Better pyflyte boolean parsing by @Tom-Newton in #2764
- add dest_dir into pythonpath before loading modules by @arbaobao in #2692
- Fix reading Flyte secrets and using PERIAN secrets param by @otarabai in #2767
- Bump cryptography from 42.0.7 to 43.0.1 by @dependabot in #2736
- [Flyte Decks] support ydata-profiling in python 3.12 by @Future-Outlier in #2766
- Update pyflyte defaults to use --copy behavior by @wild-endeavor in #2755
- Enable Spark Fast Register by @pingsutw in #2765
- Add FlyteNonRecoverableSystemException by @pingsutw in #2700
- [Flytekit] Support extra copy commands in ImageSpec by @mao3267 in #2715
- Revert dev-requirements.in change for MacOS by @Future-Outlier in #2769
- Propagate custom_info Dict through agent Resource by @ddl-ebrown in #2426
- Mock addPyFile in spark test by @pingsutw in #2770
- enabled copy-all for programmatic fast-registration via FlyteRemote by @granthamtaylor in #2768
- Do not copy flytekit itself during fast registration by @thomasjpfan in #2775
- Add correct types to
Scalar
andPrimitive
constructors inliterals.py
by @felixmulder in #2778
New Contributors
- @otarabai made their first contribution in #2537
- @ddl-ebrown made their first contribution in #2426
- @granthamtaylor made their first contribution in #2768
- @felixmulder made their first contribution in #2778
Full Changelog: v1.13.5...v1.13.6
v1.13.6b2
What's Changed
- Read offloaded literals by @eapolinario in #2685
Full Changelog: v1.13.6b1...v1.13.6b2
v1.13.6b1
What's Changed
- pin duckdb version in plugin by @dansola in #2739
- feat(image_spec): validate container registry names by @pingsutw in #2748
- add resources to input downloader in the ollama plugin by @samhita-alla in #2754
Full Changelog: v1.13.6b0...v1.13.6b1
v1.13.6b0
What's Changed
- Core/fix register remote by @novahow in #2303
- Deprecate scopes by @pingsutw in #2671
- Move vscode plugin to flytekit by @pingsutw in #2689
- Add Perian Job Platform agent by @otarabai in #2537
- Fix
test_real_config
func by unsetFLYTE_AWS_ENDPOINT
env by @Future-Outlier in #2722 - Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
- Streamline fast register options with new flag by @wild-endeavor in #2690
- fix local test
test_list_containing_multiple_annotated_pandas_dataframes
fail by @Mecoli1219 in #2725 - add motherduck support for duckdb plugin by @dansola in #2680
- Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
- Better error for min_success_ratio<1 by @pingsutw in #2724
- Fix backfill command by @pingsutw in #2730
- Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
- Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
- Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
- fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
- Imgspec/copy auto by @wild-endeavor in #2731
- GH-5732: Make
TypeEngine.lazy_import_transformers()
thread safe by @Tom-Newton in #2735 - Revert #2303 by @pingsutw in #2746
- reference lp example for flyteremote by @dansola in #2747
- Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
- Types/generic alias - assert fix only by @wild-endeavor in #2743
- Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
- add ollama to flytekit-inference by @samhita-alla in #2677
New Contributors
Full Changelog: v1.13.5...v1.13.6b0
v1.13.5
What's Changed
- Fix race conditions in the Authentication client by @rdeaton-freenome in #2635
- Update uv to 0.2.37 in default image builder by @thomasjpfan in #2687
- Input through file and pipe by @mao3267 in #2552
- Improve error message for get signed url failure by @pingsutw in #2679
- Add pythonpath "." before loading modules by @arbaobao in #2673
- Better error message for FailureNodeInputMismatch error by @pingsutw in #2693
- Remove prerelease flag with uv in image builder by @thomasjpfan in #2697
- Fix: Catch unsupported node types in map node array task by @fg91 in #2699
- Deprecation notice for pod plugin by @wild-endeavor in #2698
- Fix integration tests by @eapolinario in #2701
- Add pip_extra_index_url as a supported parameter in default builder by @thomasjpfan in #2704
- remove upper bound of plugin dependencies for flytekit-polars by @Mecoli1219 in #2514
- fix: cover 500 errors for new Harbor repos by @dylanspag-lmco in #2696
- Fix local test
test_get_config_file
fail by @Mecoli1219 in #2705 - Fix local test
test_get_remote
fail by @Mecoli1219 in #2706 - Fix local test
test_saving_remote
fail by @Mecoli1219 in #2707 - Default execution name should be generated in flyteadmin by @wayner0628 in #2678
- Support default values in typing.List[dataclass] and typing.Dict[str, dataclass] by @mao3267 in #2603
- Use logger.debug when numpy is not found by @thomasjpfan in #2712
- refactor(core): Update with_overrides signatures and type hints by @pingsutw in #2323
- Make task loading a part of dispatch execute by @thomasjpfan in #2711
- Adds neptune plugin for experiment tracking by @thomasjpfan in #2686
- Add Echo task by @pingsutw in #2654
- [Remote] check subworkflows for launch plan nodes by @wild-endeavor in #2714
- Improve jupyter repr and
__repr__
for Flyte models by @thomasjpfan in #2647 - Improve error message for entity not found in flytekit cli by @pingsutw in #2713
- Polars lazyframe by @cosmicBboy in #2695
- unify the image spec hash function by @pingsutw in #2593
- Provide upper bound to great expectations by @thomasjpfan in #2717
New Contributors
- @mao3267 made their first contribution in #2552
- @dylanspag-lmco made their first contribution in #2696
Full Changelog: v1.13.4...v1.13.5