[Beta] 14.0b2

What's Changed

• Revise Pickle Remote Task for Jupyter Notebook Environment by @Mecoli1219 in #2799
• DOC-648 Add pages for Neptune and W&B plugins by @neverett in #2803
• [Flytekit] Envd builder with extra copy commands by @mao3267 in #2774
• More instance generic checks by @wild-endeavor in #2813
• Read inputs file from stdin iff the last argument to pyflyte run is a dash by @eapolinario in #2814
• Add PERIAN agent docs by @otarabai in #2816
• Fix docs URL in pyflyte init by @bryan-hunted in #2822
• Add FLYTE_FAIL_ON_ERROR env to the databricks job by @pingsutw in #2819
• [BUG] BQToPandasDecodingHandler only reads partial data when dataset > 100MB by @mao3267 in #2789
• Cross type binding by @wild-endeavor in #2820
• [BUG] fix is_optional_type to not return true for all union types by @pvditt in #2824
• Run tests on merges to release branches by @eapolinario in #2827
• Flytekitplugin pandera update: use entrypoint and structured dataset by @cosmicBboy in #2821
• Make sure user errors contain the entire chain of the stack trace by @bgedik in #2795
• Improved Type engine for generic types and performance by @kumare3 in #2815

v1.13.9 Patches for instance generics and mapped union

What's Changed

• Instance generic empty case by @wild-endeavor in #2802
• More instance generic checks (#2813) by @eapolinario in #2817
• fix is_optional_type or not return true for all union types (#2824) by @eapolinario in #2825
• Run tests on merges to release branches by @eapolinario in #2826

Full Changelog: v1.13.8...v1.13.9

[Beta] Run active LPs by default, msgpack idl support, async type engine, improvements to register output

The next beta release in the 1.14 cycle... the official 1.14 release will probably warrant a bit of a longer testing process given the nature of these changes.

• Support default label/annotation for the default launch plan creating from workflow definition by @Mecoli1219 in #2776
• [FlyteClient][FlyteDeck] Get Downloaded Artifact Signed URL via Data Proxy by @Future-Outlier in #2777
• Expose Options in Flytekit for Direct User Access by @Mecoli1219 in #2785
• Adds a simple async utilitiy that managers an async loop in another thread by @thomasjpfan in #2784
• Adds a random DOCSEARCH_API_KEY to get monodocs build to succeed by @thomasjpfan in #2787
• Binary IDL With MessagePack by @Future-Outlier in #2760
• Pickle remote task for Jupyter Notebook Environment by @Mecoli1219 in #2733
• Fix getting started link, remove extra parenthesis by @deepyaman in #2788
• update bigquery plugin reqs by @dansola in #2790
• Related to flyteorg/flyte#5805 [Flyte Deck] Extras has been added by @101rakibulhasan in #2786
• Async type engine by @wild-endeavor in #2752
• add support for mapping over remote launch plans by @pvditt in #2761
• Fixes boundary conditions for literal convertor by @kumare3 in #2596
• Fix assertion in test_type_engine_binary_idl by @thomasjpfan in #2801
• Add unit test for pickling by @wild-endeavor in #2805
• Update task.py by @RaghavMangla in #2791
• Instance generic empty case (#2802) by @wild-endeavor in #2807
• ensure a space is added if both args are set in ImageSpec by @blaketastic2 in #2806
• add links to register by @dansola in #2804
• Fix mypy errors caught in 1.11.2 by @eapolinario in #2808
• Fix dependabot alerts as of 2024-10-11 by @eapolinario in #2809
• Run active launchplan when available to launch, else run the latest one by @kumare3 in #2796

Full Changelog: v1.14.0b0...v1.14.0b1

v1.13.8

What's Changed

• Backport to v1.13 - Fix array node map task for offloaded literal (#2772) by @eapolinario in #2793

Full Changelog: v1.13.7...v1.13.8

v1.14.0b0

What's Changed

• Fix array node map task for offloaded literal by @pmahindrakar-oss in #2772

Full Changelog: v1.13.7...v1.14.0b0

v1.13.7

What's Changed

• eager workflow: use event loop instead of asyncio.run by @cosmicBboy in #2737
• [Flyte Deck] Fix Lazy Import Error for Pandas and Plotly by @Future-Outlier in #2783
• Fixes for fast register by @wild-endeavor in #2782
• Use uv in agent image by @eapolinario in #2780

Full Changelog: v1.13.6...v1.13.7

v1.13.6

What's Changed

• Core/fix register remote by @novahow in #2303
• Deprecate scopes by @pingsutw in #2671
• Move vscode plugin to flytekit by @pingsutw in #2689
• Add Perian Job Platform agent by @otarabai in #2537
• Fix test_real_config func by unset FLYTE_AWS_ENDPOINT env by @Future-Outlier in #2722
• Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
• Streamline fast register options with new flag by @wild-endeavor in #2690
• fix local test test_list_containing_multiple_annotated_pandas_dataframes fail by @Mecoli1219 in #2725
• add motherduck support for duckdb plugin by @dansola in #2680
• Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
• Better error for min_success_ratio<1 by @pingsutw in #2724
• Fix backfill command by @pingsutw in #2730
• Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
• Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
• Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
• fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
• Imgspec/copy auto by @wild-endeavor in #2731
• GH-5732: Make TypeEngine.lazy_import_transformers() thread safe by @Tom-Newton in #2735
• Revert #2303 by @pingsutw in #2746
• reference lp example for flyteremote by @dansola in #2747
• Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
• Types/generic alias - assert fix only by @wild-endeavor in #2743
• Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
• add ollama to flytekit-inference by @samhita-alla in #2677
• pin duckdb version in plugin by @dansola in #2739
• feat(image_spec): validate container registry names by @pingsutw in #2748
• add resources to input downloader in the ollama plugin by @samhita-alla in #2754
• Read offloaded literals by @eapolinario in #2685
• Fix: Make flyte-iap catch when trying to generate token for service account from user credentials by @fg91 in #2738
• [Bug] Set bindings for ArrayNode by @pvditt in #2742
• [flyteagent] All agents return dict instead of literal map by @Future-Outlier in #2762
• GH-5768: Better pyflyte boolean parsing by @Tom-Newton in #2764
• add dest_dir into pythonpath before loading modules by @arbaobao in #2692
• Fix reading Flyte secrets and using PERIAN secrets param by @otarabai in #2767
• Bump cryptography from 42.0.7 to 43.0.1 by @dependabot in #2736
• [Flyte Decks] support ydata-profiling in python 3.12 by @Future-Outlier in #2766
• Update pyflyte defaults to use --copy behavior by @wild-endeavor in #2755
• Enable Spark Fast Register by @pingsutw in #2765
• Add FlyteNonRecoverableSystemException by @pingsutw in #2700
• [Flytekit] Support extra copy commands in ImageSpec by @mao3267 in #2715
• Revert dev-requirements.in change for MacOS by @Future-Outlier in #2769
• Propagate custom_info Dict through agent Resource by @ddl-ebrown in #2426
• Mock addPyFile in spark test by @pingsutw in #2770
• enabled copy-all for programmatic fast-registration via FlyteRemote by @granthamtaylor in #2768
• Do not copy flytekit itself during fast registration by @thomasjpfan in #2775
• Add correct types to Scalar and Primitive constructors in literals.py by @felixmulder in #2778

New Contributors

• @otarabai made their first contribution in #2537
• @ddl-ebrown made their first contribution in #2426
• @granthamtaylor made their first contribution in #2768
• @felixmulder made their first contribution in #2778

Full Changelog: v1.13.5...v1.13.6

v1.13.6b2

What's Changed

• Read offloaded literals by @eapolinario in #2685

Full Changelog: v1.13.6b1...v1.13.6b2

v1.13.6b1

What's Changed

• pin duckdb version in plugin by @dansola in #2739
• feat(image_spec): validate container registry names by @pingsutw in #2748
• add resources to input downloader in the ollama plugin by @samhita-alla in #2754

Full Changelog: v1.13.6b0...v1.13.6b1

v1.13.6b0

What's Changed

• Core/fix register remote by @novahow in #2303
• Deprecate scopes by @pingsutw in #2671
• Move vscode plugin to flytekit by @pingsutw in #2689
• Add Perian Job Platform agent by @otarabai in #2537
• Fix test_real_config func by unset FLYTE_AWS_ENDPOINT env by @Future-Outlier in #2722
• Re-adding support for mashumaro discriminated classes by @JackUrb in #2613
• Streamline fast register options with new flag by @wild-endeavor in #2690
• fix local test test_list_containing_multiple_annotated_pandas_dataframes fail by @Mecoli1219 in #2725
• add motherduck support for duckdb plugin by @dansola in #2680
• Add deprecation note to pyflyte serialize by @wild-endeavor in #2716
• Better error for min_success_ratio<1 by @pingsutw in #2724
• Fix backfill command by @pingsutw in #2730
• Update eager: make sure client secret can be specified as env var by @cosmicBboy in #2720
• Bump cryptography from 42.0.4 to 43.0.1 in /tests/flytekit/integration/remote/mock_flyte_repo/workflows by @dependabot in #2728
• Feat: Optionally use pigz to speed up tarball compression by @fg91 in #2729
• fix: Calculate the tag based on the name of the base image by @pingsutw in #2740
• Imgspec/copy auto by @wild-endeavor in #2731
• GH-5732: Make TypeEngine.lazy_import_transformers() thread safe by @Tom-Newton in #2735
• Revert #2303 by @pingsutw in #2746
• reference lp example for flyteremote by @dansola in #2747
• Fix Get Literal Type Error for Attribute Access Compile in Flytepropeller by @Future-Outlier in #2749
• Types/generic alias - assert fix only by @wild-endeavor in #2743
• Fix: Prevent UnionTransformer type ambiguity in combination with PyTorchTypeTransformer by @fg91 in #2726
• add ollama to flytekit-inference by @samhita-alla in #2677

New Contributors

• @otarabai made their first contribution in #2537

Full Changelog: v1.13.5...v1.13.6b0