1.9.4
One client
- Release 1.9.4 introduces the enable.streaming.client.optimization option, which is enabled by default.
- With this client optimization, only one client is created for multiple topic partitions per Kafka connector. This feature can reduce client runtime and lower migration cost by creating larger files.
- Note that in a high throughput scenario (for example, 50 MB/s per connector), we recommend that you disable this property if you see an increase in latency or costs.
What's Changed
- Refactor buffer threshold variables and methods to be more consistent by @sfc-gh-rcheng in #639
- [SNOW-840882] Disable flakey streaming client test by @sfc-gh-rcheng in #654
- SNOW-826772 Unification of Snowflake role and user for Snowpipe Streaming by @sfc-gh-japatel in #650
- NO-SNOW Kafka connector supports any encoding, not only UTF-8 by @sfc-gh-japatel in #652
- Upgrade to SDK 2.0.1 and fix corresponding override bdec version test by @sfc-gh-rcheng in #653
- no-snow update Google guava by @sfc-gh-japatel in #655
- enzo-cappa fix: add warn log when a file failed to be ingested by @sfc-gh-rcheng in #656
- Revert removal of TestSchemaEvolutionJson e2e test by @sfc-gh-rcheng in #659
- SNOW-811265 Do not close channel on rebalance by @sfc-gh-japatel in #651
- SNOW-850959: Fix a wrong result issue that offsets are skipped when schematization is enabled by @sfc-gh-tzhang in #658
- [SNOW-857447] Enable one client optimization by default by @sfc-gh-rcheng in #665
- Release version 1.9.4 by @sfc-gh-rcheng in #666
Changes made but reverted
- Add, attempt fix and ultimately remove flakey CLA bot
- Fix cla bot by using correct github token by @sfc-gh-rcheng in #640
- Remove CLA bot and update README.md to include cla and formatter requirements by @sfc-gh-rcheng in #643
- Change Kafka put and precommit log level to info and then revert
- Revert kafka put and precommit log message to info by @sfc-gh-rcheng in #637
- NO-SNOW Too many info logs for successfully called put and precommit,… by @sfc-gh-japatel in #660
Full Changelog: v1.9.3...v1.9.4