v0.10.0
✨ New Features
This release focuses on broadening the vision of PyAirbyte, adding capabilities for Airbyte Cloud users to orchestrate their syncs using PyAirbyte. Secrets management is also significantly expanded. Lastly, we improve record parsing of problematic records thanks to a community contribution from @SebastienN15.
☁️ Cloud Interop (#143)
- Add ability to run Airbyte Cloud jobs with
CloudWorkspace.run_sync()
, which returns aSyncResult
object. - Add ability to check Airbyte Cloud sync statuses, wait for status, check number of records synced, etc.
- Add ability to get
CachedDataset
objects from completed Airbyte Cloud jobs, and read records from those final tables. (Snowflake and BigQuery only.)
🔐 Secrets Management (#143)
- Add support for "BYO secrets" using
CustomSecretsManager
. - Add a new custom secrets manager for Google GSM:
GoogleGSMSecretsManager
.
🐛 Fixes
- Improve parsing of deeply nested records by adding a fallback
json
parser (#178) - Thanks, @SebastienN15!!