v0.10.4

🐛 Fixes

• Expand default column size for non-integer number fields to DECIMAL (38, 9), resolves issues with too-large number values (#194)

v0.10.3

✨ New Features

• Add fetch_connector_secret() convenience method on GoogleGSMSecretManager. (#191)

🐛 Fixes

• Fix GSM secrets retrieval edge cases, and improve GSM CI tests. (#191)

📖 Docs

• Improve docs around 0.10.x features. (#190)

v0.10.2

🐛 Fix

• Install google secrets library as a main dependency (resolves ImportError). (#189)

v0.10.1

🐛 Fixes

• Resolve failures when loading large dataset by running Snowflake PUT queries sequentially (#188) - Thanks, @SebastienN15!

✨ New Features

• Add parse_json() convenience method on SecretHandle class. (#182)

v0.10.0

✨ New Features

This release focuses on broadening the vision of PyAirbyte, adding capabilities for Airbyte Cloud users to orchestrate their syncs using PyAirbyte. Secrets management is also significantly expanded. Lastly, we improve record parsing of problematic records thanks to a community contribution from @SebastienN15.

☁️ Cloud Interop (#143)

• Add ability to run Airbyte Cloud jobs with CloudWorkspace.run_sync(), which returns a SyncResult object.
• Add ability to check Airbyte Cloud sync statuses, wait for status, check number of records synced, etc.
• Add ability to get CachedDataset objects from completed Airbyte Cloud jobs, and read records from those final tables. (Snowflake and BigQuery only.)

🔐 Secrets Management (#143)

• Add support for "BYO secrets" using CustomSecretsManager.
• Add a new custom secrets manager for Google GSM: GoogleGSMSecretsManager.

🐛 Fixes

• Improve parsing of deeply nested records by adding a fallback json parser (#178) - Thanks, @SebastienN15!!

v0.9.0

🚀 New Features

This release adds new metadata fields to all streams, including a unique record ID (_airbyte_raw_id) and timestamp (_airbyte_extracted_at). This release also adds a feature to auto-add new columns if they are missing from cache tables.

• Add new internal Airbyte columns, aligned with Airbyte Destinations "v2" (#144)
• Auto-add missing columns to Cache tables (#144)
• New StreamRecord class and public records module (#166)

📖 Documentation Updates

• Several new topics added to reference docs (#144, #170):
  • Schema Evolution
  • Table and Field Name Normalization
  • Airbyte-Managed Metadata Columns

v0.8.4

🚀 New Features

• Adapt BigQuery classes to be able to use default credentials (#157) - Thanks, @4sushi!

v0.8.3

🐛 Fixes

• Resolve issue where case-sensitive column pruning removes real columns (#161)

⚙️ Under the Hood

• Refactor: Source.get_records() and Source.read() now use a shared code path for record parsing and name normalization (#161)
• Refactor: Internal batch files (JSONL) now pre-normalize top-level property names (#161)

v0.8.2

🐛 Fixes

• Fix cases where tables are incorrectly reported as missing in the Postgres cache during read() (#149) - Thanks, @tinomerl!
• Improved progress updates, including printing list of streams that have been read (#147)

⚙️ Under the Hood

• Pin orjson to last stable version (#152)

v0.8.1

🐛 Fixes

• Resolve issue where read() would fail if it received unexpected/undeclared top-level properties from a source (#131)

⚙️ Under the Hood

• Bump airbyte-cdk dependency to latest version (#137)