diff --git a/.github/PULL_REQUEST_TEMPLATE/maintainer_pull_request_template.md b/.github/PULL_REQUEST_TEMPLATE/maintainer_pull_request_template.md index 768ac3f..1e22b09 100644 --- a/.github/PULL_REQUEST_TEMPLATE/maintainer_pull_request_template.md +++ b/.github/PULL_REQUEST_TEMPLATE/maintainer_pull_request_template.md @@ -4,48 +4,27 @@ **This PR will result in the following new package version:** -**Please detail what change(s) this PR introduces and any additional information that should be known during the review of this PR:** +**Please provide the finalized CHANGELOG entry which details the relevant changes included in this PR:** + ## PR Checklist ### Basic Validation Please acknowledge that you have successfully performed the following commands locally: -- [ ] dbt compile -- [ ] dbt run –full-refresh -- [ ] dbt run -- [ ] dbt test -- [ ] dbt run –vars (if applicable) +- [ ] dbt run –full-refresh && dbt test +- [ ] dbt run (if incremental models are present) && dbt test Before marking this PR as "ready for review" the following have been applied: -- [ ] The appropriate issue has been linked and tagged -- [ ] You are assigned to the corresponding issue and this PR +- [ ] The appropriate issue has been linked, tagged, and properly assigned +- [ ] All necessary documentation and version upgrades have been applied + +- [ ] docs were regenerated (unless this PR does not include any code or yml updates) - [ ] BuildKite integration tests are passing +- [ ] Detailed validation steps have been provided below ### Detailed Validation -Please acknowledge that the following validation checks have been performed prior to marking this PR as "ready for review": -- [ ] You have validated these changes and assure this PR will address the respective Issue/Feature. -- [ ] You are reasonably confident these changes will not impact any other components of this package or any dependent packages. -- [ ] You have provided details below around the validation steps performed to gain confidence in these changes. +Please share any and all of your validation steps: -### Standard Updates -Please acknowledge that your PR contains the following standard updates: -- Package versioning has been appropriately indexed in the following locations: - - [ ] indexed within dbt_project.yml - - [ ] indexed within integration_tests/dbt_project.yml -- [ ] CHANGELOG has individual entries for each respective change in this PR - -- [ ] README updates have been applied (if applicable) - -- [ ] DECISIONLOG updates have been updated (if applicable) -- [ ] Appropriate yml documentation has been added (if applicable) - -### dbt Docs -Please acknowledge that after the above were all completed the below were applied to your branch: -- [ ] docs were regenerated (unless this PR does not include any code or yml updates) - ### If you had to summarize this PR in an emoji, which would it be? -:dancer: +:dancer: \ No newline at end of file diff --git a/.github/workflows/auto-release.yml b/.github/workflows/auto-release.yml new file mode 100644 index 0000000..8ed5853 --- /dev/null +++ b/.github/workflows/auto-release.yml @@ -0,0 +1,13 @@ +name: 'auto release' +on: + pull_request: + types: + - closed + branches: + - main + +jobs: + call-workflow-passing-data: + if: github.event.pull_request.merged + uses: fivetran/dbt_package_automations/.github/workflows/auto-release.yml@main + secrets: inherit \ No newline at end of file diff --git a/CHANGELOG.md b/CHANGELOG.md index a2453b6..100d41e 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,44 @@ +# dbt_marketo_source v0.11.0 +[PR #35](https://github.com/fivetran/dbt_marketo_source/pull/35) includes the following updates: + +## Feature Updates (includes 🚨 breaking changes 🚨) +- Ensures that `stg_marketo__lead` has and documents the below columns, all [standard](https://developers.marketo.com/rest-api/lead-database/fields/list-of-standard-fields/) fields from Marketo. Previously, peristed all fields found in your `LEAD` source table but only _ensured_ that the `id`, `created_at`, `updated_at`, `email`, `first_name`, `last_name`, and `_fivetran_synced` fields were included. If any of the following default columns are missing from your `LEAD` table, `stg_marketo__lead` will create a NULL version with the proper data type: + - `phone` + - `main_phone` + - `mobile_phone` + - `company` + - `inferred_company` + - `address_lead` + - `address` + - `city` + - `state` + - `state_code` + - `country` + - `country_code` + - `postal_code` + - `billing_street` + - `billing_city` + - `billing_state` + - `billing_state_code` + - `billing_country` + - `billing_country_code` + - `billing_postal_code` + - `inferred_city` + - `inferred_state_region` + - `inferred_country` + - `inferred_postal_code` + - `inferred_phone_area_code` + - `anonymous_ip` + - `unsubscribed` -> aliased as `is_unsubscribed` (🚨 breaking change 🚨) + - `email_invalid` -> aliased as `is_email_invalid` (🚨 breaking change 🚨) + - `do_not_call` + +> Note: the above fields will persist downstream into the [transform](https://github.com/fivetran/dbt_marketo/blob/main/models/marketo__leads.sql) `marketo__leads` model. + +## Under the Hood +- Updated the maintainer PR template to resemble the most up to date format. +- Included auto-releaser GitHub Actions workflow to automate future releases. + # dbt_marketo_source v0.10.0 ## 🚨 Breaking Changes 🚨: [PR #33](https://github.com/fivetran/dbt_marketo_source/pull/33) includes the following updates in connection with the Fivetran Marketo connector's [June 2023](https://fivetran.com/docs/applications/marketo/changelog#june2023) and [May 2023](https://fivetran.com/docs/applications/marketo/changelog#may2023) releases: diff --git a/README.md b/README.md index 2db3137..b00a4b6 100644 --- a/README.md +++ b/README.md @@ -43,7 +43,7 @@ If you are **not** using the [Marketo transformation package](https://github.co ```yml packages: - package: fivetran/marketo_source - version: [">=0.10.0", "<0.11.0"] + version: [">=0.11.0", "<0.12.0"] ``` ## Step 3: Define database and schema variables diff --git a/dbt_project.yml b/dbt_project.yml index 6457d2c..7ce2400 100644 --- a/dbt_project.yml +++ b/dbt_project.yml @@ -1,5 +1,5 @@ name: 'marketo_source' -version: '0.10.0' +version: '0.11.0' config-version: 2 require-dbt-version: [">=1.3.0", "<2.0.0"] models: diff --git a/docs/catalog.json b/docs/catalog.json index acb5c63..c557a1c 100644 --- a/docs/catalog.json +++ b/docs/catalog.json @@ -1 +1 @@ -{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/catalog/v1.json", "dbt_version": "1.5.2", "generated_at": "2023-07-10T15:59:19.917643Z", "invocation_id": "a54949a1-70a0-4ef8-9821-109da0cc584f", "env": {}}, "nodes": {"seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_change_data_value_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "integer", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "integer", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "integer", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "integer", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "text", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "text", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "text", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "integer", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "text", "index": 14, "name": "source", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data"}, "seed.marketo_source_integration_tests.marketo_activity_click_email_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_click_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "text", "index": 11, "name": "link", "comment": null}, "platform": {"type": "text", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_delete_lead_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "text", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign": {"type": "text", "index": 5, "name": "campaign", "comment": null}, "campaign_id": {"type": "integer", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data"}, "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_bounced_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "integer", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "integer", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "text", "index": 7, "name": "details", "comment": null}, "email": {"type": "text", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "integer", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "integer", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data"}, "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_delivered_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data"}, "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_merge_leads_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "text", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "boolean", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "text", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "text", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "boolean", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "text", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data"}, "seed.marketo_source_integration_tests.marketo_activity_open_email_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_open_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "text", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_send_email_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_send_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_unsubscribe_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "text", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "text", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "text", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "text", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "text", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "integer", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "integer", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data"}, "seed.marketo_source_integration_tests.marketo_campaign_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_campaign_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"active": {"type": "boolean", "index": 1, "name": "active", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 3, "name": "description", "comment": null}, "id": {"type": "integer", "index": 4, "name": "id", "comment": null}, "name": {"type": "text", "index": 5, "name": "name", "comment": null}, "program_id": {"type": "integer", "index": 6, "name": "program_id", "comment": null}, "type": {"type": "text", "index": 7, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 8, "name": "updated_at", "comment": null}, "workspace_name": {"type": "text", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "text", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "integer", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "integer", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "boolean", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "boolean", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "boolean", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "integer", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "text", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "integer", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "text", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "text", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "integer", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "text", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "integer", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "boolean", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "integer", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "integer", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "integer", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "integer", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "text", "index": 30, "name": "status", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 31, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data"}, "seed.marketo_source_integration_tests.marketo_email_template_history_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_email_template_history_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"created_at": {"type": "text", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "text", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "integer", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "integer", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "text", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "text", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "integer", "index": 9, "name": "id", "comment": null}, "name": {"type": "text", "index": 10, "name": "name", "comment": null}, "operational": {"type": "boolean", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "integer", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "boolean", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "text", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "text", "index": 15, "name": "status", "comment": null}, "subject": {"type": "text", "index": 16, "name": "subject", "comment": null}, "template": {"type": "integer", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "boolean", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "text", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 20, "name": "url", "comment": null}, "version": {"type": "integer", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "boolean", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "text", "index": 23, "name": "workspace", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data"}, "seed.marketo_source_integration_tests.marketo_lead_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "text", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "text", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "text", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "text", "index": 6, "name": "last_name", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data"}, "seed.marketo_source_integration_tests.marketo_lead_describe_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_describe_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"data_type": {"type": "text", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "text", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "integer", "index": 3, "name": "id", "comment": null}, "length": {"type": "integer", "index": 4, "name": "length", "comment": null}, "restname": {"type": "text", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "boolean", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "text", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "boolean", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data"}, "seed.marketo_source_integration_tests.marketo_program_data": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_program_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "channel": {"type": "text", "index": 2, "name": "channel", "comment": null}, "created_at": {"type": "text", "index": 3, "name": "created_at", "comment": null}, "description": {"type": "integer", "index": 4, "name": "description", "comment": null}, "end_date": {"type": "integer", "index": 5, "name": "end_date", "comment": null}, "name": {"type": "text", "index": 6, "name": "name", "comment": null}, "sfdc_id": {"type": "text", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "text", "index": 8, "name": "sfdc_name", "comment": null}, "start_date": {"type": "integer", "index": 9, "name": "start_date", "comment": null}, "status": {"type": "text", "index": 10, "name": "status", "comment": null}, "type": {"type": "text", "index": 11, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 12, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "text", "index": 14, "name": "workspace", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 15, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_program_data"}, "model.marketo_source.stg_marketo__activity_change_data_value": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_change_data_value", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "integer", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "integer", "index": 4, "name": "campaign_id", "comment": null}, "activity_id": {"type": "integer", "index": 5, "name": "activity_id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "modifying_user_id": {"type": "integer", "index": 7, "name": "modifying_user_id", "comment": null}, "new_value": {"type": "text", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "text", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "change_reason": {"type": "text", "index": 12, "name": "change_reason", "comment": null}, "request_id": {"type": "integer", "index": 13, "name": "request_id", "comment": null}, "change_source": {"type": "text", "index": 14, "name": "change_source", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value"}, "model.marketo_source.stg_marketo__activity_change_data_value_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_change_data_value_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "integer", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "integer", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "integer", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "integer", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "text", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "text", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "text", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "integer", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "text", "index": 14, "name": "source", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp"}, "model.marketo_source.stg_marketo__activity_click_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_click_email", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "click_device": {"type": "text", "index": 6, "name": "click_device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "activity_id": {"type": "integer", "index": 8, "name": "activity_id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "click_link_url": {"type": "text", "index": 11, "name": "click_link_url", "comment": null}, "user_platform": {"type": "text", "index": 12, "name": "user_platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 16, "name": "user_agent", "comment": null}, "email_send_id": {"type": "text", "index": 17, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_click_email"}, "model.marketo_source.stg_marketo__activity_click_email_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_click_email_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "text", "index": 11, "name": "link", "comment": null}, "platform": {"type": "text", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp"}, "model.marketo_source.stg_marketo__activity_email_bounced": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_bounced", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "bounce_category": {"type": "integer", "index": 5, "name": "bounce_category", "comment": null}, "choice_number": {"type": "integer", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "text", "index": 7, "name": "details", "comment": null}, "email_address": {"type": "text", "index": 8, "name": "email_address", "comment": null}, "email_template_id": {"type": "integer", "index": 9, "name": "email_template_id", "comment": null}, "activity_id": {"type": "integer", "index": 10, "name": "activity_id", "comment": null}, "lead_id": {"type": "integer", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "bounce_subcategory": {"type": "integer", "index": 15, "name": "bounce_subcategory", "comment": null}, "email_send_id": {"type": "text", "index": 16, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced"}, "model.marketo_source.stg_marketo__activity_email_bounced_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_bounced_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "integer", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "integer", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "text", "index": 7, "name": "details", "comment": null}, "email": {"type": "text", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "integer", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "integer", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp"}, "model.marketo_source.stg_marketo__activity_email_delivered": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_delivered", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "activity_id": {"type": "integer", "index": 7, "name": "activity_id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}, "email_send_id": {"type": "text", "index": 12, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered"}, "model.marketo_source.stg_marketo__activity_email_delivered_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_delivered_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp"}, "model.marketo_source.stg_marketo__activity_merge_leads": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_merge_leads", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_id": {"type": "integer", "index": 1, "name": "activity_id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_timestamp": {"type": "timestamp without time zone", "index": 3, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "boolean", "index": 7, "name": "master_updated", "comment": null}, "merged_lead_id": {"type": "text", "index": 8, "name": "merged_lead_id", "comment": null}, "merge_source": {"type": "text", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "boolean", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "text", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads"}, "model.marketo_source.stg_marketo__activity_merge_leads_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_merge_leads_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "text", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "boolean", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "text", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "text", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "boolean", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "text", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp"}, "model.marketo_source.stg_marketo__activity_open_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_open_email", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "activity_id": {"type": "integer", "index": 8, "name": "activity_id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "text", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 15, "name": "user_agent", "comment": null}, "email_send_id": {"type": "text", "index": 16, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_open_email"}, "model.marketo_source.stg_marketo__activity_open_email_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_open_email_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "text", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp"}, "model.marketo_source.stg_marketo__activity_send_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_send_email", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "activity_id": {"type": "integer", "index": 7, "name": "activity_id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}, "email_send_id": {"type": "text", "index": 12, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_send_email"}, "model.marketo_source.stg_marketo__activity_send_email_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_send_email_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp"}, "model.marketo_source.stg_marketo__activity_unsubscribe_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_unsubscribe_email", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_timestamp": {"type": "timestamp without time zone", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "text", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "text", "index": 7, "name": "form_fields", "comment": null}, "activity_id": {"type": "integer", "index": 8, "name": "activity_id", "comment": null}, "lead_id": {"type": "integer", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "text", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "text", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "text", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "integer", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "integer", "index": 16, "name": "webpage_id", "comment": null}, "email_send_id": {"type": "text", "index": 17, "name": "email_send_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_unsubscribe_email_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "text", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "text", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "text", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "text", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "text", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "integer", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "integer", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"}, "model.marketo_source.stg_marketo__campaign_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__campaign_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"active": {"type": "boolean", "index": 1, "name": "active", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 3, "name": "description", "comment": null}, "id": {"type": "integer", "index": 4, "name": "id", "comment": null}, "name": {"type": "text", "index": 5, "name": "name", "comment": null}, "program_id": {"type": "integer", "index": 6, "name": "program_id", "comment": null}, "type": {"type": "text", "index": 7, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 8, "name": "updated_at", "comment": null}, "workspace_name": {"type": "text", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "text", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "integer", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "integer", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "boolean", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "boolean", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "boolean", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "integer", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "text", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "integer", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "text", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "text", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "integer", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "text", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "integer", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "boolean", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "integer", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "integer", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "integer", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "integer", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "text", "index": 30, "name": "status", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 31, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__campaign_tmp"}, "model.marketo_source.stg_marketo__campaigns": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__campaigns", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"is_active": {"type": "boolean", "index": 1, "name": "is_active", "comment": null}, "created_timestamp": {"type": "text", "index": 2, "name": "created_timestamp", "comment": null}, "description": {"type": "text", "index": 3, "name": "description", "comment": null}, "campaign_id": {"type": "integer", "index": 4, "name": "campaign_id", "comment": null}, "campaign_name": {"type": "text", "index": 5, "name": "campaign_name", "comment": null}, "program_id": {"type": "integer", "index": 6, "name": "program_id", "comment": null}, "campaign_type": {"type": "text", "index": 7, "name": "campaign_type", "comment": null}, "updated_timestamp": {"type": "text", "index": 8, "name": "updated_timestamp", "comment": null}, "workspace_name": {"type": "text", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "text", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "integer", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "integer", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "boolean", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "boolean", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "boolean", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "integer", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "text", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "integer", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "text", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "text", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "integer", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "text", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "integer", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "boolean", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "integer", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "integer", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "integer", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "integer", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "text", "index": 30, "name": "status", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__campaigns"}, "model.marketo_source.stg_marketo__email_template_history": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__email_template_history", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"created_timestamp": {"type": "text", "index": 1, "name": "created_timestamp", "comment": null}, "description": {"type": "text", "index": 2, "name": "description", "comment": null}, "folder_name": {"type": "text", "index": 3, "name": "folder_name", "comment": null}, "folder_id": {"type": "integer", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "integer", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "text", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "text", "index": 8, "name": "from_name", "comment": null}, "email_template_id": {"type": "integer", "index": 9, "name": "email_template_id", "comment": null}, "email_template_name": {"type": "text", "index": 10, "name": "email_template_name", "comment": null}, "is_operational": {"type": "boolean", "index": 11, "name": "is_operational", "comment": null}, "program_id": {"type": "integer", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "boolean", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "text", "index": 14, "name": "reply_email", "comment": null}, "email_template_status": {"type": "text", "index": 15, "name": "email_template_status", "comment": null}, "email_subject": {"type": "text", "index": 16, "name": "email_subject", "comment": null}, "parent_template_id": {"type": "integer", "index": 17, "name": "parent_template_id", "comment": null}, "is_text_only": {"type": "boolean", "index": 18, "name": "is_text_only", "comment": null}, "updated_timestamp": {"type": "text", "index": 19, "name": "updated_timestamp", "comment": null}, "email_template_url": {"type": "text", "index": 20, "name": "email_template_url", "comment": null}, "version_type": {"type": "integer", "index": 21, "name": "version_type", "comment": null}, "has_web_view_enabled": {"type": "boolean", "index": 22, "name": "has_web_view_enabled", "comment": null}, "workspace_name": {"type": "text", "index": 23, "name": "workspace_name", "comment": null}, "inferred_version": {"type": "bigint", "index": 24, "name": "inferred_version", "comment": null}, "total_count_of_versions": {"type": "bigint", "index": 25, "name": "total_count_of_versions", "comment": null}, "valid_from": {"type": "text", "index": 26, "name": "valid_from", "comment": null}, "valid_to": {"type": "text", "index": 27, "name": "valid_to", "comment": null}, "is_most_recent_version": {"type": "boolean", "index": 28, "name": "is_most_recent_version", "comment": null}, "email_template_history_id": {"type": "text", "index": 29, "name": "email_template_history_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__email_template_history"}, "model.marketo_source.stg_marketo__email_template_history_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__email_template_history_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"created_at": {"type": "text", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "text", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "integer", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "integer", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "text", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "text", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "integer", "index": 9, "name": "id", "comment": null}, "name": {"type": "text", "index": 10, "name": "name", "comment": null}, "operational": {"type": "boolean", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "integer", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "boolean", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "text", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "text", "index": 15, "name": "status", "comment": null}, "subject": {"type": "text", "index": 16, "name": "subject", "comment": null}, "template": {"type": "integer", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "boolean", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "text", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 20, "name": "url", "comment": null}, "version": {"type": "integer", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "boolean", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "text", "index": 23, "name": "workspace", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp"}, "model.marketo_source.stg_marketo__lead": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"lead_id": {"type": "integer", "index": 1, "name": "lead_id", "comment": null}, "created_timestamp": {"type": "text", "index": 2, "name": "created_timestamp", "comment": null}, "updated_timestamp": {"type": "text", "index": 3, "name": "updated_timestamp", "comment": null}, "email": {"type": "text", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "text", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "text", "index": 6, "name": "last_name", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead"}, "model.marketo_source.stg_marketo__lead_describe": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_describe", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"data_type": {"type": "text", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "text", "index": 2, "name": "display_name", "comment": null}, "lead_describe_id": {"type": "integer", "index": 3, "name": "lead_describe_id", "comment": null}, "field_max_length": {"type": "integer", "index": 4, "name": "field_max_length", "comment": null}, "rest_name": {"type": "text", "index": 5, "name": "rest_name", "comment": null}, "is_rest_readonly": {"type": "boolean", "index": 6, "name": "is_rest_readonly", "comment": null}, "soap_name": {"type": "text", "index": 7, "name": "soap_name", "comment": null}, "is_soap_readonly": {"type": "boolean", "index": 8, "name": "is_soap_readonly", "comment": null}, "rest_name_xf": {"type": "text", "index": 9, "name": "rest_name_xf", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_describe"}, "model.marketo_source.stg_marketo__lead_describe_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_describe_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"data_type": {"type": "text", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "text", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "integer", "index": 3, "name": "id", "comment": null}, "length": {"type": "integer", "index": 4, "name": "length", "comment": null}, "restname": {"type": "text", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "boolean", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "text", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "boolean", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp"}, "model.marketo_source.stg_marketo__lead_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "text", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "text", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "text", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "text", "index": 6, "name": "last_name", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_tmp"}, "model.marketo_source.stg_marketo__program": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__program", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"program_id": {"type": "integer", "index": 1, "name": "program_id", "comment": null}, "channel": {"type": "text", "index": 2, "name": "channel", "comment": null}, "created_timestamp": {"type": "text", "index": 3, "name": "created_timestamp", "comment": null}, "description": {"type": "integer", "index": 4, "name": "description", "comment": null}, "end_timestamp": {"type": "integer", "index": 5, "name": "end_timestamp", "comment": null}, "program_name": {"type": "text", "index": 6, "name": "program_name", "comment": null}, "sfdc_id": {"type": "text", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "text", "index": 8, "name": "sfdc_name", "comment": null}, "start_timestamp": {"type": "integer", "index": 9, "name": "start_timestamp", "comment": null}, "program_status": {"type": "text", "index": 10, "name": "program_status", "comment": null}, "program_type": {"type": "text", "index": 11, "name": "program_type", "comment": null}, "updated_timestamp": {"type": "text", "index": 12, "name": "updated_timestamp", "comment": null}, "url": {"type": "text", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "text", "index": 14, "name": "workspace", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__program"}, "model.marketo_source.stg_marketo__program_tmp": {"metadata": {"type": "VIEW", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__program_tmp", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "channel": {"type": "text", "index": 2, "name": "channel", "comment": null}, "created_at": {"type": "text", "index": 3, "name": "created_at", "comment": null}, "description": {"type": "integer", "index": 4, "name": "description", "comment": null}, "end_date": {"type": "integer", "index": 5, "name": "end_date", "comment": null}, "name": {"type": "text", "index": 6, "name": "name", "comment": null}, "sfdc_id": {"type": "text", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "text", "index": 8, "name": "sfdc_name", "comment": null}, "start_date": {"type": "integer", "index": 9, "name": "start_date", "comment": null}, "status": {"type": "text", "index": 10, "name": "status", "comment": null}, "type": {"type": "text", "index": 11, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 12, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "text", "index": 14, "name": "workspace", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 15, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__program_tmp"}}, "sources": {"source.marketo_source.marketo.activity_change_data_value": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_change_data_value_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "integer", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "integer", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "integer", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "integer", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "text", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "text", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "text", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "integer", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "text", "index": 14, "name": "source", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_change_data_value"}, "source.marketo_source.marketo.activity_click_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_click_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "text", "index": 11, "name": "link", "comment": null}, "platform": {"type": "text", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_click_email"}, "source.marketo_source.marketo.activity_delete_lead": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_delete_lead_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "text", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign": {"type": "text", "index": 5, "name": "campaign", "comment": null}, "campaign_id": {"type": "integer", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_delete_lead"}, "source.marketo_source.marketo.activity_email_bounced": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_bounced_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "integer", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "integer", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "text", "index": 7, "name": "details", "comment": null}, "email": {"type": "text", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "integer", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "integer", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_email_bounced"}, "source.marketo_source.marketo.activity_email_delivered": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_delivered_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_email_delivered"}, "source.marketo_source.marketo.activity_merge_leads": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_merge_leads_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "text", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "text", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "integer", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "boolean", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "text", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "text", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "boolean", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "text", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_merge_leads"}, "source.marketo_source.marketo.activity_open_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_open_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "text", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "integer", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "boolean", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "integer", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "text", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "text", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "integer", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "text", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_open_email"}, "source.marketo_source.marketo.activity_send_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_send_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "integer", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "integer", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "integer", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_send_email"}, "source.marketo_source.marketo.activity_unsubscribe_email": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_unsubscribe_email_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"activity_date": {"type": "text", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "integer", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "integer", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "integer", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "text", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "integer", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "text", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "integer", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "integer", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "text", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "integer", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "text", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "text", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "text", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "integer", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "integer", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_unsubscribe_email"}, "source.marketo_source.marketo.campaign": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_campaign_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"active": {"type": "boolean", "index": 1, "name": "active", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 3, "name": "description", "comment": null}, "id": {"type": "integer", "index": 4, "name": "id", "comment": null}, "name": {"type": "text", "index": 5, "name": "name", "comment": null}, "program_id": {"type": "integer", "index": 6, "name": "program_id", "comment": null}, "type": {"type": "text", "index": 7, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 8, "name": "updated_at", "comment": null}, "workspace_name": {"type": "text", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "text", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "integer", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "integer", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "boolean", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "boolean", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "boolean", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "integer", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "text", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "integer", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "text", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "text", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "integer", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "text", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "integer", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "boolean", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "integer", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "integer", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "integer", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "integer", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "text", "index": 30, "name": "status", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 31, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.campaign"}, "source.marketo_source.marketo.email_template_history": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_email_template_history_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"created_at": {"type": "text", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "text", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "text", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "integer", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "text", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "integer", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "text", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "text", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "integer", "index": 9, "name": "id", "comment": null}, "name": {"type": "text", "index": 10, "name": "name", "comment": null}, "operational": {"type": "boolean", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "integer", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "boolean", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "text", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "text", "index": 15, "name": "status", "comment": null}, "subject": {"type": "text", "index": 16, "name": "subject", "comment": null}, "template": {"type": "integer", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "boolean", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "text", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 20, "name": "url", "comment": null}, "version": {"type": "integer", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "boolean", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "text", "index": 23, "name": "workspace", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.email_template_history"}, "source.marketo_source.marketo.lead": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "text", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "text", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "text", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "text", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "text", "index": 6, "name": "last_name", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.lead"}, "source.marketo_source.marketo.lead_describe": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_describe_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"data_type": {"type": "text", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "text", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "integer", "index": 3, "name": "id", "comment": null}, "length": {"type": "integer", "index": 4, "name": "length", "comment": null}, "restname": {"type": "text", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "boolean", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "text", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "boolean", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.lead_describe"}, "source.marketo_source.marketo.program": {"metadata": {"type": "BASE TABLE", "schema": "marketo_source_integration_tests_8", "name": "marketo_program_data", "database": "postgres", "comment": null, "owner": "pguser"}, "columns": {"id": {"type": "integer", "index": 1, "name": "id", "comment": null}, "channel": {"type": "text", "index": 2, "name": "channel", "comment": null}, "created_at": {"type": "text", "index": 3, "name": "created_at", "comment": null}, "description": {"type": "integer", "index": 4, "name": "description", "comment": null}, "end_date": {"type": "integer", "index": 5, "name": "end_date", "comment": null}, "name": {"type": "text", "index": 6, "name": "name", "comment": null}, "sfdc_id": {"type": "text", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "text", "index": 8, "name": "sfdc_name", "comment": null}, "start_date": {"type": "integer", "index": 9, "name": "start_date", "comment": null}, "status": {"type": "text", "index": 10, "name": "status", "comment": null}, "type": {"type": "text", "index": 11, "name": "type", "comment": null}, "updated_at": {"type": "text", "index": 12, "name": "updated_at", "comment": null}, "url": {"type": "text", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "text", "index": 14, "name": "workspace", "comment": null}, "_fivetran_deleted": {"type": "boolean", "index": 15, "name": "_fivetran_deleted", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.program"}}, "errors": null} \ No newline at end of file +{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/catalog/v1.json", "dbt_version": "1.7.8", "generated_at": "2024-02-29T15:28:19.561731Z", "invocation_id": "9b425e78-4d62-4b80-9b3f-a4c4a37e5435", "env": {}}, "nodes": {"seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_change_data_value_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "INT64", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "INT64", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "INT64", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "INT64", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "STRING", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "STRING", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "STRING", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "INT64", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "STRING", "index": 14, "name": "source", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 16556, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data"}, "seed.marketo_source_integration_tests.marketo_activity_click_email_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_click_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "STRING", "index": 11, "name": "link", "comment": null}, "platform": {"type": "STRING", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 31660, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_delete_lead_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign": {"type": "STRING", "index": 5, "name": "campaign", "comment": null}, "campaign_id": {"type": "INT64", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 31, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 4650, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data"}, "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_email_bounced_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "INT64", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "INT64", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "STRING", "index": 7, "name": "details", "comment": null}, "email": {"type": "STRING", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "INT64", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "INT64", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 29624, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data"}, "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_email_delivered_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13100, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data"}, "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_merge_leads_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "BOOL", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "STRING", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "STRING", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "BOOL", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13397, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data"}, "seed.marketo_source_integration_tests.marketo_activity_open_email_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_open_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "STRING", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 25196, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_send_email_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_send_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13100, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data"}, "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_unsubscribe_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "STRING", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "STRING", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "STRING", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "STRING", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "STRING", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "INT64", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "INT64", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 67477, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data"}, "seed.marketo_source_integration_tests.marketo_campaign_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_campaign_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"active": {"type": "BOOL", "index": 1, "name": "active", "comment": null}, "created_at": {"type": "STRING", "index": 2, "name": "created_at", "comment": null}, "description": {"type": "STRING", "index": 3, "name": "description", "comment": null}, "id": {"type": "INT64", "index": 4, "name": "id", "comment": null}, "name": {"type": "STRING", "index": 5, "name": "name", "comment": null}, "program_id": {"type": "INT64", "index": 6, "name": "program_id", "comment": null}, "type": {"type": "STRING", "index": 7, "name": "type", "comment": null}, "updated_at": {"type": "STRING", "index": 8, "name": "updated_at", "comment": null}, "workspace_name": {"type": "STRING", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "STRING", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "INT64", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "INT64", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "BOOL", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "BOOL", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "BOOL", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "INT64", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "STRING", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "INT64", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "STRING", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "STRING", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "INT64", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "STRING", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "INT64", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "BOOL", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "INT64", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "INT64", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "INT64", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "INT64", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "STRING", "index": 30, "name": "status", "comment": null}, "_fivetran_deleted": {"type": "BOOL", "index": 31, "name": "_fivetran_deleted", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 18079, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data"}, "seed.marketo_source_integration_tests.marketo_email_template_history_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_email_template_history_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"created_at": {"type": "STRING", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "STRING", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "STRING", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "INT64", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "INT64", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "STRING", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "STRING", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "INT64", "index": 9, "name": "id", "comment": null}, "name": {"type": "STRING", "index": 10, "name": "name", "comment": null}, "operational": {"type": "BOOL", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "INT64", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "BOOL", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "STRING", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "STRING", "index": 15, "name": "status", "comment": null}, "subject": {"type": "STRING", "index": 16, "name": "subject", "comment": null}, "template": {"type": "INT64", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "BOOL", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "STRING", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "STRING", "index": 20, "name": "url", "comment": null}, "version": {"type": "INT64", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "BOOL", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "STRING", "index": 23, "name": "workspace", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 34691, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data"}, "seed.marketo_source_integration_tests.marketo_lead_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_lead_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "STRING", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "STRING", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "STRING", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "STRING", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "STRING", "index": 6, "name": "last_name", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 10500, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data"}, "seed.marketo_source_integration_tests.marketo_lead_describe_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_lead_describe_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"data_type": {"type": "STRING", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "STRING", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "INT64", "index": 3, "name": "id", "comment": null}, "length": {"type": "INT64", "index": 4, "name": "length", "comment": null}, "restname": {"type": "STRING", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "BOOL", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "STRING", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "BOOL", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 6651, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data"}, "seed.marketo_source_integration_tests.marketo_program_data": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_program_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "channel": {"type": "STRING", "index": 2, "name": "channel", "comment": null}, "created_at": {"type": "STRING", "index": 3, "name": "created_at", "comment": null}, "description": {"type": "INT64", "index": 4, "name": "description", "comment": null}, "end_date": {"type": "INT64", "index": 5, "name": "end_date", "comment": null}, "name": {"type": "STRING", "index": 6, "name": "name", "comment": null}, "sfdc_id": {"type": "STRING", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "STRING", "index": 8, "name": "sfdc_name", "comment": null}, "start_date": {"type": "INT64", "index": 9, "name": "start_date", "comment": null}, "status": {"type": "STRING", "index": 10, "name": "status", "comment": null}, "type": {"type": "STRING", "index": 11, "name": "type", "comment": null}, "updated_at": {"type": "STRING", "index": 12, "name": "updated_at", "comment": null}, "url": {"type": "STRING", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "STRING", "index": 14, "name": "workspace", "comment": null}, "_fivetran_deleted": {"type": "BOOL", "index": 15, "name": "_fivetran_deleted", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 16936, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "seed.marketo_source_integration_tests.marketo_program_data"}, "model.marketo_source.stg_marketo__activity_change_data_value": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_change_data_value", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "INT64", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "INT64", "index": 4, "name": "campaign_id", "comment": null}, "activity_id": {"type": "INT64", "index": 5, "name": "activity_id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "modifying_user_id": {"type": "INT64", "index": 7, "name": "modifying_user_id", "comment": null}, "new_value": {"type": "STRING", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "STRING", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "change_reason": {"type": "STRING", "index": 12, "name": "change_reason", "comment": null}, "request_id": {"type": "INT64", "index": 13, "name": "request_id", "comment": null}, "change_source": {"type": "STRING", "index": 14, "name": "change_source", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 14856, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value"}, "model.marketo_source.stg_marketo__activity_change_data_value_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_change_data_value_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "INT64", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "INT64", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "INT64", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "INT64", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "STRING", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "STRING", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "STRING", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "INT64", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "STRING", "index": 14, "name": "source", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp"}, "model.marketo_source.stg_marketo__activity_click_email": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_click_email", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "click_device": {"type": "STRING", "index": 6, "name": "click_device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "activity_id": {"type": "INT64", "index": 8, "name": "activity_id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "click_link_url": {"type": "STRING", "index": 11, "name": "click_link_url", "comment": null}, "user_platform": {"type": "STRING", "index": 12, "name": "user_platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 16, "name": "user_agent", "comment": null}, "email_send_id": {"type": "STRING", "index": 17, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 33360, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_click_email"}, "model.marketo_source.stg_marketo__activity_click_email_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_click_email_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "STRING", "index": 11, "name": "link", "comment": null}, "platform": {"type": "STRING", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp"}, "model.marketo_source.stg_marketo__activity_delete_lead": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_delete_lead", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_id": {"type": "INT64", "index": 1, "name": "activity_id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_timestamp": {"type": "TIMESTAMP", "index": 3, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_name": {"type": "STRING", "index": 5, "name": "campaign_name", "comment": null}, "campaign_id": {"type": "INT64", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 31, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 4123, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead"}, "model.marketo_source.stg_marketo__activity_delete_lead_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_delete_lead_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign": {"type": "STRING", "index": 5, "name": "campaign", "comment": null}, "campaign_id": {"type": "INT64", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead_tmp"}, "model.marketo_source.stg_marketo__activity_email_bounced": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_bounced", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "bounce_category": {"type": "INT64", "index": 5, "name": "bounce_category", "comment": null}, "choice_number": {"type": "INT64", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "STRING", "index": 7, "name": "details", "comment": null}, "email_address": {"type": "STRING", "index": 8, "name": "email_address", "comment": null}, "email_template_id": {"type": "INT64", "index": 9, "name": "email_template_id", "comment": null}, "activity_id": {"type": "INT64", "index": 10, "name": "activity_id", "comment": null}, "lead_id": {"type": "INT64", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "bounce_subcategory": {"type": "INT64", "index": 15, "name": "bounce_subcategory", "comment": null}, "email_send_id": {"type": "STRING", "index": 16, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 31324, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced"}, "model.marketo_source.stg_marketo__activity_email_bounced_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_bounced_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "INT64", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "INT64", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "STRING", "index": 7, "name": "details", "comment": null}, "email": {"type": "STRING", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "INT64", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "INT64", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp"}, "model.marketo_source.stg_marketo__activity_email_delivered": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_delivered", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "activity_id": {"type": "INT64", "index": 7, "name": "activity_id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}, "email_send_id": {"type": "STRING", "index": 12, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 14800, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered"}, "model.marketo_source.stg_marketo__activity_email_delivered_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_delivered_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp"}, "model.marketo_source.stg_marketo__activity_merge_leads": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_merge_leads", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_id": {"type": "INT64", "index": 1, "name": "activity_id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_timestamp": {"type": "TIMESTAMP", "index": 3, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "BOOL", "index": 7, "name": "master_updated", "comment": null}, "merged_lead_id": {"type": "STRING", "index": 8, "name": "merged_lead_id", "comment": null}, "merge_source": {"type": "STRING", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "BOOL", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 11499, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads"}, "model.marketo_source.stg_marketo__activity_merge_leads_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_merge_leads_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "BOOL", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "STRING", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "STRING", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "BOOL", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp"}, "model.marketo_source.stg_marketo__activity_open_email": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_open_email", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "activity_id": {"type": "INT64", "index": 8, "name": "activity_id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "STRING", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 15, "name": "user_agent", "comment": null}, "email_send_id": {"type": "STRING", "index": 16, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 26896, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_open_email"}, "model.marketo_source.stg_marketo__activity_open_email_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_open_email_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "STRING", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp"}, "model.marketo_source.stg_marketo__activity_send_email": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_send_email", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "activity_id": {"type": "INT64", "index": 7, "name": "activity_id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}, "email_send_id": {"type": "STRING", "index": 12, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 14800, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_send_email"}, "model.marketo_source.stg_marketo__activity_send_email_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_send_email_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp"}, "model.marketo_source.stg_marketo__activity_unsubscribe_email": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_unsubscribe_email", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_timestamp": {"type": "TIMESTAMP", "index": 1, "name": "activity_timestamp", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "STRING", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "STRING", "index": 7, "name": "form_fields", "comment": null}, "activity_id": {"type": "INT64", "index": 8, "name": "activity_id", "comment": null}, "lead_id": {"type": "INT64", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "STRING", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "STRING", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "STRING", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "INT64", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "INT64", "index": 16, "name": "webpage_id", "comment": null}, "email_send_id": {"type": "STRING", "index": 17, "name": "email_send_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 69177, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_unsubscribe_email_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "STRING", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "STRING", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "STRING", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "STRING", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "STRING", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "INT64", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "INT64", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"}, "model.marketo_source.stg_marketo__email_template_history": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__email_template_history", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"created_timestamp": {"type": "STRING", "index": 1, "name": "created_timestamp", "comment": null}, "description": {"type": "STRING", "index": 2, "name": "description", "comment": null}, "folder_name": {"type": "STRING", "index": 3, "name": "folder_name", "comment": null}, "folder_id": {"type": "INT64", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "INT64", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "STRING", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "STRING", "index": 8, "name": "from_name", "comment": null}, "email_template_id": {"type": "INT64", "index": 9, "name": "email_template_id", "comment": null}, "email_template_name": {"type": "STRING", "index": 10, "name": "email_template_name", "comment": null}, "is_operational": {"type": "BOOL", "index": 11, "name": "is_operational", "comment": null}, "program_id": {"type": "INT64", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "BOOL", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "STRING", "index": 14, "name": "reply_email", "comment": null}, "email_template_status": {"type": "STRING", "index": 15, "name": "email_template_status", "comment": null}, "email_subject": {"type": "STRING", "index": 16, "name": "email_subject", "comment": null}, "parent_template_id": {"type": "INT64", "index": 17, "name": "parent_template_id", "comment": null}, "is_text_only": {"type": "BOOL", "index": 18, "name": "is_text_only", "comment": null}, "updated_timestamp": {"type": "STRING", "index": 19, "name": "updated_timestamp", "comment": null}, "email_template_url": {"type": "STRING", "index": 20, "name": "email_template_url", "comment": null}, "version_type": {"type": "INT64", "index": 21, "name": "version_type", "comment": null}, "has_web_view_enabled": {"type": "BOOL", "index": 22, "name": "has_web_view_enabled", "comment": null}, "workspace_name": {"type": "STRING", "index": 23, "name": "workspace_name", "comment": null}, "inferred_version": {"type": "INT64", "index": 24, "name": "inferred_version", "comment": null}, "total_count_of_versions": {"type": "INT64", "index": 25, "name": "total_count_of_versions", "comment": null}, "valid_from": {"type": "STRING", "index": 26, "name": "valid_from", "comment": null}, "valid_to": {"type": "STRING", "index": 27, "name": "valid_to", "comment": null}, "is_most_recent_version": {"type": "BOOL", "index": 28, "name": "is_most_recent_version", "comment": null}, "email_template_history_id": {"type": "STRING", "index": 29, "name": "email_template_history_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 42816, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__email_template_history"}, "model.marketo_source.stg_marketo__email_template_history_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__email_template_history_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"created_at": {"type": "STRING", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "STRING", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "STRING", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "INT64", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "INT64", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "STRING", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "STRING", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "INT64", "index": 9, "name": "id", "comment": null}, "name": {"type": "STRING", "index": 10, "name": "name", "comment": null}, "operational": {"type": "BOOL", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "INT64", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "BOOL", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "STRING", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "STRING", "index": 15, "name": "status", "comment": null}, "subject": {"type": "STRING", "index": 16, "name": "subject", "comment": null}, "template": {"type": "INT64", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "BOOL", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "STRING", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "STRING", "index": 20, "name": "url", "comment": null}, "version": {"type": "INT64", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "BOOL", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "STRING", "index": 23, "name": "workspace", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp"}, "model.marketo_source.stg_marketo__lead": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"_fivetran_synced": {"type": "TIMESTAMP", "index": 1, "name": "_fivetran_synced", "comment": null}, "created_timestamp": {"type": "STRING", "index": 2, "name": "created_timestamp", "comment": null}, "email": {"type": "STRING", "index": 3, "name": "email", "comment": null}, "first_name": {"type": "STRING", "index": 4, "name": "first_name", "comment": null}, "lead_id": {"type": "INT64", "index": 5, "name": "lead_id", "comment": null}, "last_name": {"type": "STRING", "index": 6, "name": "last_name", "comment": null}, "updated_timestamp": {"type": "STRING", "index": 7, "name": "updated_timestamp", "comment": null}, "phone": {"type": "STRING", "index": 8, "name": "phone", "comment": null}, "main_phone": {"type": "STRING", "index": 9, "name": "main_phone", "comment": null}, "mobile_phone": {"type": "STRING", "index": 10, "name": "mobile_phone", "comment": null}, "company": {"type": "STRING", "index": 11, "name": "company", "comment": null}, "inferred_company": {"type": "STRING", "index": 12, "name": "inferred_company", "comment": null}, "address_lead": {"type": "STRING", "index": 13, "name": "address_lead", "comment": null}, "address": {"type": "STRING", "index": 14, "name": "address", "comment": null}, "city": {"type": "STRING", "index": 15, "name": "city", "comment": null}, "state": {"type": "STRING", "index": 16, "name": "state", "comment": null}, "state_code": {"type": "STRING", "index": 17, "name": "state_code", "comment": null}, "country": {"type": "STRING", "index": 18, "name": "country", "comment": null}, "country_code": {"type": "STRING", "index": 19, "name": "country_code", "comment": null}, "postal_code": {"type": "STRING", "index": 20, "name": "postal_code", "comment": null}, "billing_street": {"type": "STRING", "index": 21, "name": "billing_street", "comment": null}, "billing_city": {"type": "STRING", "index": 22, "name": "billing_city", "comment": null}, "billing_state": {"type": "STRING", "index": 23, "name": "billing_state", "comment": null}, "billing_state_code": {"type": "STRING", "index": 24, "name": "billing_state_code", "comment": null}, "billing_country": {"type": "STRING", "index": 25, "name": "billing_country", "comment": null}, "billing_country_code": {"type": "STRING", "index": 26, "name": "billing_country_code", "comment": null}, "billing_postal_code": {"type": "STRING", "index": 27, "name": "billing_postal_code", "comment": null}, "inferred_city": {"type": "STRING", "index": 28, "name": "inferred_city", "comment": null}, "inferred_state_region": {"type": "STRING", "index": 29, "name": "inferred_state_region", "comment": null}, "inferred_country": {"type": "STRING", "index": 30, "name": "inferred_country", "comment": null}, "inferred_postal_code": {"type": "STRING", "index": 31, "name": "inferred_postal_code", "comment": null}, "inferred_phone_area_code": {"type": "STRING", "index": 32, "name": "inferred_phone_area_code", "comment": null}, "anonymous_ip": {"type": "STRING", "index": 33, "name": "anonymous_ip", "comment": null}, "is_unsubscribed": {"type": "BOOL", "index": 34, "name": "is_unsubscribed", "comment": null}, "is_email_invalid": {"type": "BOOL", "index": 35, "name": "is_email_invalid", "comment": null}, "do_not_call": {"type": "BOOL", "index": 36, "name": "do_not_call", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 10500, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead"}, "model.marketo_source.stg_marketo__lead_describe": {"metadata": {"type": "table", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_describe", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"data_type": {"type": "STRING", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "STRING", "index": 2, "name": "display_name", "comment": null}, "lead_describe_id": {"type": "INT64", "index": 3, "name": "lead_describe_id", "comment": null}, "field_max_length": {"type": "INT64", "index": 4, "name": "field_max_length", "comment": null}, "rest_name": {"type": "STRING", "index": 5, "name": "rest_name", "comment": null}, "is_rest_readonly": {"type": "BOOL", "index": 6, "name": "is_rest_readonly", "comment": null}, "soap_name": {"type": "STRING", "index": 7, "name": "soap_name", "comment": null}, "is_soap_readonly": {"type": "BOOL", "index": 8, "name": "is_soap_readonly", "comment": null}, "rest_name_xf": {"type": "STRING", "index": 9, "name": "rest_name_xf", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 8263, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_describe"}, "model.marketo_source.stg_marketo__lead_describe_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_describe_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"data_type": {"type": "STRING", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "STRING", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "INT64", "index": 3, "name": "id", "comment": null}, "length": {"type": "INT64", "index": 4, "name": "length", "comment": null}, "restname": {"type": "STRING", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "BOOL", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "STRING", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "BOOL", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp"}, "model.marketo_source.stg_marketo__lead_tmp": {"metadata": {"type": "view", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_tmp", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "STRING", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "STRING", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "STRING", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "STRING", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "STRING", "index": 6, "name": "last_name", "comment": null}}, "stats": {"has_stats": {"id": "has_stats", "label": "Has Stats?", "value": false, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "model.marketo_source.stg_marketo__lead_tmp"}}, "sources": {"source.marketo_source.marketo.activity_change_data_value": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_change_data_value_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "api_method_name": {"type": "INT64", "index": 3, "name": "api_method_name", "comment": null}, "campaign_id": {"type": "INT64", "index": 4, "name": "campaign_id", "comment": null}, "id": {"type": "INT64", "index": 5, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "modifying_user": {"type": "INT64", "index": 7, "name": "modifying_user", "comment": null}, "new_value": {"type": "STRING", "index": 8, "name": "new_value", "comment": null}, "old_value": {"type": "STRING", "index": 9, "name": "old_value", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "reason": {"type": "STRING", "index": 12, "name": "reason", "comment": null}, "request_id": {"type": "INT64", "index": 13, "name": "request_id", "comment": null}, "source": {"type": "STRING", "index": 14, "name": "source", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 16556, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_change_data_value"}, "source.marketo_source.marketo.activity_click_email": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_click_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "link": {"type": "STRING", "index": 11, "name": "link", "comment": null}, "platform": {"type": "STRING", "index": 12, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 13, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 14, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 15, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 16, "name": "user_agent", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 31660, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_click_email"}, "source.marketo_source.marketo.activity_delete_lead": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_delete_lead_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign": {"type": "STRING", "index": 5, "name": "campaign", "comment": null}, "campaign_id": {"type": "INT64", "index": 6, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 7, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 8, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 31, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 4650, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_delete_lead"}, "source.marketo_source.marketo.activity_email_bounced": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_email_bounced_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "category": {"type": "INT64", "index": 5, "name": "category", "comment": null}, "choice_number": {"type": "INT64", "index": 6, "name": "choice_number", "comment": null}, "details": {"type": "STRING", "index": 7, "name": "details", "comment": null}, "email": {"type": "STRING", "index": 8, "name": "email", "comment": null}, "email_template_id": {"type": "INT64", "index": 9, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 10, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 11, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "subcategory": {"type": "INT64", "index": 15, "name": "subcategory", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 29624, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_email_bounced"}, "source.marketo_source.marketo.activity_email_delivered": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_email_delivered_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 9, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 10, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13100, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_email_delivered"}, "source.marketo_source.marketo.activity_merge_leads": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_merge_leads_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "_fivetran_synced": {"type": "STRING", "index": 2, "name": "_fivetran_synced", "comment": null}, "activity_date": {"type": "STRING", "index": 3, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 4, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 5, "name": "campaign_id", "comment": null}, "lead_id": {"type": "INT64", "index": 6, "name": "lead_id", "comment": null}, "master_updated": {"type": "BOOL", "index": 7, "name": "master_updated", "comment": null}, "merge_ids": {"type": "STRING", "index": 8, "name": "merge_ids", "comment": null}, "merge_source": {"type": "STRING", "index": 9, "name": "merge_source", "comment": null}, "merged_in_sales": {"type": "BOOL", "index": 10, "name": "merged_in_sales", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 11, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 12, "name": "primary_attribute_value_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13397, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_merge_leads"}, "source.marketo_source.marketo.activity_open_email": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_open_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "device": {"type": "STRING", "index": 6, "name": "device", "comment": null}, "email_template_id": {"type": "INT64", "index": 7, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "is_mobile_device": {"type": "BOOL", "index": 9, "name": "is_mobile_device", "comment": null}, "lead_id": {"type": "INT64", "index": 10, "name": "lead_id", "comment": null}, "platform": {"type": "STRING", "index": 11, "name": "platform", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 12, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 13, "name": "primary_attribute_value_id", "comment": null}, "step_id": {"type": "INT64", "index": 14, "name": "step_id", "comment": null}, "user_agent": {"type": "STRING", "index": 15, "name": "user_agent", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 25196, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_open_email"}, "source.marketo_source.marketo.activity_send_email": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_send_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "choice_number": {"type": "INT64", "index": 5, "name": "choice_number", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "id": {"type": "INT64", "index": 7, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 8, "name": "lead_id", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 9, "name": "primary_attribute_value_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "step_id": {"type": "INT64", "index": 11, "name": "step_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 13100, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_send_email"}, "source.marketo_source.marketo.activity_unsubscribe_email": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_activity_unsubscribe_email_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"activity_date": {"type": "STRING", "index": 1, "name": "activity_date", "comment": null}, "activity_type_id": {"type": "INT64", "index": 2, "name": "activity_type_id", "comment": null}, "campaign_id": {"type": "INT64", "index": 3, "name": "campaign_id", "comment": null}, "campaign_run_id": {"type": "INT64", "index": 4, "name": "campaign_run_id", "comment": null}, "client_ip_address": {"type": "STRING", "index": 5, "name": "client_ip_address", "comment": null}, "email_template_id": {"type": "INT64", "index": 6, "name": "email_template_id", "comment": null}, "form_fields": {"type": "STRING", "index": 7, "name": "form_fields", "comment": null}, "id": {"type": "INT64", "index": 8, "name": "id", "comment": null}, "lead_id": {"type": "INT64", "index": 9, "name": "lead_id", "comment": null}, "primary_attribute_value": {"type": "STRING", "index": 10, "name": "primary_attribute_value", "comment": null}, "primary_attribute_value_id": {"type": "INT64", "index": 11, "name": "primary_attribute_value_id", "comment": null}, "query_parameters": {"type": "STRING", "index": 12, "name": "query_parameters", "comment": null}, "referrer_url": {"type": "STRING", "index": 13, "name": "referrer_url", "comment": null}, "user_agent": {"type": "STRING", "index": 14, "name": "user_agent", "comment": null}, "webform_id": {"type": "INT64", "index": 15, "name": "webform_id", "comment": null}, "webpage_id": {"type": "INT64", "index": 16, "name": "webpage_id", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 67477, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.activity_unsubscribe_email"}, "source.marketo_source.marketo.campaign": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_campaign_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"active": {"type": "BOOL", "index": 1, "name": "active", "comment": null}, "created_at": {"type": "STRING", "index": 2, "name": "created_at", "comment": null}, "description": {"type": "STRING", "index": 3, "name": "description", "comment": null}, "id": {"type": "INT64", "index": 4, "name": "id", "comment": null}, "name": {"type": "STRING", "index": 5, "name": "name", "comment": null}, "program_id": {"type": "INT64", "index": 6, "name": "program_id", "comment": null}, "type": {"type": "STRING", "index": 7, "name": "type", "comment": null}, "updated_at": {"type": "STRING", "index": 8, "name": "updated_at", "comment": null}, "workspace_name": {"type": "STRING", "index": 9, "name": "workspace_name", "comment": null}, "computed_url": {"type": "STRING", "index": 10, "name": "computed_url", "comment": null}, "flow_id": {"type": "INT64", "index": 11, "name": "flow_id", "comment": null}, "folder_id": {"type": "INT64", "index": 12, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 13, "name": "folder_type", "comment": null}, "is_communication_limit_enabled": {"type": "BOOL", "index": 14, "name": "is_communication_limit_enabled", "comment": null}, "is_requestable": {"type": "BOOL", "index": 15, "name": "is_requestable", "comment": null}, "is_system": {"type": "BOOL", "index": 16, "name": "is_system", "comment": null}, "max_members": {"type": "INT64", "index": 17, "name": "max_members", "comment": null}, "qualification_rule_type": {"type": "STRING", "index": 18, "name": "qualification_rule_type", "comment": null}, "qualification_rule_interval": {"type": "INT64", "index": 19, "name": "qualification_rule_interval", "comment": null}, "qualification_rule_unit": {"type": "STRING", "index": 20, "name": "qualification_rule_unit", "comment": null}, "recurrence_start_at": {"type": "STRING", "index": 21, "name": "recurrence_start_at", "comment": null}, "recurrence_end_at": {"type": "INT64", "index": 22, "name": "recurrence_end_at", "comment": null}, "recurrence_interval_type": {"type": "STRING", "index": 23, "name": "recurrence_interval_type", "comment": null}, "recurrence_interval": {"type": "INT64", "index": 24, "name": "recurrence_interval", "comment": null}, "recurrence_weekday_only": {"type": "BOOL", "index": 25, "name": "recurrence_weekday_only", "comment": null}, "recurrence_day_of_month": {"type": "INT64", "index": 26, "name": "recurrence_day_of_month", "comment": null}, "recurrence_day_of_week": {"type": "INT64", "index": 27, "name": "recurrence_day_of_week", "comment": null}, "recurrence_week_of_month": {"type": "INT64", "index": 28, "name": "recurrence_week_of_month", "comment": null}, "smart_list_id": {"type": "INT64", "index": 29, "name": "smart_list_id", "comment": null}, "status": {"type": "STRING", "index": 30, "name": "status", "comment": null}, "_fivetran_deleted": {"type": "BOOL", "index": 31, "name": "_fivetran_deleted", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 18079, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.campaign"}, "source.marketo_source.marketo.email_template_history": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_email_template_history_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"created_at": {"type": "STRING", "index": 1, "name": "created_at", "comment": null}, "description": {"type": "STRING", "index": 2, "name": "description", "comment": null}, "folder_folder_name": {"type": "STRING", "index": 3, "name": "folder_folder_name", "comment": null}, "folder_id": {"type": "INT64", "index": 4, "name": "folder_id", "comment": null}, "folder_type": {"type": "STRING", "index": 5, "name": "folder_type", "comment": null}, "folder_value": {"type": "INT64", "index": 6, "name": "folder_value", "comment": null}, "from_email": {"type": "STRING", "index": 7, "name": "from_email", "comment": null}, "from_name": {"type": "STRING", "index": 8, "name": "from_name", "comment": null}, "id": {"type": "INT64", "index": 9, "name": "id", "comment": null}, "name": {"type": "STRING", "index": 10, "name": "name", "comment": null}, "operational": {"type": "BOOL", "index": 11, "name": "operational", "comment": null}, "program_id": {"type": "INT64", "index": 12, "name": "program_id", "comment": null}, "publish_to_msi": {"type": "BOOL", "index": 13, "name": "publish_to_msi", "comment": null}, "reply_email": {"type": "STRING", "index": 14, "name": "reply_email", "comment": null}, "status": {"type": "STRING", "index": 15, "name": "status", "comment": null}, "subject": {"type": "STRING", "index": 16, "name": "subject", "comment": null}, "template": {"type": "INT64", "index": 17, "name": "template", "comment": null}, "text_only": {"type": "BOOL", "index": 18, "name": "text_only", "comment": null}, "updated_at": {"type": "STRING", "index": 19, "name": "updated_at", "comment": null}, "url": {"type": "STRING", "index": 20, "name": "url", "comment": null}, "version": {"type": "INT64", "index": 21, "name": "version", "comment": null}, "web_view": {"type": "BOOL", "index": 22, "name": "web_view", "comment": null}, "workspace": {"type": "STRING", "index": 23, "name": "workspace", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 34691, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.email_template_history"}, "source.marketo_source.marketo.lead": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_lead_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "created_at": {"type": "STRING", "index": 2, "name": "created_at", "comment": null}, "updated_at": {"type": "STRING", "index": 3, "name": "updated_at", "comment": null}, "email": {"type": "STRING", "index": 4, "name": "email", "comment": null}, "first_name": {"type": "STRING", "index": 5, "name": "first_name", "comment": null}, "last_name": {"type": "STRING", "index": 6, "name": "last_name", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 10500, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.lead"}, "source.marketo_source.marketo.lead_describe": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_lead_describe_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"data_type": {"type": "STRING", "index": 1, "name": "data_type", "comment": null}, "display_name": {"type": "STRING", "index": 2, "name": "display_name", "comment": null}, "id": {"type": "INT64", "index": 3, "name": "id", "comment": null}, "length": {"type": "INT64", "index": 4, "name": "length", "comment": null}, "restname": {"type": "STRING", "index": 5, "name": "restname", "comment": null}, "restread_only": {"type": "BOOL", "index": 6, "name": "restread_only", "comment": null}, "soapname": {"type": "STRING", "index": 7, "name": "soapname", "comment": null}, "soapread_only": {"type": "BOOL", "index": 8, "name": "soapread_only", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 6651, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.lead_describe"}, "source.marketo_source.marketo.program": {"metadata": {"type": "table", "schema": "marketo_source", "name": "marketo_program_data", "database": "dbt-package-testing", "comment": null, "owner": null}, "columns": {"id": {"type": "INT64", "index": 1, "name": "id", "comment": null}, "channel": {"type": "STRING", "index": 2, "name": "channel", "comment": null}, "created_at": {"type": "STRING", "index": 3, "name": "created_at", "comment": null}, "description": {"type": "INT64", "index": 4, "name": "description", "comment": null}, "end_date": {"type": "INT64", "index": 5, "name": "end_date", "comment": null}, "name": {"type": "STRING", "index": 6, "name": "name", "comment": null}, "sfdc_id": {"type": "STRING", "index": 7, "name": "sfdc_id", "comment": null}, "sfdc_name": {"type": "STRING", "index": 8, "name": "sfdc_name", "comment": null}, "start_date": {"type": "INT64", "index": 9, "name": "start_date", "comment": null}, "status": {"type": "STRING", "index": 10, "name": "status", "comment": null}, "type": {"type": "STRING", "index": 11, "name": "type", "comment": null}, "updated_at": {"type": "STRING", "index": 12, "name": "updated_at", "comment": null}, "url": {"type": "STRING", "index": 13, "name": "url", "comment": null}, "workspace": {"type": "STRING", "index": 14, "name": "workspace", "comment": null}, "_fivetran_deleted": {"type": "BOOL", "index": 15, "name": "_fivetran_deleted", "comment": null}}, "stats": {"num_rows": {"id": "num_rows", "label": "# Rows", "value": 100, "include": true, "description": "Approximate count of rows in this table"}, "num_bytes": {"id": "num_bytes", "label": "Approximate Size", "value": 16936, "include": true, "description": "Approximate size of table as reported by BigQuery"}, "has_stats": {"id": "has_stats", "label": "Has Stats?", "value": true, "include": false, "description": "Indicates whether there are statistics for this table"}}, "unique_id": "source.marketo_source.marketo.program"}}, "errors": null} \ No newline at end of file diff --git a/docs/index.html b/docs/index.html index 5631ac6..ca1e6f8 100644 --- a/docs/index.html +++ b/docs/index.html @@ -24,7 +24,7 @@
icons
- diff --git a/docs/manifest.json b/docs/manifest.json index ef47204..17022e4 100644 --- a/docs/manifest.json +++ b/docs/manifest.json @@ -1 +1 @@ -{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/manifest/v9.json", "dbt_version": "1.5.2", "generated_at": "2023-07-10T15:59:15.216903Z", "invocation_id": "a54949a1-70a0-4ef8-9821-109da0cc584f", "env": {}, "project_id": "a72643f3c0e6cd4df80476b9de14c1e4", "user_id": "8268eefe-e8f7-472e-ab2a-a92f0135d76d", "send_anonymous_usage_stats": true, "adapter_type": "postgres"}, "nodes": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_send_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_send_email_data.csv", "original_file_path": "seeds/marketo_activity_send_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_send_email_data"], "alias": "marketo_activity_send_email_data", "checksum": {"name": "sha256", "checksum": "fb2bad0f381304d118073d9983f45eb46e5febee8dca957914a648b4ddff637e"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.213115, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_send_email_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_change_data_value_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_change_data_value_data.csv", "original_file_path": "seeds/marketo_activity_change_data_value_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_change_data_value_data"], "alias": "marketo_activity_change_data_value_data", "checksum": {"name": "sha256", "checksum": "50150cbdd92fde6155258db2e872f0ada8aa08c9d1d86b944e4895f9f4b457af"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2208698, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_change_data_value_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_email_template_history_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_email_template_history_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_email_template_history_data.csv", "original_file_path": "seeds/marketo_email_template_history_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data", "fqn": ["marketo_source_integration_tests", "marketo_email_template_history_data"], "alias": "marketo_email_template_history_data", "checksum": {"name": "sha256", "checksum": "88720f1d192884ba6a37ef4b5d7c6d71854d4317881e3c05527c647f3110819c"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2227242, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_email_template_history_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_delivered_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_email_delivered_data.csv", "original_file_path": "seeds/marketo_activity_email_delivered_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_email_delivered_data"], "alias": "marketo_activity_email_delivered_data", "checksum": {"name": "sha256", "checksum": "b2243d0565a9b1d4f98aaf79cf1ee52b48f8f2015eea1e748d126925bf15cad6"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.224424, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_delivered_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_lead_describe_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_describe_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_lead_describe_data.csv", "original_file_path": "seeds/marketo_lead_describe_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data", "fqn": ["marketo_source_integration_tests", "marketo_lead_describe_data"], "alias": "marketo_lead_describe_data", "checksum": {"name": "sha256", "checksum": "82b41788229917c7b5e11620f8093c5664ac80b42f055810c66c2c30a22dad65"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.226229, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_describe_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_delete_lead_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_delete_lead_data.csv", "original_file_path": "seeds/marketo_activity_delete_lead_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_delete_lead_data"], "alias": "marketo_activity_delete_lead_data", "checksum": {"name": "sha256", "checksum": "4798018fe3ad445e062842e31f2ab12d165e11784128c0374a24622af39d9851"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.22789, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_delete_lead_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_unsubscribe_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_unsubscribe_email_data.csv", "original_file_path": "seeds/marketo_activity_unsubscribe_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_unsubscribe_email_data"], "alias": "marketo_activity_unsubscribe_email_data", "checksum": {"name": "sha256", "checksum": "9e875888fdd08766cdd8ed980dc75c0fe6d0875af6bd9e32e31df4e1e2e6a1f8"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2296991, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_unsubscribe_email_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_campaign_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_campaign_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_campaign_data.csv", "original_file_path": "seeds/marketo_campaign_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data", "fqn": ["marketo_source_integration_tests", "marketo_campaign_data"], "alias": "marketo_campaign_data", "checksum": {"name": "sha256", "checksum": "c2dec4e9b5d9551cc21da6efb838d60c2d4f1a015c40a7765753bf3bb1f6a56a"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2315001, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_campaign_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_program_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_program_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_program_data.csv", "original_file_path": "seeds/marketo_program_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_program_data", "fqn": ["marketo_source_integration_tests", "marketo_program_data"], "alias": "marketo_program_data", "checksum": {"name": "sha256", "checksum": "b8086d8f192438267b139c516bcccfc9a52364633d951bef3c60254cd002bd55"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2332668, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_program_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_merge_leads_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_merge_leads_data.csv", "original_file_path": "seeds/marketo_activity_merge_leads_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_merge_leads_data"], "alias": "marketo_activity_merge_leads_data", "checksum": {"name": "sha256", "checksum": "24ad90300354e3399ee9da754c62c3d76e3d36f3d57be16c71e7734545a104a8"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.234967, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_merge_leads_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_click_email_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_click_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_click_email_data.csv", "original_file_path": "seeds/marketo_activity_click_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_click_email_data"], "alias": "marketo_activity_click_email_data", "checksum": {"name": "sha256", "checksum": "97c60db60ffb7cef6797417f9eeeed5c72e0f8e8a0001972911b2b74884591c5"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.236657, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_click_email_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_lead_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_lead_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_lead_data.csv", "original_file_path": "seeds/marketo_lead_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data", "fqn": ["marketo_source_integration_tests", "marketo_lead_data"], "alias": "marketo_lead_data", "checksum": {"name": "sha256", "checksum": "f31f8f352f46ccc6cbb1a26d0f277aff3b231a8cc8b79a948962b90687566a1a"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.238494, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_open_email_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_open_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_open_email_data.csv", "original_file_path": "seeds/marketo_activity_open_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_open_email_data"], "alias": "marketo_activity_open_email_data", "checksum": {"name": "sha256", "checksum": "c2e6f02fb886b1acf308d01f7ac0c8123d6bf83ed235e93cf776d0b03bf48194"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.2401972, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_open_email_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "marketo_activity_email_bounced_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_email_bounced_data.csv", "original_file_path": "seeds/marketo_activity_email_bounced_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_email_bounced_data"], "alias": "marketo_activity_email_bounced_data", "checksum": {"name": "sha256", "checksum": "84ad6102d1351832188e16498b2b5253479cbe9e5fd9d77ccb9f97b210af8f67"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "quote_columns": null, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.241906, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_bounced_data\"", "raw_code": "", "root_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "model.marketo_source.stg_marketo__activity_merge_leads": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_merge_leads", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_merge_leads.sql", "original_file_path": "models/stg_marketo__activity_merge_leads.sql", "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads", "fqn": ["marketo_source", "stg_marketo__activity_merge_leads"], "alias": "stg_marketo__activity_merge_leads", "checksum": {"name": "sha256", "checksum": "d0c946ed7fab89435ed0a3de1fca940a6e3e5d8a89e49dc8d32d1545690f7164"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "Table with merged lead activities", "columns": {"activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merged_lead_id": {"name": "merged_lead_id", "description": "ID of the lead that the lead was merged into.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "master_updated": {"name": "master_updated", "description": "Boolean if master was updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merge_source": {"name": "merge_source", "description": "Source of the merge.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merged_in_sales": {"name": "merged_in_sales", "description": "Boolean if merged in sales.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.690469, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_merge_leads\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_merge_leads_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_merge_leads_tmp')),\n staging_columns=get_activity_merge_leads_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n cast(lead_id as {{ dbt.type_int() }}) as lead_id,\n master_updated,\n cast(replace(trim(trim(merge_ids,']'),'['), ',', ', ') as {{ dbt.type_string() }}) as merged_lead_id,\n merge_source,\n merged_in_sales,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_merge_leads_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_merge_leads_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_merge_leads_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"], "nodes": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp", "model.marketo_source.stg_marketo__activity_merge_leads_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_merge_leads.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_merge_leads_tmp\"\n\n), macro as (\n\n select\n \n \n \n _fivetran_synced\n \n as \n \n _fivetran_synced\n \n, \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n master_updated\n \n as \n \n master_updated\n \n, \n \n \n merge_ids\n \n as \n \n merge_ids\n \n, \n \n \n merge_source\n \n as \n \n merge_source\n \n, \n \n \n merged_in_sales\n \n as \n \n merged_in_sales\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n cast(lead_id as INT) as lead_id,\n master_updated,\n cast(replace(trim(trim(merge_ids,']'),'['), ',', ', ') as TEXT) as merged_lead_id,\n merge_source,\n merged_in_sales,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_open_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_open_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_open_email.sql", "original_file_path": "models/stg_marketo__activity_open_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_open_email", "fqn": ["marketo_source", "stg_marketo__activity_open_email"], "alias": "stg_marketo__activity_open_email", "checksum": {"name": "sha256", "checksum": "1a2a4bd5e302bc781fe9297ef000dab7c24b639267cc6c6aabf9873484bdc9ab"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Identifies whether a mobile device was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "platform": {"name": "platform", "description": "The platform that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.6612291, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_open_email\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_open_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_open_email_tmp')),\n staging_columns=get_activity_open_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_open_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_open_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email_tmp", "model.marketo_source.stg_marketo__activity_open_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_open_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_open_email_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_send_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_send_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_send_email.sql", "original_file_path": "models/stg_marketo__activity_send_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_send_email", "fqn": ["marketo_source", "stg_marketo__activity_send_email"], "alias": "stg_marketo__activity_send_email", "checksum": {"name": "sha256", "checksum": "ddb3c66943091e1448ef6ecd7db0a026b3b967ed6853228bfb04e92667d0789f"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.663887, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_send_email\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_send_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_send_email_tmp')),\n staging_columns=get_activity_send_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n\n {{ fivetran_utils.fill_pass_through_columns('marketo__activity_send_email_passthrough_columns') }}\n\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_send_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_send_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.fivetran_utils.fill_pass_through_columns", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email_tmp", "model.marketo_source.stg_marketo__activity_send_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_send_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_send_email_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n\n \n\n\n\n\n\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__email_template_history": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__email_template_history", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__email_template_history.sql", "original_file_path": "models/stg_marketo__email_template_history.sql", "unique_id": "model.marketo_source.stg_marketo__email_template_history", "fqn": ["marketo_source", "stg_marketo__email_template_history"], "alias": "stg_marketo__email_template_history", "checksum": {"name": "sha256", "checksum": "97162d775e448bbc12c74be0edebd8c57571129d1d23298c0f415e0cd000e348"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"email_template_history_id": {"name": "email_template_history_id", "description": "ID of the version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp the email template was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_subject": {"name": "email_subject", "description": "Subject line of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "ID of the email template", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_name": {"name": "email_template_name", "description": "Name of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_status": {"name": "email_template_status", "description": "Status filter for draft or approved versions.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_url": {"name": "email_template_url", "description": "URL of the email template in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_name": {"name": "folder_name", "description": "The name of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_value": {"name": "folder_value", "description": "The value of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_email": {"name": "from_email", "description": "The 'From' address of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_name": {"name": "from_name", "description": "The 'From' name of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "has_web_view_enabled": {"name": "has_web_view_enabled", "description": "Whether 'View as Webpage' function is enabled for the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_version": {"name": "inferred_version", "description": "Incrementing integer version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_most_recent_version": {"name": "is_most_recent_version", "description": "Whether it is the most recent version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_operational": {"name": "is_operational", "description": "Whether the email is operational. Operational emails bypass unsubscribe status. Defaults to false.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_text_only": {"name": "is_text_only", "description": "Setting to include text-only version of email when sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "parent_template_id": {"name": "parent_template_id", "description": "ID of the parent template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "The ID of the email template's program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "publish_to_msi": {"name": "publish_to_msi", "description": "Whether the email is published to Marketo Sales Insight.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reply_email": {"name": "reply_email", "description": "Reply-To address of the Email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "total_count_of_versions": {"name": "total_count_of_versions", "description": "Count of versions of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp the email template was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "valid_from": {"name": "valid_from", "description": "When the version of the email template was is valid from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "valid_to": {"name": "valid_to", "description": "When the version of the email template was is valid to.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "version_type": {"name": "version_type", "description": "The type version of the email, either '1' or '2'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.678936, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__email_template_history\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__email_template_history_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__email_template_history_tmp')),\n staging_columns=get_email_template_history_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n created_at as created_timestamp,\n description,\n folder_folder_name as folder_name,\n folder_id,\n folder_type,\n folder_value,\n from_email,\n from_name,\n id as email_template_id,\n name as email_template_name,\n operational as is_operational,\n program_id,\n publish_to_msi,\n reply_email,\n status as email_template_status,\n subject as email_subject,\n template as parent_template_id,\n text_only as is_text_only,\n updated_at as updated_timestamp,\n url as email_template_url,\n version as version_type,\n web_view as has_web_view_enabled,\n workspace as workspace_name\n from macro\n\n), versions as (\n\n select \n *,\n row_number() over (partition by email_template_id order by updated_timestamp) as inferred_version,\n count(*) over (partition by email_template_id) as total_count_of_versions\n from fields\n\n), valid as (\n\n select \n *, \n case\n when inferred_version = 1 then created_timestamp\n else updated_timestamp\n end as valid_from,\n lead(updated_timestamp) over (partition by email_template_id order by updated_timestamp) as valid_to,\n inferred_version = total_count_of_versions as is_most_recent_version\n from versions\n\n), surrogate_key as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['email_template_id','inferred_version'] )}} as email_template_history_id\n from valid\n\n)\n\nselect *\nfrom surrogate_key", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history_tmp", "package": null, "version": null}, {"name": "stg_marketo__email_template_history_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_email_template_history_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__email_template_history_tmp", "model.marketo_source.stg_marketo__email_template_history_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__email_template_history.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__email_template_history_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n description\n \n as \n \n description\n \n, \n \n \n folder_folder_name\n \n as \n \n folder_folder_name\n \n, \n \n \n folder_id\n \n as \n \n folder_id\n \n, \n \n \n folder_type\n \n as \n \n folder_type\n \n, \n \n \n folder_value\n \n as \n \n folder_value\n \n, \n \n \n from_email\n \n as \n \n from_email\n \n, \n \n \n from_name\n \n as \n \n from_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n name\n \n as \n \n name\n \n, \n \n \n operational\n \n as \n \n operational\n \n, \n \n \n program_id\n \n as \n \n program_id\n \n, \n \n \n publish_to_msi\n \n as \n \n publish_to_msi\n \n, \n \n \n reply_email\n \n as \n \n reply_email\n \n, \n \n \n status\n \n as \n \n status\n \n, \n \n \n subject\n \n as \n \n subject\n \n, \n \n \n template\n \n as \n \n template\n \n, \n \n \n text_only\n \n as \n \n text_only\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n, \n \n \n url\n \n as \n \n url\n \n, \n \n \n version\n \n as \n \n version\n \n, \n \n \n web_view\n \n as \n \n web_view\n \n, \n \n \n workspace\n \n as \n \n workspace\n \n\n\n\n from base\n\n), fields as (\n\n select \n created_at as created_timestamp,\n description,\n folder_folder_name as folder_name,\n folder_id,\n folder_type,\n folder_value,\n from_email,\n from_name,\n id as email_template_id,\n name as email_template_name,\n operational as is_operational,\n program_id,\n publish_to_msi,\n reply_email,\n status as email_template_status,\n subject as email_subject,\n template as parent_template_id,\n text_only as is_text_only,\n updated_at as updated_timestamp,\n url as email_template_url,\n version as version_type,\n web_view as has_web_view_enabled,\n workspace as workspace_name\n from macro\n\n), versions as (\n\n select \n *,\n row_number() over (partition by email_template_id order by updated_timestamp) as inferred_version,\n count(*) over (partition by email_template_id) as total_count_of_versions\n from fields\n\n), valid as (\n\n select \n *, \n case\n when inferred_version = 1 then created_timestamp\n else updated_timestamp\n end as valid_from,\n lead(updated_timestamp) over (partition by email_template_id order by updated_timestamp) as valid_to,\n inferred_version = total_count_of_versions as is_most_recent_version\n from versions\n\n), surrogate_key as (\n\n select \n *,\n md5(cast(coalesce(cast(email_template_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(inferred_version as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_template_history_id\n from valid\n\n)\n\nselect *\nfrom surrogate_key", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_email_bounced": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_bounced", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_email_bounced.sql", "original_file_path": "models/stg_marketo__activity_email_bounced.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced", "fqn": ["marketo_source", "stg_marketo__activity_email_bounced"], "alias": "stg_marketo__activity_email_bounced", "checksum": {"name": "sha256", "checksum": "753f37b9c30bc8d70b6eda0c72605ec91c320eb1b05e832c393cda5ab921a6c6"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "bounce_category": {"name": "bounce_category", "description": "The category associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "bounce_subcategory": {"name": "bounce_subcategory", "description": "The subcategory associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "details": {"name": "details", "description": "Details about why the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_address": {"name": "email_address", "description": "The email address that bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.655411, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_bounced\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_email_bounced_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_email_bounced_tmp')),\n staging_columns=get_activity_email_bounced_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n category as bounce_category,\n choice_number,\n details,\n email as email_address,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n subcategory as bounce_subcategory\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_email_bounced_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_email_bounced_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp", "model.marketo_source.stg_marketo__activity_email_bounced_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_email_bounced.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_bounced_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n category\n \n as \n \n category\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n details\n \n as \n \n details\n \n, \n \n \n email\n \n as \n \n email\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n \n \n subcategory\n \n as \n \n subcategory\n \n, \n cast(null as INT) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n category as bounce_category,\n choice_number,\n details,\n email as email_address,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n subcategory as bounce_subcategory\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_change_data_value": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_change_data_value", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_change_data_value.sql", "original_file_path": "models/stg_marketo__activity_change_data_value.sql", "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value", "fqn": ["marketo_source", "stg_marketo__activity_change_data_value"], "alias": "stg_marketo__activity_change_data_value", "checksum": {"name": "sha256", "checksum": "16a382cec11b4b08da9f9bc6a11d51ccbeb7d985b1c6ffd22e81adff5b9f71da"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "Timestamp of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "api_method_name": {"name": "api_method_name", "description": "API method used for change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "change_reason": {"name": "change_reason", "description": "Reason for the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "change_source": {"name": "change_source", "description": "Source of the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "Id of the lead associated to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "modifying_user_id": {"name": "modifying_user_id", "description": "The user who instigated the change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "new_value": {"name": "new_value", "description": "New value after the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "old_value": {"name": "old_value", "description": "Old value before the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "Value of the primary attribute.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "ID of the primary attribute field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "request_id": {"name": "request_id", "description": "ID of the request made.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.648042, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_change_data_value\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_change_data_value_tmp') }}\n\n), macro as (\n\n select \n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_change_data_value_tmp')),\n staging_columns=get_activity_change_data_value_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n api_method_name,\n campaign_id,\n id as activity_id,\n lead_id,\n modifying_user as modifying_user_id,\n new_value,\n old_value,\n primary_attribute_value,\n primary_attribute_value_id,\n reason as change_reason,\n request_id,\n source as change_source\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_change_data_value_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_change_data_value_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp", "model.marketo_source.stg_marketo__activity_change_data_value_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_change_data_value.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_change_data_value_tmp\"\n\n), macro as (\n\n select \n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n api_method_name\n \n as \n \n api_method_name\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n modifying_user\n \n as \n \n modifying_user\n \n, \n \n \n new_value\n \n as \n \n new_value\n \n, \n \n \n old_value\n \n as \n \n old_value\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n reason\n \n as \n \n reason\n \n, \n \n \n request_id\n \n as \n \n request_id\n \n, \n \n \n source\n \n as \n \n source\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n api_method_name,\n campaign_id,\n id as activity_id,\n lead_id,\n modifying_user as modifying_user_id,\n new_value,\n old_value,\n primary_attribute_value,\n primary_attribute_value_id,\n reason as change_reason,\n request_id,\n source as change_source\n from macro\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__lead": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__lead.sql", "original_file_path": "models/stg_marketo__lead.sql", "unique_id": "model.marketo_source.stg_marketo__lead", "fqn": ["marketo_source", "stg_marketo__lead"], "alias": "stg_marketo__lead", "checksum": {"name": "sha256", "checksum": "39b5e960d6cf1434b7d01cee939616d50de37637afe1812bafd129fa20643dfc"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"lead_id": {"name": "lead_id", "description": "ID of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "The timestamp at which each lead object was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "The timestamp at which each lead object was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "first_name": {"name": "first_name", "description": "The first name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "last_name": {"name": "last_name", "description": "The last name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.6823921, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__lead_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__lead_tmp')),\n staging_columns=get_lead_columns()\n )\n }}\n from base\n\n), leads as (\n\n select\n id as lead_id,\n created_at as created_timestamp,\n updated_at as updated_timestamp,\n email,\n first_name,\n last_name\n\n {{ fivetran_utils.fill_pass_through_columns('marketo__lead_passthrough_columns') }}\n\n from macro\n)\n\nselect *\nfrom leads", "language": "sql", "refs": [{"name": "stg_marketo__lead_tmp", "package": null, "version": null}, {"name": "stg_marketo__lead_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_lead_columns", "macro.fivetran_utils.fill_staging_columns", "macro.fivetran_utils.fill_pass_through_columns"], "nodes": ["model.marketo_source.stg_marketo__lead_tmp", "model.marketo_source.stg_marketo__lead_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__lead.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n email\n \n as \n \n email\n \n, \n \n \n first_name\n \n as \n \n first_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n last_name\n \n as \n \n last_name\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n\n\n\n from base\n\n), leads as (\n\n select\n id as lead_id,\n created_at as created_timestamp,\n updated_at as updated_timestamp,\n email,\n first_name,\n last_name\n\n \n\n\n\n\n\n from macro\n)\n\nselect *\nfrom leads", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_email_delivered": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_delivered", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_email_delivered.sql", "original_file_path": "models/stg_marketo__activity_email_delivered.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered", "fqn": ["marketo_source", "stg_marketo__activity_email_delivered"], "alias": "stg_marketo__activity_email_delivered", "checksum": {"name": "sha256", "checksum": "e728feee6ece5169f52932e6da4505652ddc4a6dfea62ea64fedf31089727f4e"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was delivered.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.6578429, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_delivered\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_email_delivered_tmp') }}\n\n), macro as (\n\n select \n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_email_delivered_tmp')),\n staging_columns=get_activity_email_delivered_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id, \n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_email_delivered_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_email_delivered_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp", "model.marketo_source.stg_marketo__activity_email_delivered_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_email_delivered.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_delivered_tmp\"\n\n), macro as (\n\n select \n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id, \n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_click_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_click_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_click_email.sql", "original_file_path": "models/stg_marketo__activity_click_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_click_email", "fqn": ["marketo_source", "stg_marketo__activity_click_email"], "alias": "stg_marketo__activity_click_email", "checksum": {"name": "sha256", "checksum": "0ebc3224a6a77f9be542e93fcafdc8ab408bcc0ef43d55ac53fac3a787466d54"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "Timestamp of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "click_device": {"name": "click_device", "description": "The device type the activity occurred on.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "click_link_url": {"name": "click_link_url", "description": "The URL of the link clicked.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Whether the activity occurred on a mobile device.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The Web browser user agent information obtained when the lead clicked the email link.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_platform": {"name": "user_platform", "description": "The user's operating platform.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.652065, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_click_email\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_click_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_click_email_tmp')),\n staging_columns=get_activity_click_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device as click_device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n link as click_link_url,\n platform as user_platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_click_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_click_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email_tmp", "model.marketo_source.stg_marketo__activity_click_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_click_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_click_email_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n link\n \n as \n \n link\n \n, \n cast(null as TEXT) as \n \n link_id\n \n , \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device as click_device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n link as click_link_url,\n platform as user_platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__lead_describe": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_describe", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__lead_describe.sql", "original_file_path": "models/stg_marketo__lead_describe.sql", "unique_id": "model.marketo_source.stg_marketo__lead_describe", "fqn": ["marketo_source", "stg_marketo__lead_describe"], "alias": "stg_marketo__lead_describe", "checksum": {"name": "sha256", "checksum": "9c4c01161855f5da7ecfcfcb6e37be812b71b0cb2b29b130d896d6abcd3b89a1"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"lead_describe_id": {"name": "lead_describe_id", "description": "ID of the description.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "data_type": {"name": "data_type", "description": "Datatype of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "display_name": {"name": "display_name", "description": "UI display-name of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "field_max_length": {"name": "field_max_length", "description": "Max length of the field. Only applicable to text, string, and text area.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_rest_readonly": {"name": "is_rest_readonly", "description": "Whether the field is only available via the REST API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_soap_readonly": {"name": "is_soap_readonly", "description": "Whether the field is only available via the SOAP API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "rest_name": {"name": "rest_name", "description": "Description of REST API usage attributes in camel case.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "rest_name_xf": {"name": "rest_name_xf", "description": "Description of REST API usage attributes in snake case.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soap_name": {"name": "soap_name", "description": "Description of SOAP API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.680882, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_describe\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__lead_describe_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__lead_describe_tmp')),\n staging_columns=get_lead_describe_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n data_type,\n display_name,\n id as lead_describe_id,\n length as field_max_length,\n restname as rest_name,\n restread_only as is_rest_readonly,\n soapname as soap_name,\n soapread_only as is_soap_readonly\n from macro\n\n), regex as (\n\n select \n *,\n case\n when rest_name like '%\\\\_\\\\_c%' then lower(rest_name)\n else ltrim(lower(regexp_replace(rest_name, '[A-Z]','_\\\\0')),'_')\n end as rest_name_xf\n from fields\n\n)\n\nselect *\nfrom regex", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe_tmp", "package": null, "version": null}, {"name": "stg_marketo__lead_describe_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_lead_describe_columns", "macro.fivetran_utils.fill_staging_columns"], "nodes": ["model.marketo_source.stg_marketo__lead_describe_tmp", "model.marketo_source.stg_marketo__lead_describe_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__lead_describe.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_describe_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n data_type\n \n as \n \n data_type\n \n, \n \n \n display_name\n \n as \n \n display_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n length\n \n as \n \n length\n \n, \n \n \n restname\n \n as \n \n restname\n \n, \n \n \n restread_only\n \n as \n \n restread_only\n \n, \n \n \n soapname\n \n as \n \n soapname\n \n, \n \n \n soapread_only\n \n as \n \n soapread_only\n \n\n\n\n from base\n\n), fields as (\n\n select\n data_type,\n display_name,\n id as lead_describe_id,\n length as field_max_length,\n restname as rest_name,\n restread_only as is_rest_readonly,\n soapname as soap_name,\n soapread_only as is_soap_readonly\n from macro\n\n), regex as (\n\n select \n *,\n case\n when rest_name like '%\\\\_\\\\_c%' then lower(rest_name)\n else ltrim(lower(regexp_replace(rest_name, '[A-Z]','_\\\\0')),'_')\n end as rest_name_xf\n from fields\n\n)\n\nselect *\nfrom regex", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_unsubscribe_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_unsubscribe_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_unsubscribe_email.sql", "original_file_path": "models/stg_marketo__activity_unsubscribe_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email", "fqn": ["marketo_source", "stg_marketo__activity_unsubscribe_email"], "alias": "stg_marketo__activity_unsubscribe_email", "checksum": {"name": "sha256", "checksum": "f4edf9b66113b6470b0bd0e8eae2726d3de6c2545e904944f706dcfb39ab2f4e"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "client_ip_address": {"name": "client_ip_address", "description": "The IP address of the client that unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "form_fields": {"name": "form_fields", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "query_parameters": {"name": "query_parameters", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "referrer_url": {"name": "referrer_url", "description": "The URL of the referrer used to identify where the form visit originated from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webform_id": {"name": "webform_id", "description": "The ID of the unsubscribe web page.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webpage_id": {"name": "webpage_id", "description": "The ID of the unsubscribe web form.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1689004583.667708, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_unsubscribe_email\"", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_unsubscribe_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_unsubscribe_email_tmp')),\n staging_columns=get_activity_unsubscribe_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n client_ip_address,\n email_template_id,\n form_fields,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n query_parameters,\n referrer_url,\n user_agent,\n webform_id,\n webpage_id\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_unsubscribe_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_unsubscribe_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp", "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_unsubscribe_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_unsubscribe_email_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n client_ip_address\n \n as \n \n client_ip_address\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n form_fields\n \n as \n \n form_fields\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n query_parameters\n \n as \n \n query_parameters\n \n, \n \n \n referrer_url\n \n as \n \n referrer_url\n \n, \n cast(null as INT) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n, \n \n \n webform_id\n \n as \n \n webform_id\n \n, \n \n \n webpage_id\n \n as \n \n webpage_id\n \n\n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as TIMESTAMP) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n client_ip_address,\n email_template_id,\n form_fields,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n query_parameters,\n referrer_url,\n user_agent,\n webform_id,\n webpage_id\n from macro\n\n), surrogate as (\n\n select \n *,\n md5(cast(coalesce(cast(primary_attribute_value_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as TEXT), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as TEXT), '_dbt_utils_surrogate_key_null_') as TEXT)) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_email_delivered_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_delivered_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_email_delivered_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_email_delivered_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_email_delivered_tmp"], "alias": "stg_marketo__activity_email_delivered_tmp", "checksum": {"name": "sha256", "checksum": "03d7cae101b001a26032fe121d383f8193c9afdbdc74d254ac9789866c147712"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.4960861, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_delivered_tmp\"", "raw_code": "select *\nfrom {{ var('activity_email_delivered') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_email_delivered"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_email_delivered_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_delivered_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_click_email_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_click_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_click_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_click_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_click_email_tmp"], "alias": "stg_marketo__activity_click_email_tmp", "checksum": {"name": "sha256", "checksum": "b67805a9d05eb09cbc1247b1ff20a6eabba87b3722faa7ae62ce01f36c8034f5"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.500801, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_click_email_tmp\"", "raw_code": "select *\nfrom {{ var('activity_click_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_click_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_click_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_click_email_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__campaign_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__campaign_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__campaign_tmp.sql", "original_file_path": "models/tmp/stg_marketo__campaign_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__campaign_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__campaign_tmp"], "alias": "stg_marketo__campaign_tmp", "checksum": {"name": "sha256", "checksum": "b2cf4d02eab92151ffe1f387bdefeb8e195d49360e44876afa09f204900a08f0"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": true}, "created_at": 1689004583.505928, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__campaign_tmp\"", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False)) }}\n\nselect *\nfrom {{ var('campaign') }}", "language": "sql", "refs": [], "sources": [["marketo", "campaign"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.campaign"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__campaign_tmp.sql", "compiled": true, "compiled_code": "\n\nselect *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_campaign_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__lead_describe_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_describe_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__lead_describe_tmp.sql", "original_file_path": "models/tmp/stg_marketo__lead_describe_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__lead_describe_tmp"], "alias": "stg_marketo__lead_describe_tmp", "checksum": {"name": "sha256", "checksum": "076bb0dc6b5d12d6e0fd74312fc060487b1631f4407698e4242d162d4a06b26c"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.51052, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_describe_tmp\"", "raw_code": "select *\nfrom {{ var('lead_describe') }}", "language": "sql", "refs": [], "sources": [["marketo", "lead_describe"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__lead_describe_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_describe_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_change_data_value_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_change_data_value_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_change_data_value_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_change_data_value_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_change_data_value_tmp"], "alias": "stg_marketo__activity_change_data_value_tmp", "checksum": {"name": "sha256", "checksum": "2515768903723472b6b2c63204e07b3be741b6a60d054ad6278eb11e45635ba4"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.52024, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_change_data_value_tmp\"", "raw_code": "select *\nfrom {{ var('activity_change_data_value') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_change_data_value"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_change_data_value_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_change_data_value_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_email_bounced_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_email_bounced_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_email_bounced_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_email_bounced_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_email_bounced_tmp"], "alias": "stg_marketo__activity_email_bounced_tmp", "checksum": {"name": "sha256", "checksum": "ada6078aa5f9aa9542680709f13ef4f41a939793dba1dd7e95573daf9631a123"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.52454, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_bounced_tmp\"", "raw_code": "select *\nfrom {{ var('activity_email_bounced') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_email_bounced"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_email_bounced_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_bounced_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_open_email_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_open_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_open_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_open_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_open_email_tmp"], "alias": "stg_marketo__activity_open_email_tmp", "checksum": {"name": "sha256", "checksum": "da68d24a0e5cd5e2ea04461ba30829224d9be0645527c7750e112770f62904b8"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.5298219, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_open_email_tmp\"", "raw_code": "select *\nfrom {{ var('activity_open_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_open_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_open_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_open_email_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_merge_leads_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_merge_leads_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_merge_leads_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_merge_leads_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_merge_leads_tmp"], "alias": "stg_marketo__activity_merge_leads_tmp", "checksum": {"name": "sha256", "checksum": "05aefa5e82e1e7f9db39f760ca7e05f55f20d3ebab1a42d9f7a9ebac76575cc4"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.534108, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_merge_leads_tmp\"", "raw_code": "select *\nfrom {{ var('activity_merge_leads') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_merge_leads"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_merge_leads"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_merge_leads_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_merge_leads_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__program_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__program_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__program_tmp.sql", "original_file_path": "models/tmp/stg_marketo__program_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__program_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__program_tmp"], "alias": "stg_marketo__program_tmp", "checksum": {"name": "sha256", "checksum": "939b7102425fcac3e35b676d6f4cbf2d04fbcbfde99ca3953e4c8a1e1a89e401"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": true}, "created_at": 1689004583.538583, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__program_tmp\"", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False) and var('marketo__enable_programs', False)) }}\n\nselect *\nfrom {{ var('program') }}", "language": "sql", "refs": [], "sources": [["marketo", "program"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.program"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__program_tmp.sql", "compiled": true, "compiled_code": "\n\nselect *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_program_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_send_email_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_send_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_send_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_send_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_send_email_tmp"], "alias": "stg_marketo__activity_send_email_tmp", "checksum": {"name": "sha256", "checksum": "6f71b2d1da249e72e6d0aa1fdf30561c20d2b70ff4dcee478c3c53d3151216d3"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.543329, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_send_email_tmp\"", "raw_code": "select *\nfrom {{ var('activity_send_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_send_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_send_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_send_email_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__email_template_history_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__email_template_history_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__email_template_history_tmp.sql", "original_file_path": "models/tmp/stg_marketo__email_template_history_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__email_template_history_tmp"], "alias": "stg_marketo__email_template_history_tmp", "checksum": {"name": "sha256", "checksum": "ecf5e126aa9ce3fff1c7b4228a14ebf0444ecb9e53aa8f583ce9d232f87cf36b"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.547721, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__email_template_history_tmp\"", "raw_code": "select *\nfrom {{ var('email_template_history') }}", "language": "sql", "refs": [], "sources": [["marketo", "email_template_history"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__email_template_history_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_email_template_history_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_unsubscribe_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_unsubscribe_email_tmp"], "alias": "stg_marketo__activity_unsubscribe_email_tmp", "checksum": {"name": "sha256", "checksum": "19738f0a7d3263170f9d960d9fc7d9dfbad9bce271459e9668836f4e47a2f01d"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.552305, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_unsubscribe_email_tmp\"", "raw_code": "select *\nfrom {{ var('activity_unsubscribe_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_unsubscribe_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_unsubscribe_email_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__lead_tmp": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__lead_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__lead_tmp.sql", "original_file_path": "models/tmp/stg_marketo__lead_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__lead_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__lead_tmp"], "alias": "stg_marketo__lead_tmp", "checksum": {"name": "sha256", "checksum": "cec09aa5677c43f456ec365938c4b21611d022a736b30011e46ceec99e8b44ea"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1689004583.557492, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_tmp\"", "raw_code": "select *\nfrom {{ var('lead') }}", "language": "sql", "refs": [], "sources": [["marketo", "lead"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.lead"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__lead_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom \"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_data\"", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_change_data_value')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_change_data_value_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_change_data_value_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd", "fqn": ["marketo_source", "unique_stg_marketo__activity_change_data_value_activity_id"], "alias": "unique_stg_marketo__activity_change_data_value_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.701092, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_change_data_value_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_change_data_value\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_change_data_value", "attached_node": "model.marketo_source.stg_marketo__activity_change_data_value"}, "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_change_data_value')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_change_data_value_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_change_data_value_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108", "fqn": ["marketo_source", "not_null_stg_marketo__activity_change_data_value_activity_id"], "alias": "not_null_stg_marketo__activity_change_data_value_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.702842, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_change_data_value_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_change_data_value\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_change_data_value", "attached_node": "model.marketo_source.stg_marketo__activity_change_data_value"}, "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_click_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_click_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_click_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0", "fqn": ["marketo_source", "unique_stg_marketo__activity_click_email_activity_id"], "alias": "unique_stg_marketo__activity_click_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.704414, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_click_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_click_email\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_click_email", "attached_node": "model.marketo_source.stg_marketo__activity_click_email"}, "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_click_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_click_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_click_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd", "fqn": ["marketo_source", "not_null_stg_marketo__activity_click_email_activity_id"], "alias": "not_null_stg_marketo__activity_click_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.705773, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_click_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_click_email\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_click_email", "attached_node": "model.marketo_source.stg_marketo__activity_click_email"}, "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_bounced')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_email_bounced_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_email_bounced_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3", "fqn": ["marketo_source", "unique_stg_marketo__activity_email_bounced_activity_id"], "alias": "unique_stg_marketo__activity_email_bounced_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.707134, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_email_bounced_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_bounced\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_bounced", "attached_node": "model.marketo_source.stg_marketo__activity_email_bounced"}, "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_bounced')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_email_bounced_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_email_bounced_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2", "fqn": ["marketo_source", "not_null_stg_marketo__activity_email_bounced_activity_id"], "alias": "not_null_stg_marketo__activity_email_bounced_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.7087371, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_email_bounced_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_bounced\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_bounced", "attached_node": "model.marketo_source.stg_marketo__activity_email_bounced"}, "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_delivered')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_email_delivered_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_email_delivered_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87", "fqn": ["marketo_source", "unique_stg_marketo__activity_email_delivered_activity_id"], "alias": "unique_stg_marketo__activity_email_delivered_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.710191, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_email_delivered_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_delivered\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_delivered", "attached_node": "model.marketo_source.stg_marketo__activity_email_delivered"}, "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_delivered')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_email_delivered_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_email_delivered_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885", "fqn": ["marketo_source", "not_null_stg_marketo__activity_email_delivered_activity_id"], "alias": "not_null_stg_marketo__activity_email_delivered_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.711871, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_email_delivered_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_email_delivered\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_delivered", "attached_node": "model.marketo_source.stg_marketo__activity_email_delivered"}, "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_open_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_open_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_open_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6", "fqn": ["marketo_source", "unique_stg_marketo__activity_open_email_activity_id"], "alias": "unique_stg_marketo__activity_open_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.7132611, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_open_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_open_email\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_open_email", "attached_node": "model.marketo_source.stg_marketo__activity_open_email"}, "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_open_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_open_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_open_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396", "fqn": ["marketo_source", "not_null_stg_marketo__activity_open_email_activity_id"], "alias": "not_null_stg_marketo__activity_open_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.715161, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_open_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_open_email\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_open_email", "attached_node": "model.marketo_source.stg_marketo__activity_open_email"}, "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_send_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_send_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_send_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1", "fqn": ["marketo_source", "unique_stg_marketo__activity_send_email_activity_id"], "alias": "unique_stg_marketo__activity_send_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.716728, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_send_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_send_email\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_send_email", "attached_node": "model.marketo_source.stg_marketo__activity_send_email"}, "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_send_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_send_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_send_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8", "fqn": ["marketo_source", "not_null_stg_marketo__activity_send_email_activity_id"], "alias": "not_null_stg_marketo__activity_send_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.718177, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_send_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_send_email\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_send_email", "attached_node": "model.marketo_source.stg_marketo__activity_send_email"}, "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_unsubscribe_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__activity_unsubscribe_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_unsubscribe_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06", "fqn": ["marketo_source", "unique_stg_marketo__activity_unsubscribe_email_activity_id"], "alias": "unique_stg_marketo__activity_unsubscribe_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.719807, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_unsubscribe_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n activity_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_unsubscribe_email\"\nwhere activity_id is not null\ngroup by activity_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_unsubscribe_email", "attached_node": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_unsubscribe_email')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__activity_unsubscribe_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_unsubscribe_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0", "fqn": ["marketo_source", "not_null_stg_marketo__activity_unsubscribe_email_activity_id"], "alias": "not_null_stg_marketo__activity_unsubscribe_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.721248, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_unsubscribe_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_unsubscribe_email\"\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_unsubscribe_email", "attached_node": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "email_template_history_id", "model": "{{ get_where_subquery(ref('stg_marketo__email_template_history')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__email_template_history_email_template_history_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2", "fqn": ["marketo_source", "unique_stg_marketo__email_template_history_email_template_history_id"], "alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e", "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e"}, "created_at": 1689004583.725425, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}{{ config(alias=\"unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e\") }}", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n email_template_history_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__email_template_history\"\nwhere email_template_history_id is not null\ngroup by email_template_history_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "email_template_history_id", "file_key_name": "models.stg_marketo__email_template_history", "attached_node": "model.marketo_source.stg_marketo__email_template_history"}, "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "email_template_history_id", "model": "{{ get_where_subquery(ref('stg_marketo__email_template_history')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__email_template_history_email_template_history_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa", "fqn": ["marketo_source", "not_null_stg_marketo__email_template_history_email_template_history_id"], "alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd", "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd"}, "created_at": 1689004583.726743, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}{{ config(alias=\"not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd\") }}", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect email_template_history_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__email_template_history\"\nwhere email_template_history_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "email_template_history_id", "file_key_name": "models.stg_marketo__email_template_history", "attached_node": "model.marketo_source.stg_marketo__email_template_history"}, "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "lead_describe_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead_describe')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__lead_describe_lead_describe_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__lead_describe_lead_describe_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1", "fqn": ["marketo_source", "unique_stg_marketo__lead_describe_lead_describe_id"], "alias": "unique_stg_marketo__lead_describe_lead_describe_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.728058, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__lead_describe_lead_describe_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n lead_describe_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_describe\"\nwhere lead_describe_id is not null\ngroup by lead_describe_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "lead_describe_id", "file_key_name": "models.stg_marketo__lead_describe", "attached_node": "model.marketo_source.stg_marketo__lead_describe"}, "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "lead_describe_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead_describe')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__lead_describe_lead_describe_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__lead_describe_lead_describe_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879", "fqn": ["marketo_source", "not_null_stg_marketo__lead_describe_lead_describe_id"], "alias": "not_null_stg_marketo__lead_describe_lead_describe_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.729496, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__lead_describe_lead_describe_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_describe_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead_describe\"\nwhere lead_describe_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "lead_describe_id", "file_key_name": "models.stg_marketo__lead_describe", "attached_node": "model.marketo_source.stg_marketo__lead_describe"}, "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "lead_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__lead_lead_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__lead_lead_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f", "fqn": ["marketo_source", "unique_stg_marketo__lead_lead_id"], "alias": "unique_stg_marketo__lead_lead_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.730966, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__lead_lead_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n lead_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead\"\nwhere lead_id is not null\ngroup by lead_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "lead_id", "file_key_name": "models.stg_marketo__lead", "attached_node": "model.marketo_source.stg_marketo__lead"}, "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "lead_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__lead_lead_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__lead_lead_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055", "fqn": ["marketo_source", "not_null_stg_marketo__lead_lead_id"], "alias": "not_null_stg_marketo__lead_lead_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004583.732746, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__lead_lead_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__lead\"\nwhere lead_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "lead_id", "file_key_name": "models.stg_marketo__lead", "attached_node": "model.marketo_source.stg_marketo__lead"}, "model.marketo_source.stg_marketo__program": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__program", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__program.sql", "original_file_path": "models/stg_marketo__program.sql", "unique_id": "model.marketo_source.stg_marketo__program", "fqn": ["marketo_source", "stg_marketo__program"], "alias": "stg_marketo__program", "checksum": {"name": "sha256", "checksum": "0bb50c66626098d0b654bda8eb1ce87421e8c5e3b9a4b583016c67dbd79753cf"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"program_id": {"name": "program_id", "description": "ID of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "channel": {"name": "channel", "description": "Channel of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp the program was created at", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "end_timestamp": {"name": "end_timestamp", "description": "End date of the program. Applicable to event, email, and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_name": {"name": "program_name", "description": "Name of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_status": {"name": "program_status", "description": "Status of the program. Only valid for Email and engagement program types.\nAllowed values: locked, unlocked, on, off\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_type": {"name": "program_type", "description": "Type of the program. Allowed values: program, event, webinar, nurture\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_id": {"name": "sfdc_id", "description": "SFDC id of the program if linked to an SFDC campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_name": {"name": "sfdc_name", "description": "Name of the linked SFDC campaign if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "start_timestamp": {"name": "start_timestamp", "description": "Start date of program. Applicable to event, email and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp the program was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the program in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": true}, "created_at": 1689004695.478674, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__program\"", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False) and var('marketo__enable_programs', False)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__program_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__program_tmp')),\n staging_columns=get_program_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as program_id,\n channel,\n created_at as created_timestamp,\n description,\n end_date as end_timestamp,\n name as program_name,\n sfdc_id,\n sfdc_name,\n start_date as start_timestamp,\n status as program_status,\n type as program_type,\n updated_at as updated_timestamp,\n url,\n workspace\n\n {{ fivetran_utils.fill_pass_through_columns('marketo__program_passthrough_columns') }}\n\n from macro\n where not coalesce(_fivetran_deleted, false)\n \n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__program_tmp", "package": null, "version": null}, {"name": "stg_marketo__program_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_program_columns", "macro.fivetran_utils.fill_staging_columns", "macro.fivetran_utils.fill_pass_through_columns"], "nodes": ["model.marketo_source.stg_marketo__program_tmp", "model.marketo_source.stg_marketo__program_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__program.sql", "compiled": true, "compiled_code": "\n\nwith base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__program_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n _fivetran_deleted\n \n as \n \n _fivetran_deleted\n \n, \n \n \n channel\n \n as \n \n channel\n \n, \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n description\n \n as \n \n description\n \n, \n \n \n end_date\n \n as \n \n end_date\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n name\n \n as \n \n name\n \n, \n \n \n sfdc_id\n \n as \n \n sfdc_id\n \n, \n \n \n sfdc_name\n \n as \n \n sfdc_name\n \n, \n \n \n start_date\n \n as \n \n start_date\n \n, \n \n \n status\n \n as \n \n status\n \n, \n \n \n type\n \n as \n \n type\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n, \n \n \n url\n \n as \n \n url\n \n, \n \n \n workspace\n \n as \n \n workspace\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as program_id,\n channel,\n created_at as created_timestamp,\n description,\n end_date as end_timestamp,\n name as program_name,\n sfdc_id,\n sfdc_name,\n start_date as start_timestamp,\n status as program_status,\n type as program_type,\n updated_at as updated_timestamp,\n url,\n workspace\n\n \n\n\n\n\n\n from macro\n where not coalesce(_fivetran_deleted, false)\n \n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "model.marketo_source.stg_marketo__campaigns": {"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__campaigns", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__campaigns.sql", "original_file_path": "models/stg_marketo__campaigns.sql", "unique_id": "model.marketo_source.stg_marketo__campaigns", "fqn": ["marketo_source", "stg_marketo__campaigns"], "alias": "stg_marketo__campaigns", "checksum": {"name": "sha256", "checksum": "030c8c6c4498ff51d6833da7ba521ff5693f7c537caeb62202b9fd4b648ce245"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {"campaign_id": {"name": "campaign_id", "description": "ID of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_name": {"name": "campaign_name", "description": "Name of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_type": {"name": "campaign_type", "description": "Type of campaign, either 'batch' or 'trigger'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp when the campaign was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the campaign", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_active": {"name": "is_active", "description": "Whether the campaign is active. Only applicable to trigger campaigns.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "ID of the parent program, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp when the campaign was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the parent workspace, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "computed_url": {"name": "computed_url", "description": "The URL of the campaign in Marketo.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "flow_id": {"name": "flow_id", "description": "The ID of the flow that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_communication_limit_enabled": {"name": "is_communication_limit_enabled", "description": "Whether or not the campaign has a communication limit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_requestable": {"name": "is_requestable", "description": "Whether or not the campaign can be requested by leads.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_system": {"name": "is_system", "description": "Whether or not the campaign is a system campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "max_members": {"name": "max_members", "description": "The maximum number of members that the campaign can have.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_type": {"name": "qualification_rule_type", "description": "The type of qualification rule that the campaign uses.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_interval": {"name": "qualification_rule_interval", "description": "The interval for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_unit": {"name": "qualification_rule_unit", "description": "The unit for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_start_at": {"name": "recurrence_start_at", "description": "The start date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_end_at": {"name": "recurrence_end_at", "description": "The end date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval_type": {"name": "recurrence_interval_type", "description": "The type of recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval": {"name": "recurrence_interval", "description": "The value of the recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_weekday_only": {"name": "recurrence_weekday_only", "description": "Whether or not the recurrence is limited to weekdays.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_month": {"name": "recurrence_day_of_month", "description": "The day of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_week": {"name": "recurrence_day_of_week", "description": "The day of the week for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_week_of_month": {"name": "recurrence_week_of_month", "description": "The week of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "smart_list_id": {"name": "smart_list_id", "description": "The ID of the smart list that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "The status of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": true}, "created_at": 1689004695.48453, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__campaigns\"", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__campaign_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__campaign_tmp')),\n staging_columns=get_campaign_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n active as is_active,\n created_at as created_timestamp,\n description,\n id as campaign_id,\n name as campaign_name,\n program_id,\n type as campaign_type,\n updated_at as updated_timestamp,\n workspace_name,\n computed_url,\n flow_id,\n folder_id,\n folder_type,\n is_communication_limit_enabled,\n is_requestable,\n is_system,\n max_members,\n qualification_rule_type,\n qualification_rule_interval,\n qualification_rule_unit,\n recurrence_start_at,\n recurrence_end_at,\n recurrence_interval_type,\n recurrence_interval,\n recurrence_weekday_only,\n recurrence_day_of_month,\n recurrence_day_of_week,\n recurrence_week_of_month,\n smart_list_id,\n status\n from macro\n where not coalesce(_fivetran_deleted, false)\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__campaign_tmp", "package": null, "version": null}, {"name": "stg_marketo__campaign_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_campaign_columns", "macro.fivetran_utils.fill_staging_columns"], "nodes": ["model.marketo_source.stg_marketo__campaign_tmp", "model.marketo_source.stg_marketo__campaign_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__campaigns.sql", "compiled": true, "compiled_code": "\n\nwith base as (\n\n select *\n from \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__campaign_tmp\"\n\n), macro as (\n\n select\n \n cast(null as TIMESTAMP) as \n \n _fivetran_synced\n \n , \n \n \n _fivetran_deleted\n \n as \n \n _fivetran_deleted\n \n, \n \n \n active\n \n as \n \n active\n \n, \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n description\n \n as \n \n description\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n name\n \n as \n \n name\n \n, \n \n \n program_id\n \n as \n \n program_id\n \n, \n \n \n type\n \n as \n \n type\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n, \n \n \n workspace_name\n \n as \n \n workspace_name\n \n, \n \n \n computed_url\n \n as \n \n computed_url\n \n, \n \n \n flow_id\n \n as \n \n flow_id\n \n, \n \n \n folder_id\n \n as \n \n folder_id\n \n, \n \n \n folder_type\n \n as \n \n folder_type\n \n, \n \n \n is_communication_limit_enabled\n \n as \n \n is_communication_limit_enabled\n \n, \n \n \n is_requestable\n \n as \n \n is_requestable\n \n, \n \n \n is_system\n \n as \n \n is_system\n \n, \n \n \n max_members\n \n as \n \n max_members\n \n, \n \n \n qualification_rule_type\n \n as \n \n qualification_rule_type\n \n, \n \n \n qualification_rule_interval\n \n as \n \n qualification_rule_interval\n \n, \n \n \n qualification_rule_unit\n \n as \n \n qualification_rule_unit\n \n, \n \n \n recurrence_start_at\n \n as \n \n recurrence_start_at\n \n, \n \n \n recurrence_end_at\n \n as \n \n recurrence_end_at\n \n, \n \n \n recurrence_interval_type\n \n as \n \n recurrence_interval_type\n \n, \n \n \n recurrence_interval\n \n as \n \n recurrence_interval\n \n, \n \n \n recurrence_weekday_only\n \n as \n \n recurrence_weekday_only\n \n, \n \n \n recurrence_day_of_month\n \n as \n \n recurrence_day_of_month\n \n, \n \n \n recurrence_day_of_week\n \n as \n \n recurrence_day_of_week\n \n, \n \n \n recurrence_week_of_month\n \n as \n \n recurrence_week_of_month\n \n, \n \n \n smart_list_id\n \n as \n \n smart_list_id\n \n, \n \n \n status\n \n as \n \n status\n \n\n\n\n from base\n\n), fields as (\n\n select \n active as is_active,\n created_at as created_timestamp,\n description,\n id as campaign_id,\n name as campaign_name,\n program_id,\n type as campaign_type,\n updated_at as updated_timestamp,\n workspace_name,\n computed_url,\n flow_id,\n folder_id,\n folder_type,\n is_communication_limit_enabled,\n is_requestable,\n is_system,\n max_members,\n qualification_rule_type,\n qualification_rule_interval,\n qualification_rule_unit,\n recurrence_start_at,\n recurrence_end_at,\n recurrence_interval_type,\n recurrence_interval,\n recurrence_weekday_only,\n recurrence_day_of_month,\n recurrence_day_of_week,\n recurrence_week_of_month,\n smart_list_id,\n status\n from macro\n where not coalesce(_fivetran_deleted, false)\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}, "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "program_id", "model": "{{ get_where_subquery(ref('stg_marketo__program')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__program_program_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__program_program_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c", "fqn": ["marketo_source", "unique_stg_marketo__program_program_id"], "alias": "unique_stg_marketo__program_program_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004695.494266, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__program", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__program"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__program_program_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n program_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__program\"\nwhere program_id is not null\ngroup by program_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "program_id", "file_key_name": "models.stg_marketo__program", "attached_node": "model.marketo_source.stg_marketo__program"}, "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "program_id", "model": "{{ get_where_subquery(ref('stg_marketo__program')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__program_program_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__program_program_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f", "fqn": ["marketo_source", "not_null_stg_marketo__program_program_id"], "alias": "not_null_stg_marketo__program_program_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004695.4959419, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__program", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__program"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__program_program_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect program_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__program\"\nwhere program_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "program_id", "file_key_name": "models.stg_marketo__program", "attached_node": "model.marketo_source.stg_marketo__program"}, "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "campaign_id", "model": "{{ get_where_subquery(ref('stg_marketo__campaigns')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "unique_stg_marketo__campaigns_campaign_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__campaigns_campaign_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925", "fqn": ["marketo_source", "unique_stg_marketo__campaigns_campaign_id"], "alias": "unique_stg_marketo__campaigns_campaign_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004695.4973052, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__campaigns", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__campaigns"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__campaigns_campaign_id.sql", "compiled": true, "compiled_code": "\n \n \n\nselect\n campaign_id as unique_field,\n count(*) as n_records\n\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__campaigns\"\nwhere campaign_id is not null\ngroup by campaign_id\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "campaign_id", "file_key_name": "models.stg_marketo__campaigns", "attached_node": "model.marketo_source.stg_marketo__campaigns"}, "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "campaign_id", "model": "{{ get_where_subquery(ref('stg_marketo__campaigns')) }}"}, "namespace": null}, "database": "postgres", "schema": "marketo_source_integration_tests_8_dbt_test__audit", "name": "not_null_stg_marketo__campaigns_campaign_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__campaigns_campaign_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112", "fqn": ["marketo_source", "not_null_stg_marketo__campaigns_campaign_id"], "alias": "not_null_stg_marketo__campaigns_campaign_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1689004695.4986649, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__campaigns", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__campaigns"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__campaigns_campaign_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect campaign_id\nfrom \"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__campaigns\"\nwhere campaign_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "checksum": null}, "column_name": "campaign_id", "file_key_name": "models.stg_marketo__campaigns", "attached_node": "model.marketo_source.stg_marketo__campaigns"}}, "sources": {"source.marketo_source.marketo.lead": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "lead", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.lead", "fqn": ["marketo_source", "marketo", "lead"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_lead_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo leads.", "columns": {"id": {"name": "id", "description": "Unique integer id of a lead record.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "The timestamp each lead object was created at.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "The timestamp each lead object was last updated at.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "first_name": {"name": "first_name", "description": "The first name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "last_name": {"name": "last_name", "description": "The last name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_data\"", "created_at": 1689004583.737751}, "source.marketo_source.marketo.lead_describe": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "lead_describe", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.lead_describe", "fqn": ["marketo_source", "marketo", "lead_describe"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_lead_describe_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with metadata about lead object columns", "columns": {"data_type": {"name": "data_type", "description": "Datatype of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "display_name": {"name": "display_name", "description": "UI display-name of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "Unique integer id of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "length": {"name": "length", "description": "Max length of the field. Only applicable to text, string, and text area.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "restname": {"name": "restname", "description": "Description of REST API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "restread_only": {"name": "restread_only", "description": "Whether the field is only available via the REST API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soapname": {"name": "soapname", "description": "Description of SOAP API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soapread_only": {"name": "soapread_only", "description": "Whether the field is only available via the SOAP API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_lead_describe_data\"", "created_at": 1689004583.73793}, "source.marketo_source.marketo.activity_change_data_value": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_change_data_value", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_change_data_value", "fqn": ["marketo_source", "marketo", "activity_change_data_value"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_change_data_value_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with data value changes from the leads object.", "columns": {"api_method_name": {"name": "api_method_name", "description": "API method used for change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_date": {"name": "activity_date", "description": "Timestamp of the actvity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "Id of the lead associated to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "modifying_user": {"name": "modifying_user", "description": "The user who instigated the change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "new_value": {"name": "new_value", "description": "New value after the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "old_value": {"name": "old_value", "description": "Old value before the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "Value of the primary attribute.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "ID of the primary attribute field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reason": {"name": "reason", "description": "Reason for the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "request_id": {"name": "request_id", "description": "ID of the request made.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_change_data_value_data\"", "created_at": 1689004583.738079}, "source.marketo_source.marketo.campaign": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "campaign", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.campaign", "fqn": ["marketo_source", "marketo", "campaign"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_campaign_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo campaigns.", "columns": {"active": {"name": "active", "description": "Whether the campaign is active. Only applicable to trigger campaigns.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "Timestamp when the campaign was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the campaign", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "Unique integer ID of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "ID of the parent program, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "type": {"name": "type", "description": "Type of campaign, either 'batch' or 'trigger'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp when the campaign was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the parent workspace, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "computed_url": {"name": "computed_url", "description": "The URL of the campaign in Marketo.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "flow_id": {"name": "flow_id", "description": "The ID of the flow that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_communication_limit_enabled": {"name": "is_communication_limit_enabled", "description": "Whether or not the campaign has a communication limit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_requestable": {"name": "is_requestable", "description": "Whether or not the campaign can be requested by leads.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_system": {"name": "is_system", "description": "Whether or not the campaign is a system campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "max_members": {"name": "max_members", "description": "The maximum number of members that the campaign can have.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_type": {"name": "qualification_rule_type", "description": "The type of qualification rule that the campaign uses.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_interval": {"name": "qualification_rule_interval", "description": "The interval for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_unit": {"name": "qualification_rule_unit", "description": "The unit for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_start_at": {"name": "recurrence_start_at", "description": "The start date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_end_at": {"name": "recurrence_end_at", "description": "The end date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval_type": {"name": "recurrence_interval_type", "description": "The type of recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval": {"name": "recurrence_interval", "description": "The value of the recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_weekday_only": {"name": "recurrence_weekday_only", "description": "Whether or not the recurrence is limited to weekdays.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_month": {"name": "recurrence_day_of_month", "description": "The day of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_week": {"name": "recurrence_day_of_week", "description": "The day of the week for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_week_of_month": {"name": "recurrence_week_of_month", "description": "The week of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "smart_list_id": {"name": "smart_list_id", "description": "The ID of the smart list that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "The status of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "_fivetran_deleted": {"name": "_fivetran_deleted", "description": "Boolean created by Fivetran to indicate whether the record has been deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_campaign_data\"", "created_at": 1689004583.738245}, "source.marketo_source.marketo.program": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "program", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.program", "fqn": ["marketo_source", "marketo", "program"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_program_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo programs.", "columns": {"channel": {"name": "channel", "description": "Channel of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "Timestamp the program was created at", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "end_date": {"name": "end_date", "description": "End date of the program. Applicable to event, email, and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_id": {"name": "sfdc_id", "description": "SFDC id of the program if linked to an SFDC campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_name": {"name": "sfdc_name", "description": "Name of the linked SFDC campaign if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "start_date": {"name": "start_date", "description": "Start date of program. Applicable to event, email and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "Status of the program. Only valid for Email and engagement program types.\nAllowed values: locked, unlocked, on, off\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "type": {"name": "type", "description": "Type of the program. Allowed values: program, event, webinar, nurture\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp the program was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the program in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "_fivetran_deleted": {"name": "_fivetran_deleted", "description": "Boolean created by Fivetran to indicate whether the record has been deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_program_data\"", "created_at": 1689004583.738385}, "source.marketo_source.marketo.email_template_history": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "email_template_history", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.email_template_history", "fqn": ["marketo_source", "marketo", "email_template_history"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_email_template_history_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with a history of email template versions.", "columns": {"created_at": {"name": "created_at", "description": "Timestamp the email template was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_folder_name": {"name": "folder_folder_name", "description": "The name of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_value": {"name": "folder_value", "description": "The value of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_email": {"name": "from_email", "description": "The 'From' address of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_name": {"name": "from_name", "description": "The 'From' name of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the email template", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "operational": {"name": "operational", "description": "Whether the email is operational. Operational emails bypass unsubscribe status. Defaults to false.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "The ID of the email template's program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "publish_to_msi": {"name": "publish_to_msi", "description": "Whether the email is published to Marketo Sales Insight.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reply_email": {"name": "reply_email", "description": "Reply-To address of the Email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "Status filter for draft or approved versions.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "subject": {"name": "subject", "description": "Subject line of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "template": {"name": "template", "description": "ID of the parent template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "text_only": {"name": "text_only", "description": "Setting to include text-only version of email when sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp the email template was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the email template in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "version": {"name": "version", "description": "The type version of the email, either '1' or '2'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "web_view": {"name": "web_view", "description": "Whether 'View as Webpage' function is enabled for the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_email_template_history_data\"", "created_at": 1689004583.738536}, "source.marketo_source.marketo.activity_click_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_click_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_click_email", "fqn": ["marketo_source", "marketo", "activity_click_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_click_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email click activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The date of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device type the activity occurred on.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Whether the activity occurred on a mobile device.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "link": {"name": "link", "description": "The URL of the link clicked.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The Web browser user agent information obtained when the lead clicked the email link.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_click_email_data\"", "created_at": 1689004583.738677}, "source.marketo_source.marketo.activity_email_delivered": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_email_delivered", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_email_delivered", "fqn": ["marketo_source", "marketo", "activity_email_delivered"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_email_delivered_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email delivery activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was delivered.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_delivered_data\"", "created_at": 1689004583.738961}, "source.marketo_source.marketo.activity_email_bounced": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_email_bounced", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_email_bounced", "fqn": ["marketo_source", "marketo", "activity_email_bounced"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_email_bounced_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email bounce activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "category": {"name": "category", "description": "The category associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "details": {"name": "details", "description": "Details about why the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address that bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "subcategory": {"name": "subcategory", "description": "The subcategory associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_email_bounced_data\"", "created_at": 1689004583.7390988}, "source.marketo_source.marketo.activity_open_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_open_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_open_email", "fqn": ["marketo_source", "marketo", "activity_open_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_open_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email bounce activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Identifies whether a mobile device was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "platform": {"name": "platform", "description": "The platform that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_open_email_data\"", "created_at": 1689004583.7392378}, "source.marketo_source.marketo.activity_unsubscribe_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_unsubscribe_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_unsubscribe_email", "fqn": ["marketo_source", "marketo", "activity_unsubscribe_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_unsubscribe_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email unsusbscribe activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "client_ip_address": {"name": "client_ip_address", "description": "The IP address of the client that unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "form_fields": {"name": "form_fields", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "query_parameters": {"name": "query_parameters", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "referrer_url": {"name": "referrer_url", "description": "The URL of the referrer used to identify where the form visit originated from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webform_id": {"name": "webform_id", "description": "The ID of the unsubscribe web page.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webpage_id": {"name": "webpage_id", "description": "The ID of the unsubscribe web form.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_unsubscribe_email_data\"", "created_at": 1689004583.739378}, "source.marketo_source.marketo.activity_send_email": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_send_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_send_email", "fqn": ["marketo_source", "marketo", "activity_send_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_send_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email send activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_send_email_data\"", "created_at": 1689004583.739509}, "source.marketo_source.marketo.activity_delete_lead": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_delete_lead", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_delete_lead", "fqn": ["marketo_source", "marketo", "activity_delete_lead"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_delete_lead_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with deleted lead activities", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign": {"name": "campaign", "description": "The name of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_delete_lead_data\"", "created_at": 1689004583.739634}, "source.marketo_source.marketo.activity_merge_leads": {"database": "postgres", "schema": "marketo_source_integration_tests_8", "name": "activity_merge_leads", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_merge_leads", "fqn": ["marketo_source", "marketo", "activity_merge_leads"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_merge_leads_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with merged lead activities", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merge_ids": {"name": "merge_ids", "description": "ID of the lead that the lead was merged into.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8\".\"marketo_activity_merge_leads_data\"", "created_at": 1689004583.7397609}}, "macros": {"macro.dbt_postgres.postgres__current_timestamp": {"name": "postgres__current_timestamp", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/timestamps.sql", "original_file_path": "macros/timestamps.sql", "unique_id": "macro.dbt_postgres.postgres__current_timestamp", "macro_sql": "{% macro postgres__current_timestamp() -%}\n now()\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.553473, "supported_languages": null}, "macro.dbt_postgres.postgres__snapshot_string_as_time": {"name": "postgres__snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/timestamps.sql", "original_file_path": "macros/timestamps.sql", "unique_id": "macro.dbt_postgres.postgres__snapshot_string_as_time", "macro_sql": "{% macro postgres__snapshot_string_as_time(timestamp) -%}\n {%- set result = \"'\" ~ timestamp ~ \"'::timestamp without time zone\" -%}\n {{ return(result) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5540018, "supported_languages": null}, "macro.dbt_postgres.postgres__snapshot_get_time": {"name": "postgres__snapshot_get_time", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/timestamps.sql", "original_file_path": "macros/timestamps.sql", "unique_id": "macro.dbt_postgres.postgres__snapshot_get_time", "macro_sql": "{% macro postgres__snapshot_get_time() -%}\n {{ current_timestamp() }}::timestamp without time zone\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.554135, "supported_languages": null}, "macro.dbt_postgres.postgres__current_timestamp_backcompat": {"name": "postgres__current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/timestamps.sql", "original_file_path": "macros/timestamps.sql", "unique_id": "macro.dbt_postgres.postgres__current_timestamp_backcompat", "macro_sql": "{% macro postgres__current_timestamp_backcompat() %}\n current_timestamp::{{ type_timestamp() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.554257, "supported_languages": null}, "macro.dbt_postgres.postgres__current_timestamp_in_utc_backcompat": {"name": "postgres__current_timestamp_in_utc_backcompat", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/timestamps.sql", "original_file_path": "macros/timestamps.sql", "unique_id": "macro.dbt_postgres.postgres__current_timestamp_in_utc_backcompat", "macro_sql": "{% macro postgres__current_timestamp_in_utc_backcompat() %}\n (current_timestamp at time zone 'utc')::{{ type_timestamp() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.55438, "supported_languages": null}, "macro.dbt_postgres.postgres__get_catalog": {"name": "postgres__get_catalog", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/catalog.sql", "original_file_path": "macros/catalog.sql", "unique_id": "macro.dbt_postgres.postgres__get_catalog", "macro_sql": "{% macro postgres__get_catalog(information_schema, schemas) -%}\n\n {%- call statement('catalog', fetch_result=True) -%}\n {#\n If the user has multiple databases set and the first one is wrong, this will fail.\n But we won't fail in the case where there are multiple quoting-difference-only dbs, which is better.\n #}\n {% set database = information_schema.database %}\n {{ adapter.verify_database(database) }}\n\n select\n '{{ database }}' as table_database,\n sch.nspname as table_schema,\n tbl.relname as table_name,\n case tbl.relkind\n when 'v' then 'VIEW'\n else 'BASE TABLE'\n end as table_type,\n tbl_desc.description as table_comment,\n col.attname as column_name,\n col.attnum as column_index,\n pg_catalog.format_type(col.atttypid, col.atttypmod) as column_type,\n col_desc.description as column_comment,\n pg_get_userbyid(tbl.relowner) as table_owner\n\n from pg_catalog.pg_namespace sch\n join pg_catalog.pg_class tbl on tbl.relnamespace = sch.oid\n join pg_catalog.pg_attribute col on col.attrelid = tbl.oid\n left outer join pg_catalog.pg_description tbl_desc on (tbl_desc.objoid = tbl.oid and tbl_desc.objsubid = 0)\n left outer join pg_catalog.pg_description col_desc on (col_desc.objoid = tbl.oid and col_desc.objsubid = col.attnum)\n\n where (\n {%- for schema in schemas -%}\n upper(sch.nspname) = upper('{{ schema }}'){%- if not loop.last %} or {% endif -%}\n {%- endfor -%}\n )\n and not pg_is_other_temp_schema(sch.oid) -- not a temporary schema belonging to another session\n and tbl.relpersistence in ('p', 'u') -- [p]ermanent table or [u]nlogged table. Exclude [t]emporary tables\n and tbl.relkind in ('r', 'v', 'f', 'p') -- o[r]dinary table, [v]iew, [f]oreign table, [p]artitioned table. Other values are [i]ndex, [S]equence, [c]omposite type, [t]OAST table, [m]aterialized view\n and col.attnum > 0 -- negative numbers are used for system columns such as oid\n and not col.attisdropped -- column as not been dropped\n\n order by\n sch.nspname,\n tbl.relname,\n col.attnum\n\n {%- endcall -%}\n\n {{ return(load_result('catalog').table) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5555289, "supported_languages": null}, "macro.dbt_postgres.postgres_get_relations": {"name": "postgres_get_relations", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/relations.sql", "original_file_path": "macros/relations.sql", "unique_id": "macro.dbt_postgres.postgres_get_relations", "macro_sql": "{% macro postgres_get_relations () -%}\n\n {#\n -- in pg_depend, objid is the dependent, refobjid is the referenced object\n -- > a pg_depend entry indicates that the referenced object cannot be\n -- > dropped without also dropping the dependent object.\n #}\n\n {%- call statement('relations', fetch_result=True) -%}\n with relation as (\n select\n pg_rewrite.ev_class as class,\n pg_rewrite.oid as id\n from pg_rewrite\n ),\n class as (\n select\n oid as id,\n relname as name,\n relnamespace as schema,\n relkind as kind\n from pg_class\n ),\n dependency as (\n select distinct\n pg_depend.objid as id,\n pg_depend.refobjid as ref\n from pg_depend\n ),\n schema as (\n select\n pg_namespace.oid as id,\n pg_namespace.nspname as name\n from pg_namespace\n where nspname != 'information_schema' and nspname not like 'pg\\_%'\n ),\n referenced as (\n select\n relation.id AS id,\n referenced_class.name ,\n referenced_class.schema ,\n referenced_class.kind\n from relation\n join class as referenced_class on relation.class=referenced_class.id\n where referenced_class.kind in ('r', 'v')\n ),\n relationships as (\n select\n referenced.name as referenced_name,\n referenced.schema as referenced_schema_id,\n dependent_class.name as dependent_name,\n dependent_class.schema as dependent_schema_id,\n referenced.kind as kind\n from referenced\n join dependency on referenced.id=dependency.id\n join class as dependent_class on dependency.ref=dependent_class.id\n where\n (referenced.name != dependent_class.name or\n referenced.schema != dependent_class.schema)\n )\n\n select\n referenced_schema.name as referenced_schema,\n relationships.referenced_name as referenced_name,\n dependent_schema.name as dependent_schema,\n relationships.dependent_name as dependent_name\n from relationships\n join schema as dependent_schema on relationships.dependent_schema_id=dependent_schema.id\n join schema as referenced_schema on relationships.referenced_schema_id=referenced_schema.id\n group by referenced_schema, referenced_name, dependent_schema, dependent_name\n order by referenced_schema, referenced_name, dependent_schema, dependent_name;\n\n {%- endcall -%}\n\n {{ return(load_result('relations').table) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.556211, "supported_languages": null}, "macro.dbt_postgres.postgres__create_table_as": {"name": "postgres__create_table_as", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__create_table_as", "macro_sql": "{% macro postgres__create_table_as(temporary, relation, sql) -%}\n {%- set unlogged = config.get('unlogged', default=false) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n\n create {% if temporary -%}\n temporary\n {%- elif unlogged -%}\n unlogged\n {%- endif %} table {{ relation }}\n {% set contract_config = config.get('contract') %}\n {% if contract_config.enforced %}\n {{ get_assert_columns_equivalent(sql) }}\n {{ get_table_columns_and_constraints() }} ;\n insert into {{ relation }} (\n {{ adapter.dispatch('get_column_names', 'dbt')() }}\n )\n {%- set sql = get_select_subquery(sql) %}\n {% else %}\n as\n {% endif %}\n (\n {{ sql }}\n );\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_assert_columns_equivalent", "macro.dbt.get_table_columns_and_constraints", "macro.dbt.default__get_column_names", "macro.dbt.get_select_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.564297, "supported_languages": null}, "macro.dbt_postgres.postgres__get_create_index_sql": {"name": "postgres__get_create_index_sql", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__get_create_index_sql", "macro_sql": "{% macro postgres__get_create_index_sql(relation, index_dict) -%}\n {%- set index_config = adapter.parse_index(index_dict) -%}\n {%- set comma_separated_columns = \", \".join(index_config.columns) -%}\n {%- set index_name = index_config.render(relation) -%}\n\n create {% if index_config.unique -%}\n unique\n {%- endif %} index if not exists\n \"{{ index_name }}\"\n on {{ relation }} {% if index_config.type -%}\n using {{ index_config.type }}\n {%- endif %}\n ({{ comma_separated_columns }});\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.564872, "supported_languages": null}, "macro.dbt_postgres.postgres__create_schema": {"name": "postgres__create_schema", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__create_schema", "macro_sql": "{% macro postgres__create_schema(relation) -%}\n {% if relation.database -%}\n {{ adapter.verify_database(relation.database) }}\n {%- endif -%}\n {%- call statement('create_schema') -%}\n create schema if not exists {{ relation.without_identifier().include(database=False) }}\n {%- endcall -%}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.565227, "supported_languages": null}, "macro.dbt_postgres.postgres__drop_schema": {"name": "postgres__drop_schema", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__drop_schema", "macro_sql": "{% macro postgres__drop_schema(relation) -%}\n {% if relation.database -%}\n {{ adapter.verify_database(relation.database) }}\n {%- endif -%}\n {%- call statement('drop_schema') -%}\n drop schema if exists {{ relation.without_identifier().include(database=False) }} cascade\n {%- endcall -%}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.565579, "supported_languages": null}, "macro.dbt_postgres.postgres__get_columns_in_relation": {"name": "postgres__get_columns_in_relation", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__get_columns_in_relation", "macro_sql": "{% macro postgres__get_columns_in_relation(relation) -%}\n {% call statement('get_columns_in_relation', fetch_result=True) %}\n select\n column_name,\n data_type,\n character_maximum_length,\n numeric_precision,\n numeric_scale\n\n from {{ relation.information_schema('columns') }}\n where table_name = '{{ relation.identifier }}'\n {% if relation.schema %}\n and table_schema = '{{ relation.schema }}'\n {% endif %}\n order by ordinal_position\n\n {% endcall %}\n {% set table = load_result('get_columns_in_relation').table %}\n {{ return(sql_convert_columns_in_relation(table)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.sql_convert_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.566106, "supported_languages": null}, "macro.dbt_postgres.postgres__list_relations_without_caching": {"name": "postgres__list_relations_without_caching", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__list_relations_without_caching", "macro_sql": "{% macro postgres__list_relations_without_caching(schema_relation) %}\n {% call statement('list_relations_without_caching', fetch_result=True) -%}\n select\n '{{ schema_relation.database }}' as database,\n tablename as name,\n schemaname as schema,\n 'table' as type\n from pg_tables\n where schemaname ilike '{{ schema_relation.schema }}'\n union all\n select\n '{{ schema_relation.database }}' as database,\n viewname as name,\n schemaname as schema,\n 'view' as type\n from pg_views\n where schemaname ilike '{{ schema_relation.schema }}'\n {% endcall %}\n {{ return(load_result('list_relations_without_caching').table) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5665321, "supported_languages": null}, "macro.dbt_postgres.postgres__information_schema_name": {"name": "postgres__information_schema_name", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__information_schema_name", "macro_sql": "{% macro postgres__information_schema_name(database) -%}\n {% if database_name -%}\n {{ adapter.verify_database(database_name) }}\n {%- endif -%}\n information_schema\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.566724, "supported_languages": null}, "macro.dbt_postgres.postgres__list_schemas": {"name": "postgres__list_schemas", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__list_schemas", "macro_sql": "{% macro postgres__list_schemas(database) %}\n {% if database -%}\n {{ adapter.verify_database(database) }}\n {%- endif -%}\n {% call statement('list_schemas', fetch_result=True, auto_begin=False) %}\n select distinct nspname from pg_namespace\n {% endcall %}\n {{ return(load_result('list_schemas').table) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.567105, "supported_languages": null}, "macro.dbt_postgres.postgres__check_schema_exists": {"name": "postgres__check_schema_exists", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__check_schema_exists", "macro_sql": "{% macro postgres__check_schema_exists(information_schema, schema) -%}\n {% if information_schema.database -%}\n {{ adapter.verify_database(information_schema.database) }}\n {%- endif -%}\n {% call statement('check_schema_exists', fetch_result=True, auto_begin=False) %}\n select count(*) from pg_namespace where nspname = '{{ schema }}'\n {% endcall %}\n {{ return(load_result('check_schema_exists').table) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.567682, "supported_languages": null}, "macro.dbt_postgres.postgres__make_relation_with_suffix": {"name": "postgres__make_relation_with_suffix", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__make_relation_with_suffix", "macro_sql": "{% macro postgres__make_relation_with_suffix(base_relation, suffix, dstring) %}\n {% if dstring %}\n {% set dt = modules.datetime.datetime.now() %}\n {% set dtstring = dt.strftime(\"%H%M%S%f\") %}\n {% set suffix = suffix ~ dtstring %}\n {% endif %}\n {% set suffix_length = suffix|length %}\n {% set relation_max_name_length = base_relation.relation_max_name_length() %}\n {% if suffix_length > relation_max_name_length %}\n {% do exceptions.raise_compiler_error('Relation suffix is too long (' ~ suffix_length ~ ' characters). Maximum length is ' ~ relation_max_name_length ~ ' characters.') %}\n {% endif %}\n {% set identifier = base_relation.identifier[:relation_max_name_length - suffix_length] ~ suffix %}\n\n {{ return(base_relation.incorporate(path={\"identifier\": identifier })) }}\n\n {% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5686579, "supported_languages": null}, "macro.dbt_postgres.postgres__make_intermediate_relation": {"name": "postgres__make_intermediate_relation", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__make_intermediate_relation", "macro_sql": "{% macro postgres__make_intermediate_relation(base_relation, suffix) %}\n {{ return(postgres__make_relation_with_suffix(base_relation, suffix, dstring=False)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_relation_with_suffix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.568887, "supported_languages": null}, "macro.dbt_postgres.postgres__make_temp_relation": {"name": "postgres__make_temp_relation", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__make_temp_relation", "macro_sql": "{% macro postgres__make_temp_relation(base_relation, suffix) %}\n {% set temp_relation = postgres__make_relation_with_suffix(base_relation, suffix, dstring=True) %}\n {{ return(temp_relation.incorporate(path={\"schema\": none,\n \"database\": none})) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_relation_with_suffix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.569231, "supported_languages": null}, "macro.dbt_postgres.postgres__make_backup_relation": {"name": "postgres__make_backup_relation", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__make_backup_relation", "macro_sql": "{% macro postgres__make_backup_relation(base_relation, backup_relation_type, suffix) %}\n {% set backup_relation = postgres__make_relation_with_suffix(base_relation, suffix, dstring=False) %}\n {{ return(backup_relation.incorporate(type=backup_relation_type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_relation_with_suffix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.569528, "supported_languages": null}, "macro.dbt_postgres.postgres_escape_comment": {"name": "postgres_escape_comment", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres_escape_comment", "macro_sql": "{% macro postgres_escape_comment(comment) -%}\n {% if comment is not string %}\n {% do exceptions.raise_compiler_error('cannot escape a non-string: ' ~ comment) %}\n {% endif %}\n {%- set magic = '$dbt_comment_literal_block$' -%}\n {%- if magic in comment -%}\n {%- do exceptions.raise_compiler_error('The string ' ~ magic ~ ' is not allowed in comments.') -%}\n {%- endif -%}\n {{ magic }}{{ comment }}{{ magic }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.569982, "supported_languages": null}, "macro.dbt_postgres.postgres__alter_relation_comment": {"name": "postgres__alter_relation_comment", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__alter_relation_comment", "macro_sql": "{% macro postgres__alter_relation_comment(relation, comment) %}\n {% set escaped_comment = postgres_escape_comment(comment) %}\n comment on {{ relation.type }} {{ relation }} is {{ escaped_comment }};\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres_escape_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.570224, "supported_languages": null}, "macro.dbt_postgres.postgres__alter_column_comment": {"name": "postgres__alter_column_comment", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__alter_column_comment", "macro_sql": "{% macro postgres__alter_column_comment(relation, column_dict) %}\n {% set existing_columns = adapter.get_columns_in_relation(relation) | map(attribute=\"name\") | list %}\n {% for column_name in column_dict if (column_name in existing_columns) %}\n {% set comment = column_dict[column_name]['description'] %}\n {% set escaped_comment = postgres_escape_comment(comment) %}\n comment on column {{ relation }}.{{ adapter.quote(column_name) if column_dict[column_name]['quote'] else column_name }} is {{ escaped_comment }};\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres_escape_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.570861, "supported_languages": null}, "macro.dbt_postgres.postgres__get_show_grant_sql": {"name": "postgres__get_show_grant_sql", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__get_show_grant_sql", "macro_sql": "\n\n{%- macro postgres__get_show_grant_sql(relation) -%}\n select grantee, privilege_type\n from {{ relation.information_schema('role_table_grants') }}\n where grantor = current_role\n and grantee != current_role\n and table_schema = '{{ relation.schema }}'\n and table_name = '{{ relation.identifier }}'\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.571079, "supported_languages": null}, "macro.dbt_postgres.postgres__copy_grants": {"name": "postgres__copy_grants", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_postgres.postgres__copy_grants", "macro_sql": "{% macro postgres__copy_grants() %}\n {{ return(False) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5712, "supported_languages": null}, "macro.dbt_postgres.postgres__get_incremental_default_sql": {"name": "postgres__get_incremental_default_sql", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/materializations/incremental_strategies.sql", "original_file_path": "macros/materializations/incremental_strategies.sql", "unique_id": "macro.dbt_postgres.postgres__get_incremental_default_sql", "macro_sql": "{% macro postgres__get_incremental_default_sql(arg_dict) %}\n\n {% if arg_dict[\"unique_key\"] %}\n {% do return(get_incremental_delete_insert_sql(arg_dict)) %}\n {% else %}\n {% do return(get_incremental_append_sql(arg_dict)) %}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_incremental_delete_insert_sql", "macro.dbt.get_incremental_append_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.571614, "supported_languages": null}, "macro.dbt_postgres.postgres__snapshot_merge_sql": {"name": "postgres__snapshot_merge_sql", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/materializations/snapshot_merge.sql", "original_file_path": "macros/materializations/snapshot_merge.sql", "unique_id": "macro.dbt_postgres.postgres__snapshot_merge_sql", "macro_sql": "{% macro postgres__snapshot_merge_sql(target, source, insert_cols) -%}\n {%- set insert_cols_csv = insert_cols | join(', ') -%}\n\n update {{ target }}\n set dbt_valid_to = DBT_INTERNAL_SOURCE.dbt_valid_to\n from {{ source }} as DBT_INTERNAL_SOURCE\n where DBT_INTERNAL_SOURCE.dbt_scd_id::text = {{ target }}.dbt_scd_id::text\n and DBT_INTERNAL_SOURCE.dbt_change_type::text in ('update'::text, 'delete'::text)\n and {{ target }}.dbt_valid_to is null;\n\n insert into {{ target }} ({{ insert_cols_csv }})\n select {% for column in insert_cols -%}\n DBT_INTERNAL_SOURCE.{{ column }} {%- if not loop.last %}, {%- endif %}\n {%- endfor %}\n from {{ source }} as DBT_INTERNAL_SOURCE\n where DBT_INTERNAL_SOURCE.dbt_change_type::text = 'insert'::text;\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.572366, "supported_languages": null}, "macro.dbt_postgres.postgres__dateadd": {"name": "postgres__dateadd", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt_postgres.postgres__dateadd", "macro_sql": "{% macro postgres__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n {{ from_date_or_timestamp }} + ((interval '1 {{ datepart }}') * ({{ interval }}))\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.572611, "supported_languages": null}, "macro.dbt_postgres.postgres__listagg": {"name": "postgres__listagg", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt_postgres.postgres__listagg", "macro_sql": "{% macro postgres__listagg(measure, delimiter_text, order_by_clause, limit_num) -%}\n\n {% if limit_num -%}\n array_to_string(\n (array_agg(\n {{ measure }}\n {% if order_by_clause -%}\n {{ order_by_clause }}\n {%- endif %}\n ))[1:{{ limit_num }}],\n {{ delimiter_text }}\n )\n {%- else %}\n string_agg(\n {{ measure }},\n {{ delimiter_text }}\n {% if order_by_clause -%}\n {{ order_by_clause }}\n {%- endif %}\n )\n {%- endif %}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.573272, "supported_languages": null}, "macro.dbt_postgres.postgres__datediff": {"name": "postgres__datediff", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt_postgres.postgres__datediff", "macro_sql": "{% macro postgres__datediff(first_date, second_date, datepart) -%}\n\n {% if datepart == 'year' %}\n (date_part('year', ({{second_date}})::date) - date_part('year', ({{first_date}})::date))\n {% elif datepart == 'quarter' %}\n ({{ datediff(first_date, second_date, 'year') }} * 4 + date_part('quarter', ({{second_date}})::date) - date_part('quarter', ({{first_date}})::date))\n {% elif datepart == 'month' %}\n ({{ datediff(first_date, second_date, 'year') }} * 12 + date_part('month', ({{second_date}})::date) - date_part('month', ({{first_date}})::date))\n {% elif datepart == 'day' %}\n (({{second_date}})::date - ({{first_date}})::date)\n {% elif datepart == 'week' %}\n ({{ datediff(first_date, second_date, 'day') }} / 7 + case\n when date_part('dow', ({{first_date}})::timestamp) <= date_part('dow', ({{second_date}})::timestamp) then\n case when {{first_date}} <= {{second_date}} then 0 else -1 end\n else\n case when {{first_date}} <= {{second_date}} then 1 else 0 end\n end)\n {% elif datepart == 'hour' %}\n ({{ datediff(first_date, second_date, 'day') }} * 24 + date_part('hour', ({{second_date}})::timestamp) - date_part('hour', ({{first_date}})::timestamp))\n {% elif datepart == 'minute' %}\n ({{ datediff(first_date, second_date, 'hour') }} * 60 + date_part('minute', ({{second_date}})::timestamp) - date_part('minute', ({{first_date}})::timestamp))\n {% elif datepart == 'second' %}\n ({{ datediff(first_date, second_date, 'minute') }} * 60 + floor(date_part('second', ({{second_date}})::timestamp)) - floor(date_part('second', ({{first_date}})::timestamp)))\n {% elif datepart == 'millisecond' %}\n ({{ datediff(first_date, second_date, 'minute') }} * 60000 + floor(date_part('millisecond', ({{second_date}})::timestamp)) - floor(date_part('millisecond', ({{first_date}})::timestamp)))\n {% elif datepart == 'microsecond' %}\n ({{ datediff(first_date, second_date, 'minute') }} * 60000000 + floor(date_part('microsecond', ({{second_date}})::timestamp)) - floor(date_part('microsecond', ({{first_date}})::timestamp)))\n {% else %}\n {{ exceptions.raise_compiler_error(\"Unsupported datepart for macro datediff in postgres: {!r}\".format(datepart)) }}\n {% endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5767229, "supported_languages": null}, "macro.dbt_postgres.postgres__any_value": {"name": "postgres__any_value", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/any_value.sql", "original_file_path": "macros/utils/any_value.sql", "unique_id": "macro.dbt_postgres.postgres__any_value", "macro_sql": "{% macro postgres__any_value(expression) -%}\n\n min({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.576886, "supported_languages": null}, "macro.dbt_postgres.postgres__last_day": {"name": "postgres__last_day", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt_postgres.postgres__last_day", "macro_sql": "{% macro postgres__last_day(date, datepart) -%}\n\n {%- if datepart == 'quarter' -%}\n -- postgres dateadd does not support quarter interval.\n cast(\n {{dbt.dateadd('day', '-1',\n dbt.dateadd('month', '3', dbt.date_trunc(datepart, date))\n )}}\n as date)\n {%- else -%}\n {{dbt.default_last_day(date, datepart)}}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.dateadd", "macro.dbt.date_trunc", "macro.dbt.default_last_day"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5774012, "supported_languages": null}, "macro.dbt_postgres.postgres__split_part": {"name": "postgres__split_part", "resource_type": "macro", "package_name": "dbt_postgres", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt_postgres.postgres__split_part", "macro_sql": "{% macro postgres__split_part(string_text, delimiter_text, part_number) %}\n\n {% if part_number >= 0 %}\n {{ dbt.default__split_part(string_text, delimiter_text, part_number) }}\n {% else %}\n {{ dbt._split_part_negative(string_text, delimiter_text, part_number) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__split_part", "macro.dbt._split_part_negative"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.577986, "supported_languages": null}, "macro.dbt.run_hooks": {"name": "run_hooks", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.run_hooks", "macro_sql": "{% macro run_hooks(hooks, inside_transaction=True) %}\n {% for hook in hooks | selectattr('transaction', 'equalto', inside_transaction) %}\n {% if not inside_transaction and loop.first %}\n {% call statement(auto_begin=inside_transaction) %}\n commit;\n {% endcall %}\n {% endif %}\n {% set rendered = render(hook.get('sql')) | trim %}\n {% if (rendered | length) > 0 %}\n {% call statement(auto_begin=inside_transaction) %}\n {{ rendered }}\n {% endcall %}\n {% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.579322, "supported_languages": null}, "macro.dbt.make_hook_config": {"name": "make_hook_config", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.make_hook_config", "macro_sql": "{% macro make_hook_config(sql, inside_transaction) %}\n {{ tojson({\"sql\": sql, \"transaction\": inside_transaction}) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.57955, "supported_languages": null}, "macro.dbt.before_begin": {"name": "before_begin", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.before_begin", "macro_sql": "{% macro before_begin(sql) %}\n {{ make_hook_config(sql, inside_transaction=False) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5797062, "supported_languages": null}, "macro.dbt.in_transaction": {"name": "in_transaction", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.in_transaction", "macro_sql": "{% macro in_transaction(sql) %}\n {{ make_hook_config(sql, inside_transaction=True) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5798578, "supported_languages": null}, "macro.dbt.after_commit": {"name": "after_commit", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.after_commit", "macro_sql": "{% macro after_commit(sql) %}\n {{ make_hook_config(sql, inside_transaction=False) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5800068, "supported_languages": null}, "macro.dbt.set_sql_header": {"name": "set_sql_header", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.set_sql_header", "macro_sql": "{% macro set_sql_header(config) -%}\n {{ config.set('sql_header', caller()) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.580417, "supported_languages": null}, "macro.dbt.should_full_refresh": {"name": "should_full_refresh", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.should_full_refresh", "macro_sql": "{% macro should_full_refresh() %}\n {% set config_full_refresh = config.get('full_refresh') %}\n {% if config_full_refresh is none %}\n {% set config_full_refresh = flags.FULL_REFRESH %}\n {% endif %}\n {% do return(config_full_refresh) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5807402, "supported_languages": null}, "macro.dbt.should_store_failures": {"name": "should_store_failures", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.should_store_failures", "macro_sql": "{% macro should_store_failures() %}\n {% set config_store_failures = config.get('store_failures') %}\n {% if config_store_failures is none %}\n {% set config_store_failures = flags.STORE_FAILURES %}\n {% endif %}\n {% do return(config_store_failures) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5810628, "supported_languages": null}, "macro.dbt.snapshot_merge_sql": {"name": "snapshot_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot_merge.sql", "original_file_path": "macros/materializations/snapshots/snapshot_merge.sql", "unique_id": "macro.dbt.snapshot_merge_sql", "macro_sql": "{% macro snapshot_merge_sql(target, source, insert_cols) -%}\n {{ adapter.dispatch('snapshot_merge_sql', 'dbt')(target, source, insert_cols) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__snapshot_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.581537, "supported_languages": null}, "macro.dbt.default__snapshot_merge_sql": {"name": "default__snapshot_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot_merge.sql", "original_file_path": "macros/materializations/snapshots/snapshot_merge.sql", "unique_id": "macro.dbt.default__snapshot_merge_sql", "macro_sql": "{% macro default__snapshot_merge_sql(target, source, insert_cols) -%}\n {%- set insert_cols_csv = insert_cols | join(', ') -%}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on DBT_INTERNAL_SOURCE.dbt_scd_id = DBT_INTERNAL_DEST.dbt_scd_id\n\n when matched\n and DBT_INTERNAL_DEST.dbt_valid_to is null\n and DBT_INTERNAL_SOURCE.dbt_change_type in ('update', 'delete')\n then update\n set dbt_valid_to = DBT_INTERNAL_SOURCE.dbt_valid_to\n\n when not matched\n and DBT_INTERNAL_SOURCE.dbt_change_type = 'insert'\n then insert ({{ insert_cols_csv }})\n values ({{ insert_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5818272, "supported_languages": null}, "macro.dbt.strategy_dispatch": {"name": "strategy_dispatch", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.strategy_dispatch", "macro_sql": "{% macro strategy_dispatch(name) -%}\n{% set original_name = name %}\n {% if '.' in name %}\n {% set package_name, name = name.split(\".\", 1) %}\n {% else %}\n {% set package_name = none %}\n {% endif %}\n\n {% if package_name is none %}\n {% set package_context = context %}\n {% elif package_name in context %}\n {% set package_context = context[package_name] %}\n {% else %}\n {% set error_msg %}\n Could not find package '{{package_name}}', called with '{{original_name}}'\n {% endset %}\n {{ exceptions.raise_compiler_error(error_msg | trim) }}\n {% endif %}\n\n {%- set search_name = 'snapshot_' ~ name ~ '_strategy' -%}\n\n {% if search_name not in package_context %}\n {% set error_msg %}\n The specified strategy macro '{{name}}' was not found in package '{{ package_name }}'\n {% endset %}\n {{ exceptions.raise_compiler_error(error_msg | trim) }}\n {% endif %}\n {{ return(package_context[search_name]) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.585783, "supported_languages": null}, "macro.dbt.snapshot_hash_arguments": {"name": "snapshot_hash_arguments", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_hash_arguments", "macro_sql": "{% macro snapshot_hash_arguments(args) -%}\n {{ adapter.dispatch('snapshot_hash_arguments', 'dbt')(args) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.585974, "supported_languages": null}, "macro.dbt.default__snapshot_hash_arguments": {"name": "default__snapshot_hash_arguments", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.default__snapshot_hash_arguments", "macro_sql": "{% macro default__snapshot_hash_arguments(args) -%}\n md5({%- for arg in args -%}\n coalesce(cast({{ arg }} as varchar ), '')\n {% if not loop.last %} || '|' || {% endif %}\n {%- endfor -%})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.586207, "supported_languages": null}, "macro.dbt.snapshot_timestamp_strategy": {"name": "snapshot_timestamp_strategy", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_timestamp_strategy", "macro_sql": "{% macro snapshot_timestamp_strategy(node, snapshotted_rel, current_rel, config, target_exists) %}\n {% set primary_key = config['unique_key'] %}\n {% set updated_at = config['updated_at'] %}\n {% set invalidate_hard_deletes = config.get('invalidate_hard_deletes', false) %}\n\n {#/*\n The snapshot relation might not have an {{ updated_at }} value if the\n snapshot strategy is changed from `check` to `timestamp`. We\n should use a dbt-created column for the comparison in the snapshot\n table instead of assuming that the user-supplied {{ updated_at }}\n will be present in the historical data.\n\n See https://github.com/dbt-labs/dbt-core/issues/2350\n */ #}\n {% set row_changed_expr -%}\n ({{ snapshotted_rel }}.dbt_valid_from < {{ current_rel }}.{{ updated_at }})\n {%- endset %}\n\n {% set scd_id_expr = snapshot_hash_arguments([primary_key, updated_at]) %}\n\n {% do return({\n \"unique_key\": primary_key,\n \"updated_at\": updated_at,\n \"row_changed\": row_changed_expr,\n \"scd_id\": scd_id_expr,\n \"invalidate_hard_deletes\": invalidate_hard_deletes\n }) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.58698, "supported_languages": null}, "macro.dbt.snapshot_string_as_time": {"name": "snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_string_as_time", "macro_sql": "{% macro snapshot_string_as_time(timestamp) -%}\n {{ adapter.dispatch('snapshot_string_as_time', 'dbt')(timestamp) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__snapshot_string_as_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.587157, "supported_languages": null}, "macro.dbt.default__snapshot_string_as_time": {"name": "default__snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.default__snapshot_string_as_time", "macro_sql": "{% macro default__snapshot_string_as_time(timestamp) %}\n {% do exceptions.raise_not_implemented(\n 'snapshot_string_as_time macro not implemented for adapter '+adapter.type()\n ) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5873432, "supported_languages": null}, "macro.dbt.snapshot_check_all_get_existing_columns": {"name": "snapshot_check_all_get_existing_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_check_all_get_existing_columns", "macro_sql": "{% macro snapshot_check_all_get_existing_columns(node, target_exists, check_cols_config) -%}\n {%- if not target_exists -%}\n {#-- no table yet -> return whatever the query does --#}\n {{ return((false, query_columns)) }}\n {%- endif -%}\n\n {#-- handle any schema changes --#}\n {%- set target_relation = adapter.get_relation(database=node.database, schema=node.schema, identifier=node.alias) -%}\n\n {% if check_cols_config == 'all' %}\n {%- set query_columns = get_columns_in_query(node['compiled_code']) -%}\n\n {% elif check_cols_config is iterable and (check_cols_config | length) > 0 %}\n {#-- query for proper casing/quoting, to support comparison below --#}\n {%- set select_check_cols_from_target -%}\n {#-- N.B. The whitespace below is necessary to avoid edge case issue with comments --#}\n {#-- See: https://github.com/dbt-labs/dbt-core/issues/6781 --#}\n select {{ check_cols_config | join(', ') }} from (\n {{ node['compiled_code'] }}\n ) subq\n {%- endset -%}\n {% set query_columns = get_columns_in_query(select_check_cols_from_target) %}\n\n {% else %}\n {% do exceptions.raise_compiler_error(\"Invalid value for 'check_cols': \" ~ check_cols_config) %}\n {% endif %}\n\n {%- set existing_cols = adapter.get_columns_in_relation(target_relation) | map(attribute = 'name') | list -%}\n {%- set ns = namespace() -%} {#-- handle for-loop scoping with a namespace --#}\n {%- set ns.column_added = false -%}\n\n {%- set intersection = [] -%}\n {%- for col in query_columns -%}\n {%- if col in existing_cols -%}\n {%- do intersection.append(adapter.quote(col)) -%}\n {%- else -%}\n {% set ns.column_added = true %}\n {%- endif -%}\n {%- endfor -%}\n {{ return((ns.column_added, intersection)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_columns_in_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.588962, "supported_languages": null}, "macro.dbt.snapshot_check_strategy": {"name": "snapshot_check_strategy", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_check_strategy", "macro_sql": "{% macro snapshot_check_strategy(node, snapshotted_rel, current_rel, config, target_exists) %}\n {% set check_cols_config = config['check_cols'] %}\n {% set primary_key = config['unique_key'] %}\n {% set invalidate_hard_deletes = config.get('invalidate_hard_deletes', false) %}\n {% set updated_at = config.get('updated_at', snapshot_get_time()) %}\n\n {% set column_added = false %}\n\n {% set column_added, check_cols = snapshot_check_all_get_existing_columns(node, target_exists, check_cols_config) %}\n\n {%- set row_changed_expr -%}\n (\n {%- if column_added -%}\n {{ get_true_sql() }}\n {%- else -%}\n {%- for col in check_cols -%}\n {{ snapshotted_rel }}.{{ col }} != {{ current_rel }}.{{ col }}\n or\n (\n (({{ snapshotted_rel }}.{{ col }} is null) and not ({{ current_rel }}.{{ col }} is null))\n or\n ((not {{ snapshotted_rel }}.{{ col }} is null) and ({{ current_rel }}.{{ col }} is null))\n )\n {%- if not loop.last %} or {% endif -%}\n {%- endfor -%}\n {%- endif -%}\n )\n {%- endset %}\n\n {% set scd_id_expr = snapshot_hash_arguments([primary_key, updated_at]) %}\n\n {% do return({\n \"unique_key\": primary_key,\n \"updated_at\": updated_at,\n \"row_changed\": row_changed_expr,\n \"scd_id\": scd_id_expr,\n \"invalidate_hard_deletes\": invalidate_hard_deletes\n }) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_get_time", "macro.dbt.snapshot_check_all_get_existing_columns", "macro.dbt.get_true_sql", "macro.dbt.snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.591073, "supported_languages": null}, "macro.dbt.create_columns": {"name": "create_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.create_columns", "macro_sql": "{% macro create_columns(relation, columns) %}\n {{ adapter.dispatch('create_columns', 'dbt')(relation, columns) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5956779, "supported_languages": null}, "macro.dbt.default__create_columns": {"name": "default__create_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__create_columns", "macro_sql": "{% macro default__create_columns(relation, columns) %}\n {% for column in columns %}\n {% call statement() %}\n alter table {{ relation }} add column \"{{ column.name }}\" {{ column.data_type }};\n {% endcall %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.596, "supported_languages": null}, "macro.dbt.post_snapshot": {"name": "post_snapshot", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.post_snapshot", "macro_sql": "{% macro post_snapshot(staging_relation) %}\n {{ adapter.dispatch('post_snapshot', 'dbt')(staging_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__post_snapshot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.59619, "supported_languages": null}, "macro.dbt.default__post_snapshot": {"name": "default__post_snapshot", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__post_snapshot", "macro_sql": "{% macro default__post_snapshot(staging_relation) %}\n {# no-op #}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.596287, "supported_languages": null}, "macro.dbt.get_true_sql": {"name": "get_true_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.get_true_sql", "macro_sql": "{% macro get_true_sql() %}\n {{ adapter.dispatch('get_true_sql', 'dbt')() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_true_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.596446, "supported_languages": null}, "macro.dbt.default__get_true_sql": {"name": "default__get_true_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__get_true_sql", "macro_sql": "{% macro default__get_true_sql() %}\n {{ return('TRUE') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5965729, "supported_languages": null}, "macro.dbt.snapshot_staging_table": {"name": "snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.snapshot_staging_table", "macro_sql": "{% macro snapshot_staging_table(strategy, source_sql, target_relation) -%}\n {{ adapter.dispatch('snapshot_staging_table', 'dbt')(strategy, source_sql, target_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__snapshot_staging_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.596799, "supported_languages": null}, "macro.dbt.default__snapshot_staging_table": {"name": "default__snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__snapshot_staging_table", "macro_sql": "{% macro default__snapshot_staging_table(strategy, source_sql, target_relation) -%}\n\n with snapshot_query as (\n\n {{ source_sql }}\n\n ),\n\n snapshotted_data as (\n\n select *,\n {{ strategy.unique_key }} as dbt_unique_key\n\n from {{ target_relation }}\n where dbt_valid_to is null\n\n ),\n\n insertions_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n nullif({{ strategy.updated_at }}, {{ strategy.updated_at }}) as dbt_valid_to,\n {{ strategy.scd_id }} as dbt_scd_id\n\n from snapshot_query\n ),\n\n updates_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n {{ strategy.updated_at }} as dbt_valid_to\n\n from snapshot_query\n ),\n\n {%- if strategy.invalidate_hard_deletes %}\n\n deletes_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key\n from snapshot_query\n ),\n {% endif %}\n\n insertions as (\n\n select\n 'insert' as dbt_change_type,\n source_data.*\n\n from insertions_source_data as source_data\n left outer join snapshotted_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where snapshotted_data.dbt_unique_key is null\n or (\n snapshotted_data.dbt_unique_key is not null\n and (\n {{ strategy.row_changed }}\n )\n )\n\n ),\n\n updates as (\n\n select\n 'update' as dbt_change_type,\n source_data.*,\n snapshotted_data.dbt_scd_id\n\n from updates_source_data as source_data\n join snapshotted_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where (\n {{ strategy.row_changed }}\n )\n )\n\n {%- if strategy.invalidate_hard_deletes -%}\n ,\n\n deletes as (\n\n select\n 'delete' as dbt_change_type,\n source_data.*,\n {{ snapshot_get_time() }} as dbt_valid_from,\n {{ snapshot_get_time() }} as dbt_updated_at,\n {{ snapshot_get_time() }} as dbt_valid_to,\n snapshotted_data.dbt_scd_id\n\n from snapshotted_data\n left join deletes_source_data as source_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where source_data.dbt_unique_key is null\n )\n {%- endif %}\n\n select * from insertions\n union all\n select * from updates\n {%- if strategy.invalidate_hard_deletes %}\n union all\n select * from deletes\n {%- endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_get_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5977669, "supported_languages": null}, "macro.dbt.build_snapshot_table": {"name": "build_snapshot_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.build_snapshot_table", "macro_sql": "{% macro build_snapshot_table(strategy, sql) -%}\n {{ adapter.dispatch('build_snapshot_table', 'dbt')(strategy, sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__build_snapshot_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.597972, "supported_languages": null}, "macro.dbt.default__build_snapshot_table": {"name": "default__build_snapshot_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__build_snapshot_table", "macro_sql": "{% macro default__build_snapshot_table(strategy, sql) %}\n\n select *,\n {{ strategy.scd_id }} as dbt_scd_id,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n nullif({{ strategy.updated_at }}, {{ strategy.updated_at }}) as dbt_valid_to\n from (\n {{ sql }}\n ) sbq\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.5982442, "supported_languages": null}, "macro.dbt.build_snapshot_staging_table": {"name": "build_snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.build_snapshot_staging_table", "macro_sql": "{% macro build_snapshot_staging_table(strategy, sql, target_relation) %}\n {% set temp_relation = make_temp_relation(target_relation) %}\n\n {% set select = snapshot_staging_table(strategy, sql, target_relation) %}\n\n {% call statement('build_snapshot_staging_relation') %}\n {{ create_table_as(True, temp_relation, select) }}\n {% endcall %}\n\n {% do return(temp_relation) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_temp_relation", "macro.dbt.snapshot_staging_table", "macro.dbt.statement", "macro.dbt.create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.598714, "supported_languages": null}, "macro.dbt.materialization_snapshot_default": {"name": "materialization_snapshot_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot.sql", "original_file_path": "macros/materializations/snapshots/snapshot.sql", "unique_id": "macro.dbt.materialization_snapshot_default", "macro_sql": "{% materialization snapshot, default %}\n {%- set config = model['config'] -%}\n\n {%- set target_table = model.get('alias', model.get('name')) -%}\n\n {%- set strategy_name = config.get('strategy') -%}\n {%- set unique_key = config.get('unique_key') %}\n -- grab current tables grants config for comparision later on\n {%- set grant_config = config.get('grants') -%}\n\n {% set target_relation_exists, target_relation = get_or_create_relation(\n database=model.database,\n schema=model.schema,\n identifier=target_table,\n type='table') -%}\n\n {%- if not target_relation.is_table -%}\n {% do exceptions.relation_wrong_type(target_relation, 'table') %}\n {%- endif -%}\n\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n {% set strategy_macro = strategy_dispatch(strategy_name) %}\n {% set strategy = strategy_macro(model, \"snapshotted_data\", \"source_data\", config, target_relation_exists) %}\n\n {% if not target_relation_exists %}\n\n {% set build_sql = build_snapshot_table(strategy, model['compiled_code']) %}\n {% set final_sql = create_table_as(False, target_relation, build_sql) %}\n\n {% else %}\n\n {{ adapter.valid_snapshot_target(target_relation) }}\n\n {% set staging_table = build_snapshot_staging_table(strategy, sql, target_relation) %}\n\n -- this may no-op if the database does not require column expansion\n {% do adapter.expand_target_column_types(from_relation=staging_table,\n to_relation=target_relation) %}\n\n {% set missing_columns = adapter.get_missing_columns(staging_table, target_relation)\n | rejectattr('name', 'equalto', 'dbt_change_type')\n | rejectattr('name', 'equalto', 'DBT_CHANGE_TYPE')\n | rejectattr('name', 'equalto', 'dbt_unique_key')\n | rejectattr('name', 'equalto', 'DBT_UNIQUE_KEY')\n | list %}\n\n {% do create_columns(target_relation, missing_columns) %}\n\n {% set source_columns = adapter.get_columns_in_relation(staging_table)\n | rejectattr('name', 'equalto', 'dbt_change_type')\n | rejectattr('name', 'equalto', 'DBT_CHANGE_TYPE')\n | rejectattr('name', 'equalto', 'dbt_unique_key')\n | rejectattr('name', 'equalto', 'DBT_UNIQUE_KEY')\n | list %}\n\n {% set quoted_source_columns = [] %}\n {% for column in source_columns %}\n {% do quoted_source_columns.append(adapter.quote(column.name)) %}\n {% endfor %}\n\n {% set final_sql = snapshot_merge_sql(\n target = target_relation,\n source = staging_table,\n insert_cols = quoted_source_columns\n )\n %}\n\n {% endif %}\n\n {% call statement('main') %}\n {{ final_sql }}\n {% endcall %}\n\n {% set should_revoke = should_revoke(target_relation_exists, full_refresh_mode=False) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if not target_relation_exists %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {{ adapter.commit() }}\n\n {% if staging_table is defined %}\n {% do post_snapshot(staging_table) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.get_or_create_relation", "macro.dbt.run_hooks", "macro.dbt.strategy_dispatch", "macro.dbt.build_snapshot_table", "macro.dbt.create_table_as", "macro.dbt.build_snapshot_staging_table", "macro.dbt.create_columns", "macro.dbt.snapshot_merge_sql", "macro.dbt.statement", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes", "macro.dbt.post_snapshot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.605545, "supported_languages": ["sql"]}, "macro.dbt.materialization_test_default": {"name": "materialization_test_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/test.sql", "original_file_path": "macros/materializations/tests/test.sql", "unique_id": "macro.dbt.materialization_test_default", "macro_sql": "{%- materialization test, default -%}\n\n {% set relations = [] %}\n\n {% if should_store_failures() %}\n\n {% set identifier = model['alias'] %}\n {% set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) %}\n {% set target_relation = api.Relation.create(\n identifier=identifier, schema=schema, database=database, type='table') -%} %}\n\n {% if old_relation %}\n {% do adapter.drop_relation(old_relation) %}\n {% endif %}\n\n {% call statement(auto_begin=True) %}\n {{ create_table_as(False, target_relation, sql) }}\n {% endcall %}\n\n {% do relations.append(target_relation) %}\n\n {% set main_sql %}\n select *\n from {{ target_relation }}\n {% endset %}\n\n {{ adapter.commit() }}\n\n {% else %}\n\n {% set main_sql = sql %}\n\n {% endif %}\n\n {% set limit = config.get('limit') %}\n {% set fail_calc = config.get('fail_calc') %}\n {% set warn_if = config.get('warn_if') %}\n {% set error_if = config.get('error_if') %}\n\n {% call statement('main', fetch_result=True) -%}\n\n {{ get_test_sql(main_sql, fail_calc, warn_if, error_if, limit)}}\n\n {%- endcall %}\n\n {{ return({'relations': relations}) }}\n\n{%- endmaterialization -%}", "depends_on": {"macros": ["macro.dbt.should_store_failures", "macro.dbt.statement", "macro.dbt.create_table_as", "macro.dbt.get_test_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.607865, "supported_languages": ["sql"]}, "macro.dbt.get_test_sql": {"name": "get_test_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/helpers.sql", "original_file_path": "macros/materializations/tests/helpers.sql", "unique_id": "macro.dbt.get_test_sql", "macro_sql": "{% macro get_test_sql(main_sql, fail_calc, warn_if, error_if, limit) -%}\n {{ adapter.dispatch('get_test_sql', 'dbt')(main_sql, fail_calc, warn_if, error_if, limit) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_test_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.608385, "supported_languages": null}, "macro.dbt.default__get_test_sql": {"name": "default__get_test_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/helpers.sql", "original_file_path": "macros/materializations/tests/helpers.sql", "unique_id": "macro.dbt.default__get_test_sql", "macro_sql": "{% macro default__get_test_sql(main_sql, fail_calc, warn_if, error_if, limit) -%}\n select\n {{ fail_calc }} as failures,\n {{ fail_calc }} {{ warn_if }} as should_warn,\n {{ fail_calc }} {{ error_if }} as should_error\n from (\n {{ main_sql }}\n {{ \"limit \" ~ limit if limit != none }}\n ) dbt_internal_test\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.608732, "supported_languages": null}, "macro.dbt.get_where_subquery": {"name": "get_where_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/where_subquery.sql", "original_file_path": "macros/materializations/tests/where_subquery.sql", "unique_id": "macro.dbt.get_where_subquery", "macro_sql": "{% macro get_where_subquery(relation) -%}\n {% do return(adapter.dispatch('get_where_subquery', 'dbt')(relation)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_where_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.609181, "supported_languages": null}, "macro.dbt.default__get_where_subquery": {"name": "default__get_where_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/where_subquery.sql", "original_file_path": "macros/materializations/tests/where_subquery.sql", "unique_id": "macro.dbt.default__get_where_subquery", "macro_sql": "{% macro default__get_where_subquery(relation) -%}\n {% set where = config.get('where', '') %}\n {% if where %}\n {%- set filtered -%}\n (select * from {{ relation }} where {{ where }}) dbt_subquery\n {%- endset -%}\n {% do return(filtered) %}\n {%- else -%}\n {% do return(relation) %}\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6096032, "supported_languages": null}, "macro.dbt.get_quoted_csv": {"name": "get_quoted_csv", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.get_quoted_csv", "macro_sql": "{% macro get_quoted_csv(column_names) %}\n\n {% set quoted = [] %}\n {% for col in column_names -%}\n {%- do quoted.append(adapter.quote(col)) -%}\n {%- endfor %}\n\n {%- set dest_cols_csv = quoted | join(', ') -%}\n {{ return(dest_cols_csv) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.611388, "supported_languages": null}, "macro.dbt.diff_columns": {"name": "diff_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.diff_columns", "macro_sql": "{% macro diff_columns(source_columns, target_columns) %}\n\n {% set result = [] %}\n {% set source_names = source_columns | map(attribute = 'column') | list %}\n {% set target_names = target_columns | map(attribute = 'column') | list %}\n\n {# --check whether the name attribute exists in the target - this does not perform a data type check #}\n {% for sc in source_columns %}\n {% if sc.name not in target_names %}\n {{ result.append(sc) }}\n {% endif %}\n {% endfor %}\n\n {{ return(result) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.611966, "supported_languages": null}, "macro.dbt.diff_column_data_types": {"name": "diff_column_data_types", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.diff_column_data_types", "macro_sql": "{% macro diff_column_data_types(source_columns, target_columns) %}\n\n {% set result = [] %}\n {% for sc in source_columns %}\n {% set tc = target_columns | selectattr(\"name\", \"equalto\", sc.name) | list | first %}\n {% if tc %}\n {% if sc.data_type != tc.data_type and not sc.can_expand_to(other_column=tc) %}\n {{ result.append( { 'column_name': tc.name, 'new_type': sc.data_type } ) }}\n {% endif %}\n {% endif %}\n {% endfor %}\n\n {{ return(result) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6126668, "supported_languages": null}, "macro.dbt.get_merge_update_columns": {"name": "get_merge_update_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.get_merge_update_columns", "macro_sql": "{% macro get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) %}\n {{ return(adapter.dispatch('get_merge_update_columns', 'dbt')(merge_update_columns, merge_exclude_columns, dest_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_merge_update_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.612916, "supported_languages": null}, "macro.dbt.default__get_merge_update_columns": {"name": "default__get_merge_update_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.default__get_merge_update_columns", "macro_sql": "{% macro default__get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) %}\n {%- set default_cols = dest_columns | map(attribute=\"quoted\") | list -%}\n\n {%- if merge_update_columns and merge_exclude_columns -%}\n {{ exceptions.raise_compiler_error(\n 'Model cannot specify merge_update_columns and merge_exclude_columns. Please update model to use only one config'\n )}}\n {%- elif merge_update_columns -%}\n {%- set update_columns = merge_update_columns -%}\n {%- elif merge_exclude_columns -%}\n {%- set update_columns = [] -%}\n {%- for column in dest_columns -%}\n {% if column.column | lower not in merge_exclude_columns | map(\"lower\") | list %}\n {%- do update_columns.append(column.quoted) -%}\n {% endif %}\n {%- endfor -%}\n {%- else -%}\n {%- set update_columns = default_cols -%}\n {%- endif -%}\n\n {{ return(update_columns) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6136792, "supported_languages": null}, "macro.dbt.get_merge_sql": {"name": "get_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_merge_sql", "macro_sql": "{% macro get_merge_sql(target, source, unique_key, dest_columns, incremental_predicates=none) -%}\n -- back compat for old kwarg name\n {% set incremental_predicates = kwargs.get('predicates', incremental_predicates) %}\n {{ adapter.dispatch('get_merge_sql', 'dbt')(target, source, unique_key, dest_columns, incremental_predicates) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.620842, "supported_languages": null}, "macro.dbt.default__get_merge_sql": {"name": "default__get_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_merge_sql", "macro_sql": "{% macro default__get_merge_sql(target, source, unique_key, dest_columns, incremental_predicates=none) -%}\n {%- set predicates = [] if incremental_predicates is none else [] + incremental_predicates -%}\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n {%- set merge_update_columns = config.get('merge_update_columns') -%}\n {%- set merge_exclude_columns = config.get('merge_exclude_columns') -%}\n {%- set update_columns = get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {% if unique_key %}\n {% if unique_key is sequence and unique_key is not mapping and unique_key is not string %}\n {% for key in unique_key %}\n {% set this_key_match %}\n DBT_INTERNAL_SOURCE.{{ key }} = DBT_INTERNAL_DEST.{{ key }}\n {% endset %}\n {% do predicates.append(this_key_match) %}\n {% endfor %}\n {% else %}\n {% set unique_key_match %}\n DBT_INTERNAL_SOURCE.{{ unique_key }} = DBT_INTERNAL_DEST.{{ unique_key }}\n {% endset %}\n {% do predicates.append(unique_key_match) %}\n {% endif %}\n {% else %}\n {% do predicates.append('FALSE') %}\n {% endif %}\n\n {{ sql_header if sql_header is not none }}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on {{\"(\" ~ predicates | join(\") and (\") ~ \")\"}}\n\n {% if unique_key %}\n when matched then update set\n {% for column_name in update_columns -%}\n {{ column_name }} = DBT_INTERNAL_SOURCE.{{ column_name }}\n {%- if not loop.last %}, {%- endif %}\n {%- endfor %}\n {% endif %}\n\n when not matched then insert\n ({{ dest_cols_csv }})\n values\n ({{ dest_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv", "macro.dbt.get_merge_update_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.622786, "supported_languages": null}, "macro.dbt.get_delete_insert_merge_sql": {"name": "get_delete_insert_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_delete_insert_merge_sql", "macro_sql": "{% macro get_delete_insert_merge_sql(target, source, unique_key, dest_columns, incremental_predicates) -%}\n {{ adapter.dispatch('get_delete_insert_merge_sql', 'dbt')(target, source, unique_key, dest_columns, incremental_predicates) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_delete_insert_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.623289, "supported_languages": null}, "macro.dbt.default__get_delete_insert_merge_sql": {"name": "default__get_delete_insert_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_delete_insert_merge_sql", "macro_sql": "{% macro default__get_delete_insert_merge_sql(target, source, unique_key, dest_columns, incremental_predicates) -%}\n\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n\n {% if unique_key %}\n {% if unique_key is sequence and unique_key is not string %}\n delete from {{target }}\n using {{ source }}\n where (\n {% for key in unique_key %}\n {{ source }}.{{ key }} = {{ target }}.{{ key }}\n {{ \"and \" if not loop.last}}\n {% endfor %}\n {% if incremental_predicates %}\n {% for predicate in incremental_predicates %}\n and {{ predicate }}\n {% endfor %}\n {% endif %}\n );\n {% else %}\n delete from {{ target }}\n where (\n {{ unique_key }}) in (\n select ({{ unique_key }})\n from {{ source }}\n )\n {%- if incremental_predicates %}\n {% for predicate in incremental_predicates %}\n and {{ predicate }}\n {% endfor %}\n {%- endif -%};\n\n {% endif %}\n {% endif %}\n\n insert into {{ target }} ({{ dest_cols_csv }})\n (\n select {{ dest_cols_csv }}\n from {{ source }}\n )\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.624502, "supported_languages": null}, "macro.dbt.get_insert_overwrite_merge_sql": {"name": "get_insert_overwrite_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_insert_overwrite_merge_sql", "macro_sql": "{% macro get_insert_overwrite_merge_sql(target, source, dest_columns, predicates, include_sql_header=false) -%}\n {{ adapter.dispatch('get_insert_overwrite_merge_sql', 'dbt')(target, source, dest_columns, predicates, include_sql_header) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.624814, "supported_languages": null}, "macro.dbt.default__get_insert_overwrite_merge_sql": {"name": "default__get_insert_overwrite_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_insert_overwrite_merge_sql", "macro_sql": "{% macro default__get_insert_overwrite_merge_sql(target, source, dest_columns, predicates, include_sql_header) -%}\n {#-- The only time include_sql_header is True: --#}\n {#-- BigQuery + insert_overwrite strategy + \"static\" partitions config --#}\n {#-- We should consider including the sql header at the materialization level instead --#}\n\n {%- set predicates = [] if predicates is none else [] + predicates -%}\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none and include_sql_header }}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on FALSE\n\n when not matched by source\n {% if predicates %} and {{ predicates | join(' and ') }} {% endif %}\n then delete\n\n when not matched then insert\n ({{ dest_cols_csv }})\n values\n ({{ dest_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.62554, "supported_languages": null}, "macro.dbt.is_incremental": {"name": "is_incremental", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/is_incremental.sql", "original_file_path": "macros/materializations/models/incremental/is_incremental.sql", "unique_id": "macro.dbt.is_incremental", "macro_sql": "{% macro is_incremental() %}\n {#-- do not run introspective queries in parsing #}\n {% if not execute %}\n {{ return(False) }}\n {% else %}\n {% set relation = adapter.get_relation(this.database, this.schema, this.table) %}\n {{ return(relation is not none\n and relation.type == 'table'\n and model.config.materialized == 'incremental'\n and not should_full_refresh()) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6262589, "supported_languages": null}, "macro.dbt.get_incremental_append_sql": {"name": "get_incremental_append_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_append_sql", "macro_sql": "{% macro get_incremental_append_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_append_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_append_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6272378, "supported_languages": null}, "macro.dbt.default__get_incremental_append_sql": {"name": "default__get_incremental_append_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_append_sql", "macro_sql": "{% macro default__get_incremental_append_sql(arg_dict) %}\n\n {% do return(get_insert_into_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"dest_columns\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_insert_into_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6275, "supported_languages": null}, "macro.dbt.get_incremental_delete_insert_sql": {"name": "get_incremental_delete_insert_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_delete_insert_sql", "macro_sql": "{% macro get_incremental_delete_insert_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_delete_insert_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_delete_insert_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.627706, "supported_languages": null}, "macro.dbt.default__get_incremental_delete_insert_sql": {"name": "default__get_incremental_delete_insert_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_delete_insert_sql", "macro_sql": "{% macro default__get_incremental_delete_insert_sql(arg_dict) %}\n\n {% do return(get_delete_insert_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"unique_key\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_delete_insert_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6280372, "supported_languages": null}, "macro.dbt.get_incremental_merge_sql": {"name": "get_incremental_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_merge_sql", "macro_sql": "{% macro get_incremental_merge_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_merge_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.628242, "supported_languages": null}, "macro.dbt.default__get_incremental_merge_sql": {"name": "default__get_incremental_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_merge_sql", "macro_sql": "{% macro default__get_incremental_merge_sql(arg_dict) %}\n\n {% do return(get_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"unique_key\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.628564, "supported_languages": null}, "macro.dbt.get_incremental_insert_overwrite_sql": {"name": "get_incremental_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_insert_overwrite_sql", "macro_sql": "{% macro get_incremental_insert_overwrite_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_insert_overwrite_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_insert_overwrite_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.62877, "supported_languages": null}, "macro.dbt.default__get_incremental_insert_overwrite_sql": {"name": "default__get_incremental_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_insert_overwrite_sql", "macro_sql": "{% macro default__get_incremental_insert_overwrite_sql(arg_dict) %}\n\n {% do return(get_insert_overwrite_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6290581, "supported_languages": null}, "macro.dbt.get_incremental_default_sql": {"name": "get_incremental_default_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_default_sql", "macro_sql": "{% macro get_incremental_default_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_default_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__get_incremental_default_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.629262, "supported_languages": null}, "macro.dbt.default__get_incremental_default_sql": {"name": "default__get_incremental_default_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_default_sql", "macro_sql": "{% macro default__get_incremental_default_sql(arg_dict) %}\n\n {% do return(get_incremental_append_sql(arg_dict)) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_incremental_append_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6294231, "supported_languages": null}, "macro.dbt.get_insert_into_sql": {"name": "get_insert_into_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_insert_into_sql", "macro_sql": "{% macro get_insert_into_sql(target_relation, temp_relation, dest_columns) %}\n\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n\n insert into {{ target_relation }} ({{ dest_cols_csv }})\n (\n select {{ dest_cols_csv }}\n from {{ temp_relation }}\n )\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.62973, "supported_languages": null}, "macro.dbt.materialization_incremental_default": {"name": "materialization_incremental_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/incremental.sql", "original_file_path": "macros/materializations/models/incremental/incremental.sql", "unique_id": "macro.dbt.materialization_incremental_default", "macro_sql": "{% materialization incremental, default -%}\n\n -- relations\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='table') -%}\n {%- set temp_relation = make_temp_relation(target_relation)-%}\n {%- set intermediate_relation = make_intermediate_relation(target_relation)-%}\n {%- set backup_relation_type = 'table' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n\n -- configs\n {%- set unique_key = config.get('unique_key') -%}\n {%- set full_refresh_mode = (should_full_refresh() or existing_relation.is_view) -%}\n {%- set on_schema_change = incremental_validate_on_schema_change(config.get('on_schema_change'), default='ignore') -%}\n\n -- the temp_ and backup_ relations should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation. This has to happen before\n -- BEGIN, in a separate transaction\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation)-%}\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n {% set to_drop = [] %}\n\n {% if existing_relation is none %}\n {% set build_sql = get_create_table_as_sql(False, target_relation, sql) %}\n {% elif full_refresh_mode %}\n {% set build_sql = get_create_table_as_sql(False, intermediate_relation, sql) %}\n {% set need_swap = true %}\n {% else %}\n {% do run_query(get_create_table_as_sql(True, temp_relation, sql)) %}\n {% do adapter.expand_target_column_types(\n from_relation=temp_relation,\n to_relation=target_relation) %}\n {#-- Process schema changes. Returns dict of changes if successful. Use source columns for upserting/merging --#}\n {% set dest_columns = process_schema_changes(on_schema_change, temp_relation, existing_relation) %}\n {% if not dest_columns %}\n {% set dest_columns = adapter.get_columns_in_relation(existing_relation) %}\n {% endif %}\n\n {#-- Get the incremental_strategy, the macro to use for the strategy, and build the sql --#}\n {% set incremental_strategy = config.get('incremental_strategy') or 'default' %}\n {% set incremental_predicates = config.get('predicates', none) or config.get('incremental_predicates', none) %}\n {% set strategy_sql_macro_func = adapter.get_incremental_strategy_macro(context, incremental_strategy) %}\n {% set strategy_arg_dict = ({'target_relation': target_relation, 'temp_relation': temp_relation, 'unique_key': unique_key, 'dest_columns': dest_columns, 'incremental_predicates': incremental_predicates }) %}\n {% set build_sql = strategy_sql_macro_func(strategy_arg_dict) %}\n\n {% endif %}\n\n {% call statement(\"main\") %}\n {{ build_sql }}\n {% endcall %}\n\n {% if need_swap %}\n {% do adapter.rename_relation(target_relation, backup_relation) %}\n {% do adapter.rename_relation(intermediate_relation, target_relation) %}\n {% do to_drop.append(backup_relation) %}\n {% endif %}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if existing_relation is none or existing_relation.is_view or should_full_refresh() %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n -- `COMMIT` happens here\n {% do adapter.commit() %}\n\n {% for rel in to_drop %}\n {% do adapter.drop_relation(rel) %}\n {% endfor %}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{%- endmaterialization %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_temp_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.should_full_refresh", "macro.dbt.incremental_validate_on_schema_change", "macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks", "macro.dbt.get_create_table_as_sql", "macro.dbt.run_query", "macro.dbt.process_schema_changes", "macro.dbt.statement", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.635316, "supported_languages": ["sql"]}, "macro.dbt.incremental_validate_on_schema_change": {"name": "incremental_validate_on_schema_change", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.incremental_validate_on_schema_change", "macro_sql": "{% macro incremental_validate_on_schema_change(on_schema_change, default='ignore') %}\n\n {% if on_schema_change not in ['sync_all_columns', 'append_new_columns', 'fail', 'ignore'] %}\n\n {% set log_message = 'Invalid value for on_schema_change (%s) specified. Setting default value of %s.' % (on_schema_change, default) %}\n {% do log(log_message) %}\n\n {{ return(default) }}\n\n {% else %}\n\n {{ return(on_schema_change) }}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.641671, "supported_languages": null}, "macro.dbt.check_for_schema_changes": {"name": "check_for_schema_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.check_for_schema_changes", "macro_sql": "{% macro check_for_schema_changes(source_relation, target_relation) %}\n\n {% set schema_changed = False %}\n\n {%- set source_columns = adapter.get_columns_in_relation(source_relation) -%}\n {%- set target_columns = adapter.get_columns_in_relation(target_relation) -%}\n {%- set source_not_in_target = diff_columns(source_columns, target_columns) -%}\n {%- set target_not_in_source = diff_columns(target_columns, source_columns) -%}\n\n {% set new_target_types = diff_column_data_types(source_columns, target_columns) %}\n\n {% if source_not_in_target != [] %}\n {% set schema_changed = True %}\n {% elif target_not_in_source != [] or new_target_types != [] %}\n {% set schema_changed = True %}\n {% elif new_target_types != [] %}\n {% set schema_changed = True %}\n {% endif %}\n\n {% set changes_dict = {\n 'schema_changed': schema_changed,\n 'source_not_in_target': source_not_in_target,\n 'target_not_in_source': target_not_in_source,\n 'source_columns': source_columns,\n 'target_columns': target_columns,\n 'new_target_types': new_target_types\n } %}\n\n {% set msg %}\n In {{ target_relation }}:\n Schema changed: {{ schema_changed }}\n Source columns not in target: {{ source_not_in_target }}\n Target columns not in source: {{ target_not_in_source }}\n New column types: {{ new_target_types }}\n {% endset %}\n\n {% do log(msg) %}\n\n {{ return(changes_dict) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.diff_columns", "macro.dbt.diff_column_data_types"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.643061, "supported_languages": null}, "macro.dbt.sync_column_schemas": {"name": "sync_column_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.sync_column_schemas", "macro_sql": "{% macro sync_column_schemas(on_schema_change, target_relation, schema_changes_dict) %}\n\n {%- set add_to_target_arr = schema_changes_dict['source_not_in_target'] -%}\n\n {%- if on_schema_change == 'append_new_columns'-%}\n {%- if add_to_target_arr | length > 0 -%}\n {%- do alter_relation_add_remove_columns(target_relation, add_to_target_arr, none) -%}\n {%- endif -%}\n\n {% elif on_schema_change == 'sync_all_columns' %}\n {%- set remove_from_target_arr = schema_changes_dict['target_not_in_source'] -%}\n {%- set new_target_types = schema_changes_dict['new_target_types'] -%}\n\n {% if add_to_target_arr | length > 0 or remove_from_target_arr | length > 0 %}\n {%- do alter_relation_add_remove_columns(target_relation, add_to_target_arr, remove_from_target_arr) -%}\n {% endif %}\n\n {% if new_target_types != [] %}\n {% for ntt in new_target_types %}\n {% set column_name = ntt['column_name'] %}\n {% set new_type = ntt['new_type'] %}\n {% do alter_column_type(target_relation, column_name, new_type) %}\n {% endfor %}\n {% endif %}\n\n {% endif %}\n\n {% set schema_change_message %}\n In {{ target_relation }}:\n Schema change approach: {{ on_schema_change }}\n Columns added: {{ add_to_target_arr }}\n Columns removed: {{ remove_from_target_arr }}\n Data types changed: {{ new_target_types }}\n {% endset %}\n\n {% do log(schema_change_message) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.alter_relation_add_remove_columns", "macro.dbt.alter_column_type"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.644397, "supported_languages": null}, "macro.dbt.process_schema_changes": {"name": "process_schema_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.process_schema_changes", "macro_sql": "{% macro process_schema_changes(on_schema_change, source_relation, target_relation) %}\n\n {% if on_schema_change == 'ignore' %}\n\n {{ return({}) }}\n\n {% else %}\n\n {% set schema_changes_dict = check_for_schema_changes(source_relation, target_relation) %}\n\n {% if schema_changes_dict['schema_changed'] %}\n\n {% if on_schema_change == 'fail' %}\n\n {% set fail_msg %}\n The source and target schemas on this incremental model are out of sync!\n They can be reconciled in several ways:\n - set the `on_schema_change` config to either append_new_columns or sync_all_columns, depending on your situation.\n - Re-run the incremental model with `full_refresh: True` to update the target schema.\n - update the schema manually and re-run the process.\n\n Additional troubleshooting context:\n Source columns not in target: {{ schema_changes_dict['source_not_in_target'] }}\n Target columns not in source: {{ schema_changes_dict['target_not_in_source'] }}\n New column types: {{ schema_changes_dict['new_target_types'] }}\n {% endset %}\n\n {% do exceptions.raise_compiler_error(fail_msg) %}\n\n {# -- unless we ignore, run the sync operation per the config #}\n {% else %}\n\n {% do sync_column_schemas(on_schema_change, target_relation, schema_changes_dict) %}\n\n {% endif %}\n\n {% endif %}\n\n {{ return(schema_changes_dict['source_columns']) }}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.check_for_schema_changes", "macro.dbt.sync_column_schemas"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.645349, "supported_languages": null}, "macro.dbt.get_table_columns_and_constraints": {"name": "get_table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.get_table_columns_and_constraints", "macro_sql": "{%- macro get_table_columns_and_constraints() -%}\n {{ adapter.dispatch('get_table_columns_and_constraints', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__get_table_columns_and_constraints"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.646438, "supported_languages": null}, "macro.dbt.default__get_table_columns_and_constraints": {"name": "default__get_table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__get_table_columns_and_constraints", "macro_sql": "{% macro default__get_table_columns_and_constraints() -%}\n {{ return(table_columns_and_constraints()) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.table_columns_and_constraints"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6465678, "supported_languages": null}, "macro.dbt.table_columns_and_constraints": {"name": "table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.table_columns_and_constraints", "macro_sql": "{% macro table_columns_and_constraints() %}\n {# loop through user_provided_columns to create DDL with data types and constraints #}\n {%- set raw_column_constraints = adapter.render_raw_columns_constraints(raw_columns=model['columns']) -%}\n {%- set raw_model_constraints = adapter.render_raw_model_constraints(raw_constraints=model['constraints']) -%}\n (\n {% for c in raw_column_constraints -%}\n {{ c }}{{ \",\" if not loop.last or raw_model_constraints }}\n {% endfor %}\n {% for c in raw_model_constraints -%}\n {{ c }}{{ \",\" if not loop.last }}\n {% endfor -%}\n )\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6471329, "supported_languages": null}, "macro.dbt.get_assert_columns_equivalent": {"name": "get_assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.get_assert_columns_equivalent", "macro_sql": "\n\n{%- macro get_assert_columns_equivalent(sql) -%}\n {{ adapter.dispatch('get_assert_columns_equivalent', 'dbt')(sql) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__get_assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6473138, "supported_languages": null}, "macro.dbt.default__get_assert_columns_equivalent": {"name": "default__get_assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__get_assert_columns_equivalent", "macro_sql": "{% macro default__get_assert_columns_equivalent(sql) -%}\n {{ return(assert_columns_equivalent(sql)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6474571, "supported_languages": null}, "macro.dbt.assert_columns_equivalent": {"name": "assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.assert_columns_equivalent", "macro_sql": "{% macro assert_columns_equivalent(sql) %}\n {#-- Obtain the column schema provided by sql file. #}\n {%- set sql_file_provided_columns = get_column_schema_from_query(sql, config.get('sql_header', none)) -%}\n {#--Obtain the column schema provided by the schema file by generating an 'empty schema' query from the model's columns. #}\n {%- set schema_file_provided_columns = get_column_schema_from_query(get_empty_schema_sql(model['columns'])) -%}\n\n {#-- create dictionaries with name and formatted data type and strings for exception #}\n {%- set sql_columns = format_columns(sql_file_provided_columns) -%}\n {%- set yaml_columns = format_columns(schema_file_provided_columns) -%}\n\n {%- if sql_columns|length != yaml_columns|length -%}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n\n {%- for sql_col in sql_columns -%}\n {%- set yaml_col = [] -%}\n {%- for this_col in yaml_columns -%}\n {%- if this_col['name'] == sql_col['name'] -%}\n {%- do yaml_col.append(this_col) -%}\n {%- break -%}\n {%- endif -%}\n {%- endfor -%}\n {%- if not yaml_col -%}\n {#-- Column with name not found in yaml #}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n {%- if sql_col['formatted'] != yaml_col[0]['formatted'] -%}\n {#-- Column data types don't match #}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n {%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_column_schema_from_query", "macro.dbt.get_empty_schema_sql", "macro.dbt.format_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6486552, "supported_languages": null}, "macro.dbt.format_columns": {"name": "format_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.format_columns", "macro_sql": "{% macro format_columns(columns) %}\n {% set formatted_columns = [] %}\n {% for column in columns %}\n {%- set formatted_column = adapter.dispatch('format_column', 'dbt')(column) -%}\n {%- do formatted_columns.append(formatted_column) -%}\n {% endfor %}\n {{ return(formatted_columns) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__format_column"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.649081, "supported_languages": null}, "macro.dbt.default__format_column": {"name": "default__format_column", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/columns_spec_ddl.sql", "original_file_path": "macros/materializations/models/table/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__format_column", "macro_sql": "{% macro default__format_column(column) -%}\n {% set data_type = column.dtype %}\n {% set formatted = column.column.lower() ~ \" \" ~ data_type %}\n {{ return({'name': column.name, 'data_type': data_type, 'formatted': formatted}) }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.64945, "supported_languages": null}, "macro.dbt.materialization_table_default": {"name": "materialization_table_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/table.sql", "original_file_path": "macros/materializations/models/table/table.sql", "unique_id": "macro.dbt.materialization_table_default", "macro_sql": "{% materialization table, default %}\n\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='table') %}\n {%- set intermediate_relation = make_intermediate_relation(target_relation) -%}\n -- the intermediate_relation should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation) -%}\n /*\n See ../view/view.sql for more information about this relation.\n */\n {%- set backup_relation_type = 'table' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n -- as above, the backup_relation should not already exist\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n\n -- drop the temp relations if they exist already in the database\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_table_as_sql(False, intermediate_relation, sql) }}\n {%- endcall %}\n\n -- cleanup\n {% if existing_relation is not none %}\n {{ adapter.rename_relation(existing_relation, backup_relation) }}\n {% endif %}\n\n {{ adapter.rename_relation(intermediate_relation, target_relation) }}\n\n {% do create_indexes(target_relation) %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n -- `COMMIT` happens here\n {{ adapter.commit() }}\n\n -- finally, drop the existing/backup relation after the commit\n {{ drop_relation_if_exists(backup_relation) }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks", "macro.dbt.statement", "macro.dbt.get_create_table_as_sql", "macro.dbt.create_indexes", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.65244, "supported_languages": ["sql"]}, "macro.dbt.get_create_table_as_sql": {"name": "get_create_table_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.get_create_table_as_sql", "macro_sql": "{% macro get_create_table_as_sql(temporary, relation, sql) -%}\n {{ adapter.dispatch('get_create_table_as_sql', 'dbt')(temporary, relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_create_table_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.653415, "supported_languages": null}, "macro.dbt.default__get_create_table_as_sql": {"name": "default__get_create_table_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.default__get_create_table_as_sql", "macro_sql": "{% macro default__get_create_table_as_sql(temporary, relation, sql) -%}\n {{ return(create_table_as(temporary, relation, sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.653674, "supported_languages": null}, "macro.dbt.create_table_as": {"name": "create_table_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.create_table_as", "macro_sql": "{% macro create_table_as(temporary, relation, compiled_code, language='sql') -%}\n {# backward compatibility for create_table_as that does not support language #}\n {% if language == \"sql\" %}\n {{ adapter.dispatch('create_table_as', 'dbt')(temporary, relation, compiled_code)}}\n {% else %}\n {{ adapter.dispatch('create_table_as', 'dbt')(temporary, relation, compiled_code, language) }}\n {% endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.65417, "supported_languages": null}, "macro.dbt.default__create_table_as": {"name": "default__create_table_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.default__create_table_as", "macro_sql": "{% macro default__create_table_as(temporary, relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n\n create {% if temporary: -%}temporary{%- endif %} table\n {{ relation.include(database=(not temporary), schema=(not temporary)) }}\n {% set contract_config = config.get('contract') %}\n {% if contract_config.enforced %}\n {{ get_assert_columns_equivalent(sql) }}\n {{ get_table_columns_and_constraints() }}\n {%- set sql = get_select_subquery(sql) %}\n {% endif %}\n as (\n {{ sql }}\n );\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_assert_columns_equivalent", "macro.dbt.get_table_columns_and_constraints", "macro.dbt.get_select_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.654933, "supported_languages": null}, "macro.dbt.default__get_column_names": {"name": "default__get_column_names", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.default__get_column_names", "macro_sql": "{% macro default__get_column_names() %}\n {#- loop through user_provided_columns to get column names -#}\n {%- set user_provided_columns = model['columns'] -%}\n {%- for i in user_provided_columns %}\n {%- set col = user_provided_columns[i] -%}\n {%- set col_name = adapter.quote(col['name']) if col.get('quote') else col['name'] -%}\n {{ col_name }}{{ \", \" if not loop.last }}\n {%- endfor -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.655465, "supported_languages": null}, "macro.dbt.get_select_subquery": {"name": "get_select_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.get_select_subquery", "macro_sql": "{% macro get_select_subquery(sql) %}\n {{ return(adapter.dispatch('get_select_subquery', 'dbt')(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_select_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.655676, "supported_languages": null}, "macro.dbt.default__get_select_subquery": {"name": "default__get_select_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table/create_table_as.sql", "original_file_path": "macros/materializations/models/table/create_table_as.sql", "unique_id": "macro.dbt.default__get_select_subquery", "macro_sql": "{% macro default__get_select_subquery(sql) %}\n select {{ adapter.dispatch('get_column_names', 'dbt')() }}\n from (\n {{ sql }}\n ) as model_subq\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_column_names"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.655874, "supported_languages": null}, "macro.dbt.materialization_view_default": {"name": "materialization_view_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/view.sql", "original_file_path": "macros/materializations/models/view/view.sql", "unique_id": "macro.dbt.materialization_view_default", "macro_sql": "{%- materialization view, default -%}\n\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='view') -%}\n {%- set intermediate_relation = make_intermediate_relation(target_relation) -%}\n\n -- the intermediate_relation should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation) -%}\n /*\n This relation (probably) doesn't exist yet. If it does exist, it's a leftover from\n a previous run, and we're going to try to drop it immediately. At the end of this\n materialization, we're going to rename the \"existing_relation\" to this identifier,\n and then we're going to drop it. In order to make sure we run the correct one of:\n - drop view ...\n - drop table ...\n\n We need to set the type of this relation to be the type of the existing_relation, if it exists,\n or else \"view\" as a sane default if it does not. Note that if the existing_relation does not\n exist, then there is nothing to move out of the way and subsequentally drop. In that case,\n this relation will be effectively unused.\n */\n {%- set backup_relation_type = 'view' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n -- as above, the backup_relation should not already exist\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- drop the temp relations if they exist already in the database\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_view_as_sql(intermediate_relation, sql) }}\n {%- endcall %}\n\n -- cleanup\n -- move the existing view out of the way\n {% if existing_relation is not none %}\n {{ adapter.rename_relation(existing_relation, backup_relation) }}\n {% endif %}\n {{ adapter.rename_relation(intermediate_relation, target_relation) }}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {{ adapter.commit() }}\n\n {{ drop_relation_if_exists(backup_relation) }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{%- endmaterialization -%}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.run_hooks", "macro.dbt.drop_relation_if_exists", "macro.dbt.statement", "macro.dbt.get_create_view_as_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.65914, "supported_languages": ["sql"]}, "macro.dbt.handle_existing_table": {"name": "handle_existing_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/helpers.sql", "original_file_path": "macros/materializations/models/view/helpers.sql", "unique_id": "macro.dbt.handle_existing_table", "macro_sql": "{% macro handle_existing_table(full_refresh, old_relation) %}\n {{ adapter.dispatch('handle_existing_table', 'dbt')(full_refresh, old_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__handle_existing_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6595268, "supported_languages": null}, "macro.dbt.default__handle_existing_table": {"name": "default__handle_existing_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/helpers.sql", "original_file_path": "macros/materializations/models/view/helpers.sql", "unique_id": "macro.dbt.default__handle_existing_table", "macro_sql": "{% macro default__handle_existing_table(full_refresh, old_relation) %}\n {{ log(\"Dropping relation \" ~ old_relation ~ \" because it is of type \" ~ old_relation.type) }}\n {{ adapter.drop_relation(old_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.65978, "supported_languages": null}, "macro.dbt.create_or_replace_view": {"name": "create_or_replace_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/create_or_replace_view.sql", "original_file_path": "macros/materializations/models/view/create_or_replace_view.sql", "unique_id": "macro.dbt.create_or_replace_view", "macro_sql": "{% macro create_or_replace_view() %}\n {%- set identifier = model['alias'] -%}\n\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n {%- set exists_as_view = (old_relation is not none and old_relation.is_view) -%}\n\n {%- set target_relation = api.Relation.create(\n identifier=identifier, schema=schema, database=database,\n type='view') -%}\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks) }}\n\n -- If there's a table with the same name and we weren't told to full refresh,\n -- that's an error. If we were told to full refresh, drop it. This behavior differs\n -- for Snowflake and BigQuery, so multiple dispatch is used.\n {%- if old_relation is not none and old_relation.is_table -%}\n {{ handle_existing_table(should_full_refresh(), old_relation) }}\n {%- endif -%}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_view_as_sql(target_relation, sql) }}\n {%- endcall %}\n\n {% set should_revoke = should_revoke(exists_as_view, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {{ run_hooks(post_hooks) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt.handle_existing_table", "macro.dbt.should_full_refresh", "macro.dbt.statement", "macro.dbt.get_create_view_as_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6615272, "supported_languages": null}, "macro.dbt.get_create_view_as_sql": {"name": "get_create_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/create_view_as.sql", "original_file_path": "macros/materializations/models/view/create_view_as.sql", "unique_id": "macro.dbt.get_create_view_as_sql", "macro_sql": "{% macro get_create_view_as_sql(relation, sql) -%}\n {{ adapter.dispatch('get_create_view_as_sql', 'dbt')(relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_create_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6620102, "supported_languages": null}, "macro.dbt.default__get_create_view_as_sql": {"name": "default__get_create_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/create_view_as.sql", "original_file_path": "macros/materializations/models/view/create_view_as.sql", "unique_id": "macro.dbt.default__get_create_view_as_sql", "macro_sql": "{% macro default__get_create_view_as_sql(relation, sql) -%}\n {{ return(create_view_as(relation, sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_view_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.662192, "supported_languages": null}, "macro.dbt.create_view_as": {"name": "create_view_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/create_view_as.sql", "original_file_path": "macros/materializations/models/view/create_view_as.sql", "unique_id": "macro.dbt.create_view_as", "macro_sql": "{% macro create_view_as(relation, sql) -%}\n {{ adapter.dispatch('create_view_as', 'dbt')(relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_view_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.662389, "supported_languages": null}, "macro.dbt.default__create_view_as": {"name": "default__create_view_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view/create_view_as.sql", "original_file_path": "macros/materializations/models/view/create_view_as.sql", "unique_id": "macro.dbt.default__create_view_as", "macro_sql": "{% macro default__create_view_as(relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n create view {{ relation }}\n {% set contract_config = config.get('contract') %}\n {% if contract_config.enforced %}\n {{ get_assert_columns_equivalent(sql) }}\n {%- endif %}\n as (\n {{ sql }}\n );\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.662879, "supported_languages": null}, "macro.dbt.materialization_seed_default": {"name": "materialization_seed_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/seed.sql", "original_file_path": "macros/materializations/seeds/seed.sql", "unique_id": "macro.dbt.materialization_seed_default", "macro_sql": "{% materialization seed, default %}\n\n {%- set identifier = model['alias'] -%}\n {%- set full_refresh_mode = (should_full_refresh()) -%}\n\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n\n {%- set exists_as_table = (old_relation is not none and old_relation.is_table) -%}\n {%- set exists_as_view = (old_relation is not none and old_relation.is_view) -%}\n\n {%- set grant_config = config.get('grants') -%}\n {%- set agate_table = load_agate_table() -%}\n -- grab current tables grants config for comparision later on\n\n {%- do store_result('agate_table', response='OK', agate_table=agate_table) -%}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% set create_table_sql = \"\" %}\n {% if exists_as_view %}\n {{ exceptions.raise_compiler_error(\"Cannot seed to '{}', it is a view\".format(old_relation)) }}\n {% elif exists_as_table %}\n {% set create_table_sql = reset_csv_table(model, full_refresh_mode, old_relation, agate_table) %}\n {% else %}\n {% set create_table_sql = create_csv_table(model, agate_table) %}\n {% endif %}\n\n {% set code = 'CREATE' if full_refresh_mode else 'INSERT' %}\n {% set rows_affected = (agate_table.rows | length) %}\n {% set sql = load_csv_rows(model, agate_table) %}\n\n {% call noop_statement('main', code ~ ' ' ~ rows_affected, code, rows_affected) %}\n {{ get_csv_sql(create_table_sql, sql) }};\n {% endcall %}\n\n {% set target_relation = this.incorporate(type='table') %}\n\n {% set should_revoke = should_revoke(old_relation, full_refresh_mode) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if full_refresh_mode or not exists_as_table %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n -- `COMMIT` happens here\n {{ adapter.commit() }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh", "macro.dbt.run_hooks", "macro.dbt.reset_csv_table", "macro.dbt.create_csv_table", "macro.dbt.load_csv_rows", "macro.dbt.noop_statement", "macro.dbt.get_csv_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.666765, "supported_languages": ["sql"]}, "macro.dbt.create_csv_table": {"name": "create_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.create_csv_table", "macro_sql": "{% macro create_csv_table(model, agate_table) -%}\n {{ adapter.dispatch('create_csv_table', 'dbt')(model, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.672653, "supported_languages": null}, "macro.dbt.default__create_csv_table": {"name": "default__create_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__create_csv_table", "macro_sql": "{% macro default__create_csv_table(model, agate_table) %}\n {%- set column_override = model['config'].get('column_types', {}) -%}\n {%- set quote_seed_column = model['config'].get('quote_columns', None) -%}\n\n {% set sql %}\n create table {{ this.render() }} (\n {%- for col_name in agate_table.column_names -%}\n {%- set inferred_type = adapter.convert_type(agate_table, loop.index0) -%}\n {%- set type = column_override.get(col_name, inferred_type) -%}\n {%- set column_name = (col_name | string) -%}\n {{ adapter.quote_seed_column(column_name, quote_seed_column) }} {{ type }} {%- if not loop.last -%}, {%- endif -%}\n {%- endfor -%}\n )\n {% endset %}\n\n {% call statement('_') -%}\n {{ sql }}\n {%- endcall %}\n\n {{ return(sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.673663, "supported_languages": null}, "macro.dbt.reset_csv_table": {"name": "reset_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.reset_csv_table", "macro_sql": "{% macro reset_csv_table(model, full_refresh, old_relation, agate_table) -%}\n {{ adapter.dispatch('reset_csv_table', 'dbt')(model, full_refresh, old_relation, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__reset_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.673939, "supported_languages": null}, "macro.dbt.default__reset_csv_table": {"name": "default__reset_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__reset_csv_table", "macro_sql": "{% macro default__reset_csv_table(model, full_refresh, old_relation, agate_table) %}\n {% set sql = \"\" %}\n {% if full_refresh %}\n {{ adapter.drop_relation(old_relation) }}\n {% set sql = create_csv_table(model, agate_table) %}\n {% else %}\n {{ adapter.truncate_relation(old_relation) }}\n {% set sql = \"truncate table \" ~ old_relation %}\n {% endif %}\n\n {{ return(sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.674458, "supported_languages": null}, "macro.dbt.get_csv_sql": {"name": "get_csv_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_csv_sql", "macro_sql": "{% macro get_csv_sql(create_or_truncate_sql, insert_sql) %}\n {{ adapter.dispatch('get_csv_sql', 'dbt')(create_or_truncate_sql, insert_sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_csv_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.674674, "supported_languages": null}, "macro.dbt.default__get_csv_sql": {"name": "default__get_csv_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_csv_sql", "macro_sql": "{% macro default__get_csv_sql(create_or_truncate_sql, insert_sql) %}\n {{ create_or_truncate_sql }};\n -- dbt seed --\n {{ insert_sql }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6748211, "supported_languages": null}, "macro.dbt.get_binding_char": {"name": "get_binding_char", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_binding_char", "macro_sql": "{% macro get_binding_char() -%}\n {{ adapter.dispatch('get_binding_char', 'dbt')() }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_binding_char"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.674981, "supported_languages": null}, "macro.dbt.default__get_binding_char": {"name": "default__get_binding_char", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_binding_char", "macro_sql": "{% macro default__get_binding_char() %}\n {{ return('%s') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.675104, "supported_languages": null}, "macro.dbt.get_batch_size": {"name": "get_batch_size", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_batch_size", "macro_sql": "{% macro get_batch_size() -%}\n {{ return(adapter.dispatch('get_batch_size', 'dbt')()) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_batch_size"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.675272, "supported_languages": null}, "macro.dbt.default__get_batch_size": {"name": "default__get_batch_size", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_batch_size", "macro_sql": "{% macro default__get_batch_size() %}\n {{ return(10000) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.675406, "supported_languages": null}, "macro.dbt.get_seed_column_quoted_csv": {"name": "get_seed_column_quoted_csv", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_seed_column_quoted_csv", "macro_sql": "{% macro get_seed_column_quoted_csv(model, column_names) %}\n {%- set quote_seed_column = model['config'].get('quote_columns', None) -%}\n {% set quoted = [] %}\n {% for col in column_names -%}\n {%- do quoted.append(adapter.quote_seed_column(col, quote_seed_column)) -%}\n {%- endfor %}\n\n {%- set dest_cols_csv = quoted | join(', ') -%}\n {{ return(dest_cols_csv) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.675927, "supported_languages": null}, "macro.dbt.load_csv_rows": {"name": "load_csv_rows", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.load_csv_rows", "macro_sql": "{% macro load_csv_rows(model, agate_table) -%}\n {{ adapter.dispatch('load_csv_rows', 'dbt')(model, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__load_csv_rows"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.676129, "supported_languages": null}, "macro.dbt.default__load_csv_rows": {"name": "default__load_csv_rows", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__load_csv_rows", "macro_sql": "{% macro default__load_csv_rows(model, agate_table) %}\n\n {% set batch_size = get_batch_size() %}\n\n {% set cols_sql = get_seed_column_quoted_csv(model, agate_table.column_names) %}\n {% set bindings = [] %}\n\n {% set statements = [] %}\n\n {% for chunk in agate_table.rows | batch(batch_size) %}\n {% set bindings = [] %}\n\n {% for row in chunk %}\n {% do bindings.extend(row) %}\n {% endfor %}\n\n {% set sql %}\n insert into {{ this.render() }} ({{ cols_sql }}) values\n {% for row in chunk -%}\n ({%- for column in agate_table.column_names -%}\n {{ get_binding_char() }}\n {%- if not loop.last%},{%- endif %}\n {%- endfor -%})\n {%- if not loop.last%},{%- endif %}\n {%- endfor %}\n {% endset %}\n\n {% do adapter.add_query(sql, bindings=bindings, abridge_sql_log=True) %}\n\n {% if loop.index0 == 0 %}\n {% do statements.append(sql) %}\n {% endif %}\n {% endfor %}\n\n {# Return SQL so we can render it out into the compiled files #}\n {{ return(statements[0]) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_batch_size", "macro.dbt.get_seed_column_quoted_csv", "macro.dbt.get_binding_char"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.677561, "supported_languages": null}, "macro.dbt.generate_alias_name": {"name": "generate_alias_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_alias.sql", "original_file_path": "macros/get_custom_name/get_custom_alias.sql", "unique_id": "macro.dbt.generate_alias_name", "macro_sql": "{% macro generate_alias_name(custom_alias_name=none, node=none) -%}\n {% do return(adapter.dispatch('generate_alias_name', 'dbt')(custom_alias_name, node)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_alias_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.678072, "supported_languages": null}, "macro.dbt.default__generate_alias_name": {"name": "default__generate_alias_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_alias.sql", "original_file_path": "macros/get_custom_name/get_custom_alias.sql", "unique_id": "macro.dbt.default__generate_alias_name", "macro_sql": "{% macro default__generate_alias_name(custom_alias_name=none, node=none) -%}\n\n {%- if custom_alias_name -%}\n\n {{ custom_alias_name | trim }}\n\n {%- elif node.version -%}\n\n {{ return(node.name ~ \"_v\" ~ (node.version | replace(\".\", \"_\"))) }}\n\n {%- else -%}\n\n {{ node.name }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6785002, "supported_languages": null}, "macro.dbt.generate_schema_name": {"name": "generate_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.generate_schema_name", "macro_sql": "{% macro generate_schema_name(custom_schema_name=none, node=none) -%}\n {{ return(adapter.dispatch('generate_schema_name', 'dbt')(custom_schema_name, node)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_schema_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6790679, "supported_languages": null}, "macro.dbt.default__generate_schema_name": {"name": "default__generate_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.default__generate_schema_name", "macro_sql": "{% macro default__generate_schema_name(custom_schema_name, node) -%}\n\n {%- set default_schema = target.schema -%}\n {%- if custom_schema_name is none -%}\n\n {{ default_schema }}\n\n {%- else -%}\n\n {{ default_schema }}_{{ custom_schema_name | trim }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.679353, "supported_languages": null}, "macro.dbt.generate_schema_name_for_env": {"name": "generate_schema_name_for_env", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.generate_schema_name_for_env", "macro_sql": "{% macro generate_schema_name_for_env(custom_schema_name, node) -%}\n\n {%- set default_schema = target.schema -%}\n {%- if target.name == 'prod' and custom_schema_name is not none -%}\n\n {{ custom_schema_name | trim }}\n\n {%- else -%}\n\n {{ default_schema }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.679661, "supported_languages": null}, "macro.dbt.generate_database_name": {"name": "generate_database_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_database.sql", "original_file_path": "macros/get_custom_name/get_custom_database.sql", "unique_id": "macro.dbt.generate_database_name", "macro_sql": "{% macro generate_database_name(custom_database_name=none, node=none) -%}\n {% do return(adapter.dispatch('generate_database_name', 'dbt')(custom_database_name, node)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_database_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6801002, "supported_languages": null}, "macro.dbt.default__generate_database_name": {"name": "default__generate_database_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_database.sql", "original_file_path": "macros/get_custom_name/get_custom_database.sql", "unique_id": "macro.dbt.default__generate_database_name", "macro_sql": "{% macro default__generate_database_name(custom_database_name=none, node=none) -%}\n {%- set default_database = target.database -%}\n {%- if custom_database_name is none -%}\n\n {{ default_database }}\n\n {%- else -%}\n\n {{ custom_database_name }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.680371, "supported_languages": null}, "macro.dbt.default__test_relationships": {"name": "default__test_relationships", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/relationships.sql", "original_file_path": "macros/generic_test_sql/relationships.sql", "unique_id": "macro.dbt.default__test_relationships", "macro_sql": "{% macro default__test_relationships(model, column_name, to, field) %}\n\nwith child as (\n select {{ column_name }} as from_field\n from {{ model }}\n where {{ column_name }} is not null\n),\n\nparent as (\n select {{ field }} as to_field\n from {{ to }}\n)\n\nselect\n from_field\n\nfrom child\nleft join parent\n on child.from_field = parent.to_field\n\nwhere parent.to_field is null\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6807501, "supported_languages": null}, "macro.dbt.default__test_not_null": {"name": "default__test_not_null", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/not_null.sql", "original_file_path": "macros/generic_test_sql/not_null.sql", "unique_id": "macro.dbt.default__test_not_null", "macro_sql": "{% macro default__test_not_null(model, column_name) %}\n\n{% set column_list = '*' if should_store_failures() else column_name %}\n\nselect {{ column_list }}\nfrom {{ model }}\nwhere {{ column_name }} is null\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_store_failures"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.681068, "supported_languages": null}, "macro.dbt.default__test_unique": {"name": "default__test_unique", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/unique.sql", "original_file_path": "macros/generic_test_sql/unique.sql", "unique_id": "macro.dbt.default__test_unique", "macro_sql": "{% macro default__test_unique(model, column_name) %}\n\nselect\n {{ column_name }} as unique_field,\n count(*) as n_records\n\nfrom {{ model }}\nwhere {{ column_name }} is not null\ngroup by {{ column_name }}\nhaving count(*) > 1\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.681325, "supported_languages": null}, "macro.dbt.default__test_accepted_values": {"name": "default__test_accepted_values", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/accepted_values.sql", "original_file_path": "macros/generic_test_sql/accepted_values.sql", "unique_id": "macro.dbt.default__test_accepted_values", "macro_sql": "{% macro default__test_accepted_values(model, column_name, values, quote=True) %}\n\nwith all_values as (\n\n select\n {{ column_name }} as value_field,\n count(*) as n_records\n\n from {{ model }}\n group by {{ column_name }}\n\n)\n\nselect *\nfrom all_values\nwhere value_field not in (\n {% for value in values -%}\n {% if quote -%}\n '{{ value }}'\n {%- else -%}\n {{ value }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {%- endfor %}\n)\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.682019, "supported_languages": null}, "macro.dbt.statement": {"name": "statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.statement", "macro_sql": "\n{%- macro statement(name=None, fetch_result=False, auto_begin=True, language='sql') -%}\n {%- if execute: -%}\n {%- set compiled_code = caller() -%}\n\n {%- if name == 'main' -%}\n {{ log('Writing runtime {} for node \"{}\"'.format(language, model['unique_id'])) }}\n {{ write(compiled_code) }}\n {%- endif -%}\n {%- if language == 'sql'-%}\n {%- set res, table = adapter.execute(compiled_code, auto_begin=auto_begin, fetch=fetch_result) -%}\n {%- elif language == 'python' -%}\n {%- set res = submit_python_job(model, compiled_code) -%}\n {#-- TODO: What should table be for python models? --#}\n {%- set table = None -%}\n {%- else -%}\n {% do exceptions.raise_compiler_error(\"statement macro didn't get supported language\") %}\n {%- endif -%}\n\n {%- if name is not none -%}\n {{ store_result(name, response=res, agate_table=table) }}\n {%- endif -%}\n\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.683671, "supported_languages": null}, "macro.dbt.noop_statement": {"name": "noop_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.noop_statement", "macro_sql": "{% macro noop_statement(name=None, message=None, code=None, rows_affected=None, res=None) -%}\n {%- set sql = caller() -%}\n\n {%- if name == 'main' -%}\n {{ log('Writing runtime SQL for node \"{}\"'.format(model['unique_id'])) }}\n {{ write(sql) }}\n {%- endif -%}\n\n {%- if name is not none -%}\n {{ store_raw_result(name, message=message, code=code, rows_affected=rows_affected, agate_table=res) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.684535, "supported_languages": null}, "macro.dbt.run_query": {"name": "run_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.run_query", "macro_sql": "{% macro run_query(sql) %}\n {% call statement(\"run_query_statement\", fetch_result=true, auto_begin=false) %}\n {{ sql }}\n {% endcall %}\n\n {% do return(load_result(\"run_query_statement\").table) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6849148, "supported_languages": null}, "macro.dbt.convert_datetime": {"name": "convert_datetime", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.convert_datetime", "macro_sql": "{% macro convert_datetime(date_str, date_fmt) %}\n\n {% set error_msg -%}\n The provided partition date '{{ date_str }}' does not match the expected format '{{ date_fmt }}'\n {%- endset %}\n\n {% set res = try_or_compiler_error(error_msg, modules.datetime.datetime.strptime, date_str.strip(), date_fmt) %}\n {{ return(res) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.687093, "supported_languages": null}, "macro.dbt.dates_in_range": {"name": "dates_in_range", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.dates_in_range", "macro_sql": "{% macro dates_in_range(start_date_str, end_date_str=none, in_fmt=\"%Y%m%d\", out_fmt=\"%Y%m%d\") %}\n {% set end_date_str = start_date_str if end_date_str is none else end_date_str %}\n\n {% set start_date = convert_datetime(start_date_str, in_fmt) %}\n {% set end_date = convert_datetime(end_date_str, in_fmt) %}\n\n {% set day_count = (end_date - start_date).days %}\n {% if day_count < 0 %}\n {% set msg -%}\n Partiton start date is after the end date ({{ start_date }}, {{ end_date }})\n {%- endset %}\n\n {{ exceptions.raise_compiler_error(msg, model) }}\n {% endif %}\n\n {% set date_list = [] %}\n {% for i in range(0, day_count + 1) %}\n {% set the_date = (modules.datetime.timedelta(days=i) + start_date) %}\n {% if not out_fmt %}\n {% set _ = date_list.append(the_date) %}\n {% else %}\n {% set _ = date_list.append(the_date.strftime(out_fmt)) %}\n {% endif %}\n {% endfor %}\n\n {{ return(date_list) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.convert_datetime"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.688434, "supported_languages": null}, "macro.dbt.partition_range": {"name": "partition_range", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.partition_range", "macro_sql": "{% macro partition_range(raw_partition_date, date_fmt='%Y%m%d') %}\n {% set partition_range = (raw_partition_date | string).split(\",\") %}\n\n {% if (partition_range | length) == 1 %}\n {% set start_date = partition_range[0] %}\n {% set end_date = none %}\n {% elif (partition_range | length) == 2 %}\n {% set start_date = partition_range[0] %}\n {% set end_date = partition_range[1] %}\n {% else %}\n {{ exceptions.raise_compiler_error(\"Invalid partition time. Expected format: {Start Date}[,{End Date}]. Got: \" ~ raw_partition_date) }}\n {% endif %}\n\n {{ return(dates_in_range(start_date, end_date, in_fmt=date_fmt)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dates_in_range"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.689304, "supported_languages": null}, "macro.dbt.py_current_timestring": {"name": "py_current_timestring", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.py_current_timestring", "macro_sql": "{% macro py_current_timestring() %}\n {% set dt = modules.datetime.datetime.now() %}\n {% do return(dt.strftime(\"%Y%m%d%H%M%S%f\")) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6897018, "supported_languages": null}, "macro.dbt.except": {"name": "except", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/except.sql", "original_file_path": "macros/utils/except.sql", "unique_id": "macro.dbt.except", "macro_sql": "{% macro except() %}\n {{ return(adapter.dispatch('except', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.690003, "supported_languages": null}, "macro.dbt.default__except": {"name": "default__except", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/except.sql", "original_file_path": "macros/utils/except.sql", "unique_id": "macro.dbt.default__except", "macro_sql": "{% macro default__except() %}\n\n except\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.690101, "supported_languages": null}, "macro.dbt.replace": {"name": "replace", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/replace.sql", "original_file_path": "macros/utils/replace.sql", "unique_id": "macro.dbt.replace", "macro_sql": "{% macro replace(field, old_chars, new_chars) -%}\n {{ return(adapter.dispatch('replace', 'dbt') (field, old_chars, new_chars)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__replace"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6904829, "supported_languages": null}, "macro.dbt.default__replace": {"name": "default__replace", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/replace.sql", "original_file_path": "macros/utils/replace.sql", "unique_id": "macro.dbt.default__replace", "macro_sql": "{% macro default__replace(field, old_chars, new_chars) %}\n\n replace(\n {{ field }},\n {{ old_chars }},\n {{ new_chars }}\n )\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.690669, "supported_languages": null}, "macro.dbt.concat": {"name": "concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/concat.sql", "original_file_path": "macros/utils/concat.sql", "unique_id": "macro.dbt.concat", "macro_sql": "{% macro concat(fields) -%}\n {{ return(adapter.dispatch('concat', 'dbt')(fields)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.690939, "supported_languages": null}, "macro.dbt.default__concat": {"name": "default__concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/concat.sql", "original_file_path": "macros/utils/concat.sql", "unique_id": "macro.dbt.default__concat", "macro_sql": "{% macro default__concat(fields) -%}\n {{ fields|join(' || ') }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.691075, "supported_languages": null}, "macro.dbt.length": {"name": "length", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/length.sql", "original_file_path": "macros/utils/length.sql", "unique_id": "macro.dbt.length", "macro_sql": "{% macro length(expression) -%}\n {{ return(adapter.dispatch('length', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__length"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.691351, "supported_languages": null}, "macro.dbt.default__length": {"name": "default__length", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/length.sql", "original_file_path": "macros/utils/length.sql", "unique_id": "macro.dbt.default__length", "macro_sql": "{% macro default__length(expression) %}\n\n length(\n {{ expression }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.691469, "supported_languages": null}, "macro.dbt.dateadd": {"name": "dateadd", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt.dateadd", "macro_sql": "{% macro dateadd(datepart, interval, from_date_or_timestamp) %}\n {{ return(adapter.dispatch('dateadd', 'dbt')(datepart, interval, from_date_or_timestamp)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.692847, "supported_languages": null}, "macro.dbt.default__dateadd": {"name": "default__dateadd", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt.default__dateadd", "macro_sql": "{% macro default__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n dateadd(\n {{ datepart }},\n {{ interval }},\n {{ from_date_or_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6932428, "supported_languages": null}, "macro.dbt.intersect": {"name": "intersect", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/intersect.sql", "original_file_path": "macros/utils/intersect.sql", "unique_id": "macro.dbt.intersect", "macro_sql": "{% macro intersect() %}\n {{ return(adapter.dispatch('intersect', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__intersect"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6937659, "supported_languages": null}, "macro.dbt.default__intersect": {"name": "default__intersect", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/intersect.sql", "original_file_path": "macros/utils/intersect.sql", "unique_id": "macro.dbt.default__intersect", "macro_sql": "{% macro default__intersect() %}\n\n intersect\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.693887, "supported_languages": null}, "macro.dbt.escape_single_quotes": {"name": "escape_single_quotes", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/escape_single_quotes.sql", "original_file_path": "macros/utils/escape_single_quotes.sql", "unique_id": "macro.dbt.escape_single_quotes", "macro_sql": "{% macro escape_single_quotes(expression) %}\n {{ return(adapter.dispatch('escape_single_quotes', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__escape_single_quotes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.694303, "supported_languages": null}, "macro.dbt.default__escape_single_quotes": {"name": "default__escape_single_quotes", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/escape_single_quotes.sql", "original_file_path": "macros/utils/escape_single_quotes.sql", "unique_id": "macro.dbt.default__escape_single_quotes", "macro_sql": "{% macro default__escape_single_quotes(expression) -%}\n{{ expression | replace(\"'\",\"''\") }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.69447, "supported_languages": null}, "macro.dbt.right": {"name": "right", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/right.sql", "original_file_path": "macros/utils/right.sql", "unique_id": "macro.dbt.right", "macro_sql": "{% macro right(string_text, length_expression) -%}\n {{ return(adapter.dispatch('right', 'dbt') (string_text, length_expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__right"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6948018, "supported_languages": null}, "macro.dbt.default__right": {"name": "default__right", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/right.sql", "original_file_path": "macros/utils/right.sql", "unique_id": "macro.dbt.default__right", "macro_sql": "{% macro default__right(string_text, length_expression) %}\n\n right(\n {{ string_text }},\n {{ length_expression }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.695057, "supported_languages": null}, "macro.dbt.listagg": {"name": "listagg", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt.listagg", "macro_sql": "{% macro listagg(measure, delimiter_text=\"','\", order_by_clause=none, limit_num=none) -%}\n {{ return(adapter.dispatch('listagg', 'dbt') (measure, delimiter_text, order_by_clause, limit_num)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__listagg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.696197, "supported_languages": null}, "macro.dbt.default__listagg": {"name": "default__listagg", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt.default__listagg", "macro_sql": "{% macro default__listagg(measure, delimiter_text, order_by_clause, limit_num) -%}\n\n {% if limit_num -%}\n array_to_string(\n array_slice(\n array_agg(\n {{ measure }}\n ){% if order_by_clause -%}\n within group ({{ order_by_clause }})\n {%- endif %}\n ,0\n ,{{ limit_num }}\n ),\n {{ delimiter_text }}\n )\n {%- else %}\n listagg(\n {{ measure }},\n {{ delimiter_text }}\n )\n {% if order_by_clause -%}\n within group ({{ order_by_clause }})\n {%- endif %}\n {%- endif %}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.69666, "supported_languages": null}, "macro.dbt.datediff": {"name": "datediff", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt.datediff", "macro_sql": "{% macro datediff(first_date, second_date, datepart) %}\n {{ return(adapter.dispatch('datediff', 'dbt')(first_date, second_date, datepart)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.69706, "supported_languages": null}, "macro.dbt.default__datediff": {"name": "default__datediff", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt.default__datediff", "macro_sql": "{% macro default__datediff(first_date, second_date, datepart) -%}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.697245, "supported_languages": null}, "macro.dbt.safe_cast": {"name": "safe_cast", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/safe_cast.sql", "original_file_path": "macros/utils/safe_cast.sql", "unique_id": "macro.dbt.safe_cast", "macro_sql": "{% macro safe_cast(field, type) %}\n {{ return(adapter.dispatch('safe_cast', 'dbt') (field, type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__safe_cast"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6975622, "supported_languages": null}, "macro.dbt.default__safe_cast": {"name": "default__safe_cast", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/safe_cast.sql", "original_file_path": "macros/utils/safe_cast.sql", "unique_id": "macro.dbt.default__safe_cast", "macro_sql": "{% macro default__safe_cast(field, type) %}\n {# most databases don't support this function yet\n so we just need to use cast #}\n cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.697719, "supported_languages": null}, "macro.dbt.hash": {"name": "hash", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/hash.sql", "original_file_path": "macros/utils/hash.sql", "unique_id": "macro.dbt.hash", "macro_sql": "{% macro hash(field) -%}\n {{ return(adapter.dispatch('hash', 'dbt') (field)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__hash"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.698008, "supported_languages": null}, "macro.dbt.default__hash": {"name": "default__hash", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/hash.sql", "original_file_path": "macros/utils/hash.sql", "unique_id": "macro.dbt.default__hash", "macro_sql": "{% macro default__hash(field) -%}\n md5(cast({{ field }} as {{ api.Column.translate_type('string') }}))\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.698184, "supported_languages": null}, "macro.dbt.cast_bool_to_text": {"name": "cast_bool_to_text", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/cast_bool_to_text.sql", "original_file_path": "macros/utils/cast_bool_to_text.sql", "unique_id": "macro.dbt.cast_bool_to_text", "macro_sql": "{% macro cast_bool_to_text(field) %}\n {{ adapter.dispatch('cast_bool_to_text', 'dbt') (field) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__cast_bool_to_text"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6984499, "supported_languages": null}, "macro.dbt.default__cast_bool_to_text": {"name": "default__cast_bool_to_text", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/cast_bool_to_text.sql", "original_file_path": "macros/utils/cast_bool_to_text.sql", "unique_id": "macro.dbt.default__cast_bool_to_text", "macro_sql": "{% macro default__cast_bool_to_text(field) %}\n cast({{ field }} as {{ api.Column.translate_type('string') }})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.698626, "supported_languages": null}, "macro.dbt.any_value": {"name": "any_value", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/any_value.sql", "original_file_path": "macros/utils/any_value.sql", "unique_id": "macro.dbt.any_value", "macro_sql": "{% macro any_value(expression) -%}\n {{ return(adapter.dispatch('any_value', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__any_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6988952, "supported_languages": null}, "macro.dbt.default__any_value": {"name": "default__any_value", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/any_value.sql", "original_file_path": "macros/utils/any_value.sql", "unique_id": "macro.dbt.default__any_value", "macro_sql": "{% macro default__any_value(expression) -%}\n\n any_value({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.699012, "supported_languages": null}, "macro.dbt.position": {"name": "position", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/position.sql", "original_file_path": "macros/utils/position.sql", "unique_id": "macro.dbt.position", "macro_sql": "{% macro position(substring_text, string_text) -%}\n {{ return(adapter.dispatch('position', 'dbt') (substring_text, string_text)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__position"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.6993248, "supported_languages": null}, "macro.dbt.default__position": {"name": "default__position", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/position.sql", "original_file_path": "macros/utils/position.sql", "unique_id": "macro.dbt.default__position", "macro_sql": "{% macro default__position(substring_text, string_text) %}\n\n position(\n {{ substring_text }} in {{ string_text }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.699473, "supported_languages": null}, "macro.dbt.string_literal": {"name": "string_literal", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/literal.sql", "original_file_path": "macros/utils/literal.sql", "unique_id": "macro.dbt.string_literal", "macro_sql": "{%- macro string_literal(value) -%}\n {{ return(adapter.dispatch('string_literal', 'dbt') (value)) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__string_literal"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.699735, "supported_languages": null}, "macro.dbt.default__string_literal": {"name": "default__string_literal", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/literal.sql", "original_file_path": "macros/utils/literal.sql", "unique_id": "macro.dbt.default__string_literal", "macro_sql": "{% macro default__string_literal(value) -%}\n '{{ value }}'\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.69985, "supported_languages": null}, "macro.dbt.type_string": {"name": "type_string", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_string", "macro_sql": "\n\n{%- macro type_string() -%}\n {{ return(adapter.dispatch('type_string', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7008262, "supported_languages": null}, "macro.dbt.default__type_string": {"name": "default__type_string", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_string", "macro_sql": "{% macro default__type_string() %}\n {{ return(api.Column.translate_type(\"string\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7009852, "supported_languages": null}, "macro.dbt.type_timestamp": {"name": "type_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_timestamp", "macro_sql": "\n\n{%- macro type_timestamp() -%}\n {{ return(adapter.dispatch('type_timestamp', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7013812, "supported_languages": null}, "macro.dbt.default__type_timestamp": {"name": "default__type_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_timestamp", "macro_sql": "{% macro default__type_timestamp() %}\n {{ return(api.Column.translate_type(\"timestamp\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.701548, "supported_languages": null}, "macro.dbt.type_float": {"name": "type_float", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_float", "macro_sql": "\n\n{%- macro type_float() -%}\n {{ return(adapter.dispatch('type_float', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_float"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.701726, "supported_languages": null}, "macro.dbt.default__type_float": {"name": "default__type_float", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_float", "macro_sql": "{% macro default__type_float() %}\n {{ return(api.Column.translate_type(\"float\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7018838, "supported_languages": null}, "macro.dbt.type_numeric": {"name": "type_numeric", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_numeric", "macro_sql": "\n\n{%- macro type_numeric() -%}\n {{ return(adapter.dispatch('type_numeric', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_numeric"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7020512, "supported_languages": null}, "macro.dbt.default__type_numeric": {"name": "default__type_numeric", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_numeric", "macro_sql": "{% macro default__type_numeric() %}\n {{ return(api.Column.numeric_type(\"numeric\", 28, 6)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.702237, "supported_languages": null}, "macro.dbt.type_bigint": {"name": "type_bigint", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_bigint", "macro_sql": "\n\n{%- macro type_bigint() -%}\n {{ return(adapter.dispatch('type_bigint', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_bigint"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.702414, "supported_languages": null}, "macro.dbt.default__type_bigint": {"name": "default__type_bigint", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_bigint", "macro_sql": "{% macro default__type_bigint() %}\n {{ return(api.Column.translate_type(\"bigint\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7026901, "supported_languages": null}, "macro.dbt.type_int": {"name": "type_int", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_int", "macro_sql": "\n\n{%- macro type_int() -%}\n {{ return(adapter.dispatch('type_int', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.702883, "supported_languages": null}, "macro.dbt.default__type_int": {"name": "default__type_int", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_int", "macro_sql": "{%- macro default__type_int() -%}\n {{ return(api.Column.translate_type(\"integer\")) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.703049, "supported_languages": null}, "macro.dbt.type_boolean": {"name": "type_boolean", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_boolean", "macro_sql": "\n\n{%- macro type_boolean() -%}\n {{ return(adapter.dispatch('type_boolean', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_boolean"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.703229, "supported_languages": null}, "macro.dbt.default__type_boolean": {"name": "default__type_boolean", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_boolean", "macro_sql": "{%- macro default__type_boolean() -%}\n {{ return(api.Column.translate_type(\"boolean\")) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.703393, "supported_languages": null}, "macro.dbt.array_concat": {"name": "array_concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_concat.sql", "original_file_path": "macros/utils/array_concat.sql", "unique_id": "macro.dbt.array_concat", "macro_sql": "{% macro array_concat(array_1, array_2) -%}\n {{ return(adapter.dispatch('array_concat', 'dbt')(array_1, array_2)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__array_concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7037141, "supported_languages": null}, "macro.dbt.default__array_concat": {"name": "default__array_concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_concat.sql", "original_file_path": "macros/utils/array_concat.sql", "unique_id": "macro.dbt.default__array_concat", "macro_sql": "{% macro default__array_concat(array_1, array_2) -%}\n array_cat({{ array_1 }}, {{ array_2 }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.703857, "supported_languages": null}, "macro.dbt.bool_or": {"name": "bool_or", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/bool_or.sql", "original_file_path": "macros/utils/bool_or.sql", "unique_id": "macro.dbt.bool_or", "macro_sql": "{% macro bool_or(expression) -%}\n {{ return(adapter.dispatch('bool_or', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__bool_or"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.70413, "supported_languages": null}, "macro.dbt.default__bool_or": {"name": "default__bool_or", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/bool_or.sql", "original_file_path": "macros/utils/bool_or.sql", "unique_id": "macro.dbt.default__bool_or", "macro_sql": "{% macro default__bool_or(expression) -%}\n\n bool_or({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.704245, "supported_languages": null}, "macro.dbt.last_day": {"name": "last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.last_day", "macro_sql": "{% macro last_day(date, datepart) %}\n {{ return(adapter.dispatch('last_day', 'dbt') (date, datepart)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__last_day"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.704617, "supported_languages": null}, "macro.dbt.default_last_day": {"name": "default_last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.default_last_day", "macro_sql": "\n\n{%- macro default_last_day(date, datepart) -%}\n cast(\n {{dbt.dateadd('day', '-1',\n dbt.dateadd(datepart, '1', dbt.date_trunc(datepart, date))\n )}}\n as date)\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.dateadd", "macro.dbt.date_trunc"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.704911, "supported_languages": null}, "macro.dbt.default__last_day": {"name": "default__last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.default__last_day", "macro_sql": "{% macro default__last_day(date, datepart) -%}\n {{dbt.default_last_day(date, datepart)}}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default_last_day"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.70508, "supported_languages": null}, "macro.dbt.split_part": {"name": "split_part", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt.split_part", "macro_sql": "{% macro split_part(string_text, delimiter_text, part_number) %}\n {{ return(adapter.dispatch('split_part', 'dbt') (string_text, delimiter_text, part_number)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__split_part"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.705656, "supported_languages": null}, "macro.dbt.default__split_part": {"name": "default__split_part", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt.default__split_part", "macro_sql": "{% macro default__split_part(string_text, delimiter_text, part_number) %}\n\n split_part(\n {{ string_text }},\n {{ delimiter_text }},\n {{ part_number }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7058392, "supported_languages": null}, "macro.dbt._split_part_negative": {"name": "_split_part_negative", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt._split_part_negative", "macro_sql": "{% macro _split_part_negative(string_text, delimiter_text, part_number) %}\n\n split_part(\n {{ string_text }},\n {{ delimiter_text }},\n length({{ string_text }})\n - length(\n replace({{ string_text }}, {{ delimiter_text }}, '')\n ) + 2 {{ part_number }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7061682, "supported_languages": null}, "macro.dbt.date_trunc": {"name": "date_trunc", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_trunc.sql", "original_file_path": "macros/utils/date_trunc.sql", "unique_id": "macro.dbt.date_trunc", "macro_sql": "{% macro date_trunc(datepart, date) -%}\n {{ return(adapter.dispatch('date_trunc', 'dbt') (datepart, date)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__date_trunc"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7064729, "supported_languages": null}, "macro.dbt.default__date_trunc": {"name": "default__date_trunc", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_trunc.sql", "original_file_path": "macros/utils/date_trunc.sql", "unique_id": "macro.dbt.default__date_trunc", "macro_sql": "{% macro default__date_trunc(datepart, date) -%}\n date_trunc('{{datepart}}', {{date}})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7066162, "supported_languages": null}, "macro.dbt.array_construct": {"name": "array_construct", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_construct.sql", "original_file_path": "macros/utils/array_construct.sql", "unique_id": "macro.dbt.array_construct", "macro_sql": "{% macro array_construct(inputs=[], data_type=api.Column.translate_type('integer')) -%}\n {{ return(adapter.dispatch('array_construct', 'dbt')(inputs, data_type)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__array_construct"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.707019, "supported_languages": null}, "macro.dbt.default__array_construct": {"name": "default__array_construct", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_construct.sql", "original_file_path": "macros/utils/array_construct.sql", "unique_id": "macro.dbt.default__array_construct", "macro_sql": "{% macro default__array_construct(inputs, data_type) -%}\n {% if inputs|length > 0 %}\n array[ {{ inputs|join(' , ') }} ]\n {% else %}\n array[]::{{data_type}}[]\n {% endif %}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.707283, "supported_languages": null}, "macro.dbt.array_append": {"name": "array_append", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_append.sql", "original_file_path": "macros/utils/array_append.sql", "unique_id": "macro.dbt.array_append", "macro_sql": "{% macro array_append(array, new_element) -%}\n {{ return(adapter.dispatch('array_append', 'dbt')(array, new_element)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__array_append"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.707592, "supported_languages": null}, "macro.dbt.default__array_append": {"name": "default__array_append", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_append.sql", "original_file_path": "macros/utils/array_append.sql", "unique_id": "macro.dbt.default__array_append", "macro_sql": "{% macro default__array_append(array, new_element) -%}\n array_append({{ array }}, {{ new_element }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.707731, "supported_languages": null}, "macro.dbt.create_schema": {"name": "create_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.create_schema", "macro_sql": "{% macro create_schema(relation) -%}\n {{ adapter.dispatch('create_schema', 'dbt')(relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__create_schema"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.708132, "supported_languages": null}, "macro.dbt.default__create_schema": {"name": "default__create_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.default__create_schema", "macro_sql": "{% macro default__create_schema(relation) -%}\n {%- call statement('create_schema') -%}\n create schema if not exists {{ relation.without_identifier() }}\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.708333, "supported_languages": null}, "macro.dbt.drop_schema": {"name": "drop_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.drop_schema", "macro_sql": "{% macro drop_schema(relation) -%}\n {{ adapter.dispatch('drop_schema', 'dbt')(relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__drop_schema"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.708504, "supported_languages": null}, "macro.dbt.default__drop_schema": {"name": "default__drop_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.default__drop_schema", "macro_sql": "{% macro default__drop_schema(relation) -%}\n {%- call statement('drop_schema') -%}\n drop schema if exists {{ relation.without_identifier() }} cascade\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.708694, "supported_languages": null}, "macro.dbt.current_timestamp": {"name": "current_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp", "macro_sql": "{%- macro current_timestamp() -%}\n {{ adapter.dispatch('current_timestamp', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_postgres.postgres__current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.709217, "supported_languages": null}, "macro.dbt.default__current_timestamp": {"name": "default__current_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp", "macro_sql": "{% macro default__current_timestamp() -%}\n {{ exceptions.raise_not_implemented(\n 'current_timestamp macro not implemented for adapter ' + adapter.type()) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.709379, "supported_languages": null}, "macro.dbt.snapshot_get_time": {"name": "snapshot_get_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.snapshot_get_time", "macro_sql": "\n\n{%- macro snapshot_get_time() -%}\n {{ adapter.dispatch('snapshot_get_time', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_postgres.postgres__snapshot_get_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.709528, "supported_languages": null}, "macro.dbt.default__snapshot_get_time": {"name": "default__snapshot_get_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__snapshot_get_time", "macro_sql": "{% macro default__snapshot_get_time() %}\n {{ current_timestamp() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7096379, "supported_languages": null}, "macro.dbt.current_timestamp_backcompat": {"name": "current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp_backcompat", "macro_sql": "{% macro current_timestamp_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__current_timestamp_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.709822, "supported_languages": null}, "macro.dbt.default__current_timestamp_backcompat": {"name": "default__current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp_backcompat", "macro_sql": "{% macro default__current_timestamp_backcompat() %}\n current_timestamp::timestamp\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.709904, "supported_languages": null}, "macro.dbt.current_timestamp_in_utc_backcompat": {"name": "current_timestamp_in_utc_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp_in_utc_backcompat", "macro_sql": "{% macro current_timestamp_in_utc_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_in_utc_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__current_timestamp_in_utc_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.710109, "supported_languages": null}, "macro.dbt.default__current_timestamp_in_utc_backcompat": {"name": "default__current_timestamp_in_utc_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp_in_utc_backcompat", "macro_sql": "{% macro default__current_timestamp_in_utc_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.current_timestamp_backcompat", "macro.dbt_postgres.postgres__current_timestamp_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.710289, "supported_languages": null}, "macro.dbt.get_create_index_sql": {"name": "get_create_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.get_create_index_sql", "macro_sql": "{% macro get_create_index_sql(relation, index_dict) -%}\n {{ return(adapter.dispatch('get_create_index_sql', 'dbt')(relation, index_dict)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__get_create_index_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.710926, "supported_languages": null}, "macro.dbt.default__get_create_index_sql": {"name": "default__get_create_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__get_create_index_sql", "macro_sql": "{% macro default__get_create_index_sql(relation, index_dict) -%}\n {% do return(None) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.711193, "supported_languages": null}, "macro.dbt.create_indexes": {"name": "create_indexes", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.create_indexes", "macro_sql": "{% macro create_indexes(relation) -%}\n {{ adapter.dispatch('create_indexes', 'dbt')(relation) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.711377, "supported_languages": null}, "macro.dbt.default__create_indexes": {"name": "default__create_indexes", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__create_indexes", "macro_sql": "{% macro default__create_indexes(relation) -%}\n {%- set _indexes = config.get('indexes', default=[]) -%}\n\n {% for _index_dict in _indexes %}\n {% set create_index_sql = get_create_index_sql(relation, _index_dict) %}\n {% if create_index_sql %}\n {% do run_query(create_index_sql) %}\n {% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_create_index_sql", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.711915, "supported_languages": null}, "macro.dbt.make_intermediate_relation": {"name": "make_intermediate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_intermediate_relation", "macro_sql": "{% macro make_intermediate_relation(base_relation, suffix='__dbt_tmp') %}\n {{ return(adapter.dispatch('make_intermediate_relation', 'dbt')(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_intermediate_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.715699, "supported_languages": null}, "macro.dbt.default__make_intermediate_relation": {"name": "default__make_intermediate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_intermediate_relation", "macro_sql": "{% macro default__make_intermediate_relation(base_relation, suffix) %}\n {{ return(default__make_temp_relation(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__make_temp_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7158961, "supported_languages": null}, "macro.dbt.make_temp_relation": {"name": "make_temp_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_temp_relation", "macro_sql": "{% macro make_temp_relation(base_relation, suffix='__dbt_tmp') %}\n {{ return(adapter.dispatch('make_temp_relation', 'dbt')(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_temp_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.716144, "supported_languages": null}, "macro.dbt.default__make_temp_relation": {"name": "default__make_temp_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_temp_relation", "macro_sql": "{% macro default__make_temp_relation(base_relation, suffix) %}\n {%- set temp_identifier = base_relation.identifier ~ suffix -%}\n {%- set temp_relation = base_relation.incorporate(\n path={\"identifier\": temp_identifier}) -%}\n\n {{ return(temp_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.716466, "supported_languages": null}, "macro.dbt.make_backup_relation": {"name": "make_backup_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_backup_relation", "macro_sql": "{% macro make_backup_relation(base_relation, backup_relation_type, suffix='__dbt_backup') %}\n {{ return(adapter.dispatch('make_backup_relation', 'dbt')(base_relation, backup_relation_type, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__make_backup_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.716741, "supported_languages": null}, "macro.dbt.default__make_backup_relation": {"name": "default__make_backup_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_backup_relation", "macro_sql": "{% macro default__make_backup_relation(base_relation, backup_relation_type, suffix) %}\n {%- set backup_identifier = base_relation.identifier ~ suffix -%}\n {%- set backup_relation = base_relation.incorporate(\n path={\"identifier\": backup_identifier},\n type=backup_relation_type\n ) -%}\n {{ return(backup_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.717087, "supported_languages": null}, "macro.dbt.drop_relation": {"name": "drop_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.drop_relation", "macro_sql": "{% macro drop_relation(relation) -%}\n {{ return(adapter.dispatch('drop_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__drop_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.717289, "supported_languages": null}, "macro.dbt.default__drop_relation": {"name": "default__drop_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__drop_relation", "macro_sql": "{% macro default__drop_relation(relation) -%}\n {% call statement('drop_relation', auto_begin=False) -%}\n drop {{ relation.type }} if exists {{ relation }} cascade\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.717525, "supported_languages": null}, "macro.dbt.truncate_relation": {"name": "truncate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.truncate_relation", "macro_sql": "{% macro truncate_relation(relation) -%}\n {{ return(adapter.dispatch('truncate_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__truncate_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7177238, "supported_languages": null}, "macro.dbt.default__truncate_relation": {"name": "default__truncate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__truncate_relation", "macro_sql": "{% macro default__truncate_relation(relation) -%}\n {% call statement('truncate_relation') -%}\n truncate table {{ relation }}\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.717896, "supported_languages": null}, "macro.dbt.rename_relation": {"name": "rename_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.rename_relation", "macro_sql": "{% macro rename_relation(from_relation, to_relation) -%}\n {{ return(adapter.dispatch('rename_relation', 'dbt')(from_relation, to_relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__rename_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.718118, "supported_languages": null}, "macro.dbt.default__rename_relation": {"name": "default__rename_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__rename_relation", "macro_sql": "{% macro default__rename_relation(from_relation, to_relation) -%}\n {% set target_name = adapter.quote_as_configured(to_relation.identifier, 'identifier') %}\n {% call statement('rename_relation') -%}\n alter table {{ from_relation }} rename to {{ target_name }}\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.71842, "supported_languages": null}, "macro.dbt.get_or_create_relation": {"name": "get_or_create_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.get_or_create_relation", "macro_sql": "{% macro get_or_create_relation(database, schema, identifier, type) -%}\n {{ return(adapter.dispatch('get_or_create_relation', 'dbt')(database, schema, identifier, type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_or_create_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7186902, "supported_languages": null}, "macro.dbt.default__get_or_create_relation": {"name": "default__get_or_create_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__get_or_create_relation", "macro_sql": "{% macro default__get_or_create_relation(database, schema, identifier, type) %}\n {%- set target_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) %}\n\n {% if target_relation %}\n {% do return([true, target_relation]) %}\n {% endif %}\n\n {%- set new_relation = api.Relation.create(\n database=database,\n schema=schema,\n identifier=identifier,\n type=type\n ) -%}\n {% do return([false, new_relation]) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.719291, "supported_languages": null}, "macro.dbt.load_cached_relation": {"name": "load_cached_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.load_cached_relation", "macro_sql": "{% macro load_cached_relation(relation) %}\n {% do return(adapter.get_relation(\n database=relation.database,\n schema=relation.schema,\n identifier=relation.identifier\n )) -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7196212, "supported_languages": null}, "macro.dbt.load_relation": {"name": "load_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.load_relation", "macro_sql": "{% macro load_relation(relation) %}\n {{ return(load_cached_relation(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.719775, "supported_languages": null}, "macro.dbt.drop_relation_if_exists": {"name": "drop_relation_if_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.drop_relation_if_exists", "macro_sql": "{% macro drop_relation_if_exists(relation) %}\n {% if relation is not none %}\n {{ adapter.drop_relation(relation) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.719989, "supported_languages": null}, "macro.dbt.collect_freshness": {"name": "collect_freshness", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/freshness.sql", "original_file_path": "macros/adapters/freshness.sql", "unique_id": "macro.dbt.collect_freshness", "macro_sql": "{% macro collect_freshness(source, loaded_at_field, filter) %}\n {{ return(adapter.dispatch('collect_freshness', 'dbt')(source, loaded_at_field, filter))}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__collect_freshness"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.72046, "supported_languages": null}, "macro.dbt.default__collect_freshness": {"name": "default__collect_freshness", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/freshness.sql", "original_file_path": "macros/adapters/freshness.sql", "unique_id": "macro.dbt.default__collect_freshness", "macro_sql": "{% macro default__collect_freshness(source, loaded_at_field, filter) %}\n {% call statement('collect_freshness', fetch_result=True, auto_begin=False) -%}\n select\n max({{ loaded_at_field }}) as max_loaded_at,\n {{ current_timestamp() }} as snapshotted_at\n from {{ source }}\n {% if filter %}\n where {{ filter }}\n {% endif %}\n {% endcall %}\n {{ return(load_result('collect_freshness')) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7209148, "supported_languages": null}, "macro.dbt.copy_grants": {"name": "copy_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.copy_grants", "macro_sql": "{% macro copy_grants() %}\n {{ return(adapter.dispatch('copy_grants', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__copy_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.722959, "supported_languages": null}, "macro.dbt.default__copy_grants": {"name": "default__copy_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__copy_grants", "macro_sql": "{% macro default__copy_grants() %}\n {{ return(True) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.723138, "supported_languages": null}, "macro.dbt.support_multiple_grantees_per_dcl_statement": {"name": "support_multiple_grantees_per_dcl_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.support_multiple_grantees_per_dcl_statement", "macro_sql": "{% macro support_multiple_grantees_per_dcl_statement() %}\n {{ return(adapter.dispatch('support_multiple_grantees_per_dcl_statement', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__support_multiple_grantees_per_dcl_statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.723341, "supported_languages": null}, "macro.dbt.default__support_multiple_grantees_per_dcl_statement": {"name": "default__support_multiple_grantees_per_dcl_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__support_multiple_grantees_per_dcl_statement", "macro_sql": "\n\n{%- macro default__support_multiple_grantees_per_dcl_statement() -%}\n {{ return(True) }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7234712, "supported_languages": null}, "macro.dbt.should_revoke": {"name": "should_revoke", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.should_revoke", "macro_sql": "{% macro should_revoke(existing_relation, full_refresh_mode=True) %}\n\n {% if not existing_relation %}\n {#-- The table doesn't already exist, so no grants to copy over --#}\n {{ return(False) }}\n {% elif full_refresh_mode %}\n {#-- The object is being REPLACED -- whether grants are copied over depends on the value of user config --#}\n {{ return(copy_grants()) }}\n {% else %}\n {#-- The table is being merged/upserted/inserted -- grants will be carried over --#}\n {{ return(True) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.copy_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.723854, "supported_languages": null}, "macro.dbt.get_show_grant_sql": {"name": "get_show_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_show_grant_sql", "macro_sql": "{% macro get_show_grant_sql(relation) %}\n {{ return(adapter.dispatch(\"get_show_grant_sql\", \"dbt\")(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__get_show_grant_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7240589, "supported_languages": null}, "macro.dbt.default__get_show_grant_sql": {"name": "default__get_show_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_show_grant_sql", "macro_sql": "{% macro default__get_show_grant_sql(relation) %}\n show grants on {{ relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.724174, "supported_languages": null}, "macro.dbt.get_grant_sql": {"name": "get_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_grant_sql", "macro_sql": "{% macro get_grant_sql(relation, privilege, grantees) %}\n {{ return(adapter.dispatch('get_grant_sql', 'dbt')(relation, privilege, grantees)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_grant_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.724423, "supported_languages": null}, "macro.dbt.default__get_grant_sql": {"name": "default__get_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_grant_sql", "macro_sql": "\n\n{%- macro default__get_grant_sql(relation, privilege, grantees) -%}\n grant {{ privilege }} on {{ relation }} to {{ grantees | join(', ') }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.724627, "supported_languages": null}, "macro.dbt.get_revoke_sql": {"name": "get_revoke_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_revoke_sql", "macro_sql": "{% macro get_revoke_sql(relation, privilege, grantees) %}\n {{ return(adapter.dispatch('get_revoke_sql', 'dbt')(relation, privilege, grantees)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_revoke_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.724876, "supported_languages": null}, "macro.dbt.default__get_revoke_sql": {"name": "default__get_revoke_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_revoke_sql", "macro_sql": "\n\n{%- macro default__get_revoke_sql(relation, privilege, grantees) -%}\n revoke {{ privilege }} on {{ relation }} from {{ grantees | join(', ') }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7250812, "supported_languages": null}, "macro.dbt.get_dcl_statement_list": {"name": "get_dcl_statement_list", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_dcl_statement_list", "macro_sql": "{% macro get_dcl_statement_list(relation, grant_config, get_dcl_macro) %}\n {{ return(adapter.dispatch('get_dcl_statement_list', 'dbt')(relation, grant_config, get_dcl_macro)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_dcl_statement_list"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.725327, "supported_languages": null}, "macro.dbt.default__get_dcl_statement_list": {"name": "default__get_dcl_statement_list", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_dcl_statement_list", "macro_sql": "\n\n{%- macro default__get_dcl_statement_list(relation, grant_config, get_dcl_macro) -%}\n {#\n -- Unpack grant_config into specific privileges and the set of users who need them granted/revoked.\n -- Depending on whether this database supports multiple grantees per statement, pass in the list of\n -- all grantees per privilege, or (if not) template one statement per privilege-grantee pair.\n -- `get_dcl_macro` will be either `get_grant_sql` or `get_revoke_sql`\n #}\n {%- set dcl_statements = [] -%}\n {%- for privilege, grantees in grant_config.items() %}\n {%- if support_multiple_grantees_per_dcl_statement() and grantees -%}\n {%- set dcl = get_dcl_macro(relation, privilege, grantees) -%}\n {%- do dcl_statements.append(dcl) -%}\n {%- else -%}\n {%- for grantee in grantees -%}\n {% set dcl = get_dcl_macro(relation, privilege, [grantee]) %}\n {%- do dcl_statements.append(dcl) -%}\n {% endfor -%}\n {%- endif -%}\n {%- endfor -%}\n {{ return(dcl_statements) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.support_multiple_grantees_per_dcl_statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.72614, "supported_languages": null}, "macro.dbt.call_dcl_statements": {"name": "call_dcl_statements", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.call_dcl_statements", "macro_sql": "{% macro call_dcl_statements(dcl_statement_list) %}\n {{ return(adapter.dispatch(\"call_dcl_statements\", \"dbt\")(dcl_statement_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__call_dcl_statements"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.726348, "supported_languages": null}, "macro.dbt.default__call_dcl_statements": {"name": "default__call_dcl_statements", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__call_dcl_statements", "macro_sql": "{% macro default__call_dcl_statements(dcl_statement_list) %}\n {#\n -- By default, supply all grant + revoke statements in a single semicolon-separated block,\n -- so that they're all processed together.\n\n -- Some databases do not support this. Those adapters will need to override this macro\n -- to run each statement individually.\n #}\n {% call statement('grants') %}\n {% for dcl_statement in dcl_statement_list %}\n {{ dcl_statement }};\n {% endfor %}\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.726615, "supported_languages": null}, "macro.dbt.apply_grants": {"name": "apply_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.apply_grants", "macro_sql": "{% macro apply_grants(relation, grant_config, should_revoke) %}\n {{ return(adapter.dispatch(\"apply_grants\", \"dbt\")(relation, grant_config, should_revoke)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7268648, "supported_languages": null}, "macro.dbt.default__apply_grants": {"name": "default__apply_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__apply_grants", "macro_sql": "{% macro default__apply_grants(relation, grant_config, should_revoke=True) %}\n {#-- If grant_config is {} or None, this is a no-op --#}\n {% if grant_config %}\n {% if should_revoke %}\n {#-- We think previous grants may have carried over --#}\n {#-- Show current grants and calculate diffs --#}\n {% set current_grants_table = run_query(get_show_grant_sql(relation)) %}\n {% set current_grants_dict = adapter.standardize_grants_dict(current_grants_table) %}\n {% set needs_granting = diff_of_two_dicts(grant_config, current_grants_dict) %}\n {% set needs_revoking = diff_of_two_dicts(current_grants_dict, grant_config) %}\n {% if not (needs_granting or needs_revoking) %}\n {{ log('On ' ~ relation ~': All grants are in place, no revocation or granting needed.')}}\n {% endif %}\n {% else %}\n {#-- We don't think there's any chance of previous grants having carried over. --#}\n {#-- Jump straight to granting what the user has configured. --#}\n {% set needs_revoking = {} %}\n {% set needs_granting = grant_config %}\n {% endif %}\n {% if needs_granting or needs_revoking %}\n {% set revoke_statement_list = get_dcl_statement_list(relation, needs_revoking, get_revoke_sql) %}\n {% set grant_statement_list = get_dcl_statement_list(relation, needs_granting, get_grant_sql) %}\n {% set dcl_statement_list = revoke_statement_list + grant_statement_list %}\n {% if dcl_statement_list %}\n {{ call_dcl_statements(dcl_statement_list) }}\n {% endif %}\n {% endif %}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query", "macro.dbt.get_show_grant_sql", "macro.dbt.get_dcl_statement_list", "macro.dbt.call_dcl_statements"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.728105, "supported_languages": null}, "macro.dbt.alter_column_comment": {"name": "alter_column_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.alter_column_comment", "macro_sql": "{% macro alter_column_comment(relation, column_dict) -%}\n {{ return(adapter.dispatch('alter_column_comment', 'dbt')(relation, column_dict)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__alter_column_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7288792, "supported_languages": null}, "macro.dbt.default__alter_column_comment": {"name": "default__alter_column_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__alter_column_comment", "macro_sql": "{% macro default__alter_column_comment(relation, column_dict) -%}\n {{ exceptions.raise_not_implemented(\n 'alter_column_comment macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7290628, "supported_languages": null}, "macro.dbt.alter_relation_comment": {"name": "alter_relation_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.alter_relation_comment", "macro_sql": "{% macro alter_relation_comment(relation, relation_comment) -%}\n {{ return(adapter.dispatch('alter_relation_comment', 'dbt')(relation, relation_comment)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__alter_relation_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.729284, "supported_languages": null}, "macro.dbt.default__alter_relation_comment": {"name": "default__alter_relation_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__alter_relation_comment", "macro_sql": "{% macro default__alter_relation_comment(relation, relation_comment) -%}\n {{ exceptions.raise_not_implemented(\n 'alter_relation_comment macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7294662, "supported_languages": null}, "macro.dbt.persist_docs": {"name": "persist_docs", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.persist_docs", "macro_sql": "{% macro persist_docs(relation, model, for_relation=true, for_columns=true) -%}\n {{ return(adapter.dispatch('persist_docs', 'dbt')(relation, model, for_relation, for_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.729762, "supported_languages": null}, "macro.dbt.default__persist_docs": {"name": "default__persist_docs", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__persist_docs", "macro_sql": "{% macro default__persist_docs(relation, model, for_relation, for_columns) -%}\n {% if for_relation and config.persist_relation_docs() and model.description %}\n {% do run_query(alter_relation_comment(relation, model.description)) %}\n {% endif %}\n\n {% if for_columns and config.persist_column_docs() and model.columns %}\n {% do run_query(alter_column_comment(relation, model.columns)) %}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query", "macro.dbt.alter_relation_comment", "macro.dbt.alter_column_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.730287, "supported_languages": null}, "macro.dbt.get_catalog": {"name": "get_catalog", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.get_catalog", "macro_sql": "{% macro get_catalog(information_schema, schemas) -%}\n {{ return(adapter.dispatch('get_catalog', 'dbt')(information_schema, schemas)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__get_catalog"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.731939, "supported_languages": null}, "macro.dbt.default__get_catalog": {"name": "default__get_catalog", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__get_catalog", "macro_sql": "{% macro default__get_catalog(information_schema, schemas) -%}\n\n {% set typename = adapter.type() %}\n {% set msg -%}\n get_catalog not implemented for {{ typename }}\n {%- endset %}\n\n {{ exceptions.raise_compiler_error(msg) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7322218, "supported_languages": null}, "macro.dbt.information_schema_name": {"name": "information_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.information_schema_name", "macro_sql": "{% macro information_schema_name(database) %}\n {{ return(adapter.dispatch('information_schema_name', 'dbt')(database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__information_schema_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.732424, "supported_languages": null}, "macro.dbt.default__information_schema_name": {"name": "default__information_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__information_schema_name", "macro_sql": "{% macro default__information_schema_name(database) -%}\n {%- if database -%}\n {{ database }}.INFORMATION_SCHEMA\n {%- else -%}\n INFORMATION_SCHEMA\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.732595, "supported_languages": null}, "macro.dbt.list_schemas": {"name": "list_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.list_schemas", "macro_sql": "{% macro list_schemas(database) -%}\n {{ return(adapter.dispatch('list_schemas', 'dbt')(database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__list_schemas"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.732789, "supported_languages": null}, "macro.dbt.default__list_schemas": {"name": "default__list_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__list_schemas", "macro_sql": "{% macro default__list_schemas(database) -%}\n {% set sql %}\n select distinct schema_name\n from {{ information_schema_name(database) }}.SCHEMATA\n where catalog_name ilike '{{ database }}'\n {% endset %}\n {{ return(run_query(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.information_schema_name", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.733191, "supported_languages": null}, "macro.dbt.check_schema_exists": {"name": "check_schema_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.check_schema_exists", "macro_sql": "{% macro check_schema_exists(information_schema, schema) -%}\n {{ return(adapter.dispatch('check_schema_exists', 'dbt')(information_schema, schema)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__check_schema_exists"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.733477, "supported_languages": null}, "macro.dbt.default__check_schema_exists": {"name": "default__check_schema_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__check_schema_exists", "macro_sql": "{% macro default__check_schema_exists(information_schema, schema) -%}\n {% set sql -%}\n select count(*)\n from {{ information_schema.replace(information_schema_view='SCHEMATA') }}\n where catalog_name='{{ information_schema.database }}'\n and schema_name='{{ schema }}'\n {%- endset %}\n {{ return(run_query(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.replace", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.733833, "supported_languages": null}, "macro.dbt.list_relations_without_caching": {"name": "list_relations_without_caching", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.list_relations_without_caching", "macro_sql": "{% macro list_relations_without_caching(schema_relation) %}\n {{ return(adapter.dispatch('list_relations_without_caching', 'dbt')(schema_relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__list_relations_without_caching"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7340422, "supported_languages": null}, "macro.dbt.default__list_relations_without_caching": {"name": "default__list_relations_without_caching", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__list_relations_without_caching", "macro_sql": "{% macro default__list_relations_without_caching(schema_relation) %}\n {{ exceptions.raise_not_implemented(\n 'list_relations_without_caching macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.734221, "supported_languages": null}, "macro.dbt.get_columns_in_relation": {"name": "get_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_columns_in_relation", "macro_sql": "{% macro get_columns_in_relation(relation) -%}\n {{ return(adapter.dispatch('get_columns_in_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_postgres.postgres__get_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7367308, "supported_languages": null}, "macro.dbt.default__get_columns_in_relation": {"name": "default__get_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_columns_in_relation", "macro_sql": "{% macro default__get_columns_in_relation(relation) -%}\n {{ exceptions.raise_not_implemented(\n 'get_columns_in_relation macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7370229, "supported_languages": null}, "macro.dbt.sql_convert_columns_in_relation": {"name": "sql_convert_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.sql_convert_columns_in_relation", "macro_sql": "{% macro sql_convert_columns_in_relation(table) -%}\n {% set columns = [] %}\n {% for row in table %}\n {% do columns.append(api.Column(*row)) %}\n {% endfor %}\n {{ return(columns) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.737372, "supported_languages": null}, "macro.dbt.get_empty_subquery_sql": {"name": "get_empty_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_empty_subquery_sql", "macro_sql": "{% macro get_empty_subquery_sql(select_sql, select_sql_header=none) -%}\n {{ return(adapter.dispatch('get_empty_subquery_sql', 'dbt')(select_sql, select_sql_header)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.737619, "supported_languages": null}, "macro.dbt.default__get_empty_subquery_sql": {"name": "default__get_empty_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_empty_subquery_sql", "macro_sql": "{% macro default__get_empty_subquery_sql(select_sql, select_sql_header=none) %}\n {%- if select_sql_header is not none -%}\n {{ select_sql_header }}\n {%- endif -%}\n select * from (\n {{ select_sql }}\n ) as __dbt_sbq\n where false\n limit 0\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.737849, "supported_languages": null}, "macro.dbt.get_empty_schema_sql": {"name": "get_empty_schema_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_empty_schema_sql", "macro_sql": "{% macro get_empty_schema_sql(columns) -%}\n {{ return(adapter.dispatch('get_empty_schema_sql', 'dbt')(columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_empty_schema_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7380521, "supported_languages": null}, "macro.dbt.default__get_empty_schema_sql": {"name": "default__get_empty_schema_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_empty_schema_sql", "macro_sql": "{% macro default__get_empty_schema_sql(columns) %}\n {%- set col_err = [] -%}\n select\n {% for i in columns %}\n {%- set col = columns[i] -%}\n {%- if col['data_type'] is not defined -%}\n {{ col_err.append(col['name']) }}\n {%- endif -%}\n {% set col_name = adapter.quote(col['name']) if col.get('quote') else col['name'] %}\n cast(null as {{ col['data_type'] }}) as {{ col_name }}{{ \", \" if not loop.last }}\n {%- endfor -%}\n {%- if (col_err | length) > 0 -%}\n {{ exceptions.column_type_missing(column_names=col_err) }}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7389, "supported_languages": null}, "macro.dbt.get_column_schema_from_query": {"name": "get_column_schema_from_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_column_schema_from_query", "macro_sql": "{% macro get_column_schema_from_query(select_sql, select_sql_header=none) -%}\n {% set columns = [] %}\n {# -- Using an 'empty subquery' here to get the same schema as the given select_sql statement, without necessitating a data scan.#}\n {% set sql = get_empty_subquery_sql(select_sql, select_sql_header) %}\n {% set column_schema = adapter.get_column_schema_from_query(sql) %}\n {{ return(column_schema) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.739284, "supported_languages": null}, "macro.dbt.get_columns_in_query": {"name": "get_columns_in_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_columns_in_query", "macro_sql": "{% macro get_columns_in_query(select_sql) -%}\n {{ return(adapter.dispatch('get_columns_in_query', 'dbt')(select_sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_columns_in_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.739489, "supported_languages": null}, "macro.dbt.default__get_columns_in_query": {"name": "default__get_columns_in_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_columns_in_query", "macro_sql": "{% macro default__get_columns_in_query(select_sql) %}\n {% call statement('get_columns_in_query', fetch_result=True, auto_begin=False) -%}\n {{ get_empty_subquery_sql(select_sql) }}\n {% endcall %}\n {{ return(load_result('get_columns_in_query').table.columns | map(attribute='name') | list) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.739871, "supported_languages": null}, "macro.dbt.alter_column_type": {"name": "alter_column_type", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.alter_column_type", "macro_sql": "{% macro alter_column_type(relation, column_name, new_column_type) -%}\n {{ return(adapter.dispatch('alter_column_type', 'dbt')(relation, column_name, new_column_type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__alter_column_type"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7401211, "supported_languages": null}, "macro.dbt.default__alter_column_type": {"name": "default__alter_column_type", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__alter_column_type", "macro_sql": "{% macro default__alter_column_type(relation, column_name, new_column_type) -%}\n {#\n 1. Create a new column (w/ temp name and correct type)\n 2. Copy data over to it\n 3. Drop the existing column (cascade!)\n 4. Rename the new column to existing column\n #}\n {%- set tmp_column = column_name + \"__dbt_alter\" -%}\n\n {% call statement('alter_column_type') %}\n alter table {{ relation }} add column {{ adapter.quote(tmp_column) }} {{ new_column_type }};\n update {{ relation }} set {{ adapter.quote(tmp_column) }} = {{ adapter.quote(column_name) }};\n alter table {{ relation }} drop column {{ adapter.quote(column_name) }} cascade;\n alter table {{ relation }} rename column {{ adapter.quote(tmp_column) }} to {{ adapter.quote(column_name) }}\n {% endcall %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.74086, "supported_languages": null}, "macro.dbt.alter_relation_add_remove_columns": {"name": "alter_relation_add_remove_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.alter_relation_add_remove_columns", "macro_sql": "{% macro alter_relation_add_remove_columns(relation, add_columns = none, remove_columns = none) -%}\n {{ return(adapter.dispatch('alter_relation_add_remove_columns', 'dbt')(relation, add_columns, remove_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__alter_relation_add_remove_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.74128, "supported_languages": null}, "macro.dbt.default__alter_relation_add_remove_columns": {"name": "default__alter_relation_add_remove_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__alter_relation_add_remove_columns", "macro_sql": "{% macro default__alter_relation_add_remove_columns(relation, add_columns, remove_columns) %}\n\n {% if add_columns is none %}\n {% set add_columns = [] %}\n {% endif %}\n {% if remove_columns is none %}\n {% set remove_columns = [] %}\n {% endif %}\n\n {% set sql -%}\n\n alter {{ relation.type }} {{ relation }}\n\n {% for column in add_columns %}\n add column {{ column.name }} {{ column.data_type }}{{ ',' if not loop.last }}\n {% endfor %}{{ ',' if add_columns and remove_columns }}\n\n {% for column in remove_columns %}\n drop column {{ column.name }}{{ ',' if not loop.last }}\n {% endfor %}\n\n {%- endset -%}\n\n {% do run_query(sql) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7421792, "supported_languages": null}, "macro.dbt.resolve_model_name": {"name": "resolve_model_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.resolve_model_name", "macro_sql": "{% macro resolve_model_name(input_model_name) %}\n {{ return(adapter.dispatch('resolve_model_name', 'dbt')(input_model_name)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.744128, "supported_languages": null}, "macro.dbt.default__resolve_model_name": {"name": "default__resolve_model_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.default__resolve_model_name", "macro_sql": "\n\n{%- macro default__resolve_model_name(input_model_name) -%}\n {{ input_model_name | string | replace('\"', '\\\"') }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.74431, "supported_languages": null}, "macro.dbt.build_ref_function": {"name": "build_ref_function", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_ref_function", "macro_sql": "{% macro build_ref_function(model) %}\n\n {%- set ref_dict = {} -%}\n {%- for _ref in model.refs -%}\n {% set _ref_args = [_ref.get('package'), _ref['name']] if _ref.get('package') else [_ref['name'],] %}\n {%- set resolved = ref(*_ref_args, v=_ref.get('version')) -%}\n {%- if _ref.get('version') -%}\n {% do _ref_args.extend([\"v\" ~ _ref['version']]) %}\n {%- endif -%}\n {%- do ref_dict.update({_ref_args | join('.'): resolve_model_name(resolved)}) -%}\n {%- endfor -%}\n\ndef ref(*args, **kwargs):\n refs = {{ ref_dict | tojson }}\n key = '.'.join(args)\n version = kwargs.get(\"v\") or kwargs.get(\"version\")\n if version:\n key += f\".v{version}\"\n dbt_load_df_function = kwargs.get(\"dbt_load_df_function\")\n return dbt_load_df_function(refs[key])\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.745224, "supported_languages": null}, "macro.dbt.build_source_function": {"name": "build_source_function", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_source_function", "macro_sql": "{% macro build_source_function(model) %}\n\n {%- set source_dict = {} -%}\n {%- for _source in model.sources -%}\n {%- set resolved = source(*_source) -%}\n {%- do source_dict.update({_source | join('.'): resolve_model_name(resolved)}) -%}\n {%- endfor -%}\n\ndef source(*args, dbt_load_df_function):\n sources = {{ source_dict | tojson }}\n key = '.'.join(args)\n return dbt_load_df_function(sources[key])\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7457721, "supported_languages": null}, "macro.dbt.build_config_dict": {"name": "build_config_dict", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_config_dict", "macro_sql": "{% macro build_config_dict(model) %}\n {%- set config_dict = {} -%}\n {% set config_dbt_used = zip(model.config.config_keys_used, model.config.config_keys_defaults) | list %}\n {%- for key, default in config_dbt_used -%}\n {# weird type testing with enum, would be much easier to write this logic in Python! #}\n {%- if key == \"language\" -%}\n {%- set value = \"python\" -%}\n {%- endif -%}\n {%- set value = model.config.get(key, default) -%}\n {%- do config_dict.update({key: value}) -%}\n {%- endfor -%}\nconfig_dict = {{ config_dict }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.746412, "supported_languages": null}, "macro.dbt.py_script_postfix": {"name": "py_script_postfix", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.py_script_postfix", "macro_sql": "{% macro py_script_postfix(model) %}\n# This part is user provided model code\n# you will need to copy the next section to run the code\n# COMMAND ----------\n# this part is dbt logic for get ref work, do not modify\n\n{{ build_ref_function(model ) }}\n{{ build_source_function(model ) }}\n{{ build_config_dict(model) }}\n\nclass config:\n def __init__(self, *args, **kwargs):\n pass\n\n @staticmethod\n def get(key, default=None):\n return config_dict.get(key, default)\n\nclass this:\n \"\"\"dbt.this() or dbt.this.identifier\"\"\"\n database = \"{{ this.database }}\"\n schema = \"{{ this.schema }}\"\n identifier = \"{{ this.identifier }}\"\n {% set this_relation_name = resolve_model_name(this) %}\n def __repr__(self):\n return '{{ this_relation_name }}'\n\n\nclass dbtObj:\n def __init__(self, load_df_function) -> None:\n self.source = lambda *args: source(*args, dbt_load_df_function=load_df_function)\n self.ref = lambda *args, **kwargs: ref(*args, **kwargs, dbt_load_df_function=load_df_function)\n self.config = config\n self.this = this()\n self.is_incremental = {{ is_incremental() }}\n\n# COMMAND ----------\n{{py_script_comment()}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.build_ref_function", "macro.dbt.build_source_function", "macro.dbt.build_config_dict", "macro.dbt.resolve_model_name", "macro.dbt.is_incremental", "macro.dbt.py_script_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7469351, "supported_languages": null}, "macro.dbt.py_script_comment": {"name": "py_script_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.py_script_comment", "macro_sql": "{%macro py_script_comment()%}\n{%endmacro%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.747019, "supported_languages": null}, "macro.dbt.test_unique": {"name": "test_unique", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_unique", "macro_sql": "{% test unique(model, column_name) %}\n {% set macro = adapter.dispatch('test_unique', 'dbt') %}\n {{ macro(model, column_name) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_unique"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.747586, "supported_languages": null}, "macro.dbt.test_not_null": {"name": "test_not_null", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_not_null", "macro_sql": "{% test not_null(model, column_name) %}\n {% set macro = adapter.dispatch('test_not_null', 'dbt') %}\n {{ macro(model, column_name) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7478411, "supported_languages": null}, "macro.dbt.test_accepted_values": {"name": "test_accepted_values", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_accepted_values", "macro_sql": "{% test accepted_values(model, column_name, values, quote=True) %}\n {% set macro = adapter.dispatch('test_accepted_values', 'dbt') %}\n {{ macro(model, column_name, values, quote) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_accepted_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.748149, "supported_languages": null}, "macro.dbt.test_relationships": {"name": "test_relationships", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_relationships", "macro_sql": "{% test relationships(model, column_name, to, field) %}\n {% set macro = adapter.dispatch('test_relationships', 'dbt') %}\n {{ macro(model, column_name, to, field) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_relationships"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.74852, "supported_languages": null}, "macro.dbt_utils.get_url_host": {"name": "get_url_host", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_host.sql", "original_file_path": "macros/web/get_url_host.sql", "unique_id": "macro.dbt_utils.get_url_host", "macro_sql": "{% macro get_url_host(field) -%}\n {{ return(adapter.dispatch('get_url_host', 'dbt_utils')(field)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_host"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.748937, "supported_languages": null}, "macro.dbt_utils.default__get_url_host": {"name": "default__get_url_host", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_host.sql", "original_file_path": "macros/web/get_url_host.sql", "unique_id": "macro.dbt_utils.default__get_url_host", "macro_sql": "{% macro default__get_url_host(field) -%}\n\n{%- set parsed =\n dbt.split_part(\n dbt.split_part(\n dbt.replace(\n dbt.replace(\n dbt.replace(field, \"'android-app://'\", \"''\"\n ), \"'http://'\", \"''\"\n ), \"'https://'\", \"''\"\n ), \"'/'\", 1\n ), \"'?'\", 1\n )\n\n-%}\n\n\n {{ dbt.safe_cast(\n parsed,\n dbt.type_string()\n )}}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.split_part", "macro.dbt.replace", "macro.dbt.safe_cast", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.749454, "supported_languages": null}, "macro.dbt_utils.get_url_path": {"name": "get_url_path", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_path.sql", "original_file_path": "macros/web/get_url_path.sql", "unique_id": "macro.dbt_utils.get_url_path", "macro_sql": "{% macro get_url_path(field) -%}\n {{ return(adapter.dispatch('get_url_path', 'dbt_utils')(field)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_path"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.749994, "supported_languages": null}, "macro.dbt_utils.default__get_url_path": {"name": "default__get_url_path", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_path.sql", "original_file_path": "macros/web/get_url_path.sql", "unique_id": "macro.dbt_utils.default__get_url_path", "macro_sql": "{% macro default__get_url_path(field) -%}\n\n {%- set stripped_url =\n dbt.replace(\n dbt.replace(field, \"'http://'\", \"''\"), \"'https://'\", \"''\")\n -%}\n\n {%- set first_slash_pos -%}\n coalesce(\n nullif({{ dbt.position(\"'/'\", stripped_url) }}, 0),\n {{ dbt.position(\"'?'\", stripped_url) }} - 1\n )\n {%- endset -%}\n\n {%- set parsed_path =\n dbt.split_part(\n dbt.right(\n stripped_url,\n dbt.length(stripped_url) ~ \"-\" ~ first_slash_pos\n ),\n \"'?'\", 1\n )\n -%}\n\n {{ dbt.safe_cast(\n parsed_path,\n dbt.type_string()\n )}}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.replace", "macro.dbt.position", "macro.dbt.split_part", "macro.dbt.right", "macro.dbt.length", "macro.dbt.safe_cast", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.750706, "supported_languages": null}, "macro.dbt_utils.get_url_parameter": {"name": "get_url_parameter", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_parameter.sql", "original_file_path": "macros/web/get_url_parameter.sql", "unique_id": "macro.dbt_utils.get_url_parameter", "macro_sql": "{% macro get_url_parameter(field, url_parameter) -%}\n {{ return(adapter.dispatch('get_url_parameter', 'dbt_utils')(field, url_parameter)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_parameter"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7510478, "supported_languages": null}, "macro.dbt_utils.default__get_url_parameter": {"name": "default__get_url_parameter", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_parameter.sql", "original_file_path": "macros/web/get_url_parameter.sql", "unique_id": "macro.dbt_utils.default__get_url_parameter", "macro_sql": "{% macro default__get_url_parameter(field, url_parameter) -%}\n\n{%- set formatted_url_parameter = \"'\" + url_parameter + \"='\" -%}\n\n{%- set split = dbt.split_part(dbt.split_part(field, formatted_url_parameter, 2), \"'&'\", 1) -%}\n\nnullif({{ split }},'')\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.split_part"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7514062, "supported_languages": null}, "macro.dbt_utils.test_fewer_rows_than": {"name": "test_fewer_rows_than", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/fewer_rows_than.sql", "original_file_path": "macros/generic_tests/fewer_rows_than.sql", "unique_id": "macro.dbt_utils.test_fewer_rows_than", "macro_sql": "{% test fewer_rows_than(model, compare_model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_fewer_rows_than', 'dbt_utils')(model, compare_model, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_fewer_rows_than"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.752558, "supported_languages": null}, "macro.dbt_utils.default__test_fewer_rows_than": {"name": "default__test_fewer_rows_than", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/fewer_rows_than.sql", "original_file_path": "macros/generic_tests/fewer_rows_than.sql", "unique_id": "macro.dbt_utils.default__test_fewer_rows_than", "macro_sql": "{% macro default__test_fewer_rows_than(model, compare_model, group_by_columns) %}\n\n{{ config(fail_calc = 'sum(coalesce(row_count_delta, 0))') }}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set join_gb_cols %}\n {% for c in group_by_columns %}\n and a.{{c}} = b.{{c}}\n {% endfor %}\n {% endset %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n{#-- We must add a fake join key in case additional grouping variables are not provided --#}\n{#-- Redshift does not allow for dynamically created join conditions (e.g. full join on 1 = 1 --#}\n{#-- The same logic is used in equal_rowcount. In case of changes, maintain consistent logic --#}\n{% set group_by_columns = ['id_dbtutils_test_fewer_rows_than'] + group_by_columns %}\n{% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n\n\nwith a as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_fewer_rows_than,\n count(*) as count_our_model \n from {{ model }}\n {{ groupby_gb_cols }}\n\n),\nb as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_fewer_rows_than,\n count(*) as count_comparison_model \n from {{ compare_model }}\n {{ groupby_gb_cols }}\n\n),\ncounts as (\n\n select\n\n {% for c in group_by_columns -%}\n a.{{c}} as {{c}}_a,\n b.{{c}} as {{c}}_b,\n {% endfor %}\n\n count_our_model,\n count_comparison_model\n from a\n full join b on \n a.id_dbtutils_test_fewer_rows_than = b.id_dbtutils_test_fewer_rows_than\n {{ join_gb_cols }}\n\n),\nfinal as (\n\n select *,\n case\n -- fail the test if we have more rows than the reference model and return the row count delta\n when count_our_model > count_comparison_model then (count_our_model - count_comparison_model)\n -- fail the test if they are the same number\n when count_our_model = count_comparison_model then 1\n -- pass the test if the delta is positive (i.e. return the number 0)\n else 0\n end as row_count_delta\n from counts\n\n)\n\nselect * from final\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7539022, "supported_languages": null}, "macro.dbt_utils.test_equal_rowcount": {"name": "test_equal_rowcount", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equal_rowcount.sql", "original_file_path": "macros/generic_tests/equal_rowcount.sql", "unique_id": "macro.dbt_utils.test_equal_rowcount", "macro_sql": "{% test equal_rowcount(model, compare_model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_equal_rowcount', 'dbt_utils')(model, compare_model, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_equal_rowcount"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7549078, "supported_languages": null}, "macro.dbt_utils.default__test_equal_rowcount": {"name": "default__test_equal_rowcount", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equal_rowcount.sql", "original_file_path": "macros/generic_tests/equal_rowcount.sql", "unique_id": "macro.dbt_utils.default__test_equal_rowcount", "macro_sql": "{% macro default__test_equal_rowcount(model, compare_model, group_by_columns) %}\n\n{#-- Needs to be set at parse time, before we return '' below --#}\n{{ config(fail_calc = 'sum(coalesce(diff_count, 0))') }}\n\n{#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n{%- if not execute -%}\n {{ return('') }}\n{% endif %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(', ') + ', ' %}\n {% set join_gb_cols %}\n {% for c in group_by_columns %}\n and a.{{c}} = b.{{c}}\n {% endfor %}\n {% endset %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n{#-- We must add a fake join key in case additional grouping variables are not provided --#}\n{#-- Redshift does not allow for dynamically created join conditions (e.g. full join on 1 = 1 --#}\n{#-- The same logic is used in fewer_rows_than. In case of changes, maintain consistent logic --#}\n{% set group_by_columns = ['id_dbtutils_test_equal_rowcount'] + group_by_columns %}\n{% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n\nwith a as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_equal_rowcount,\n count(*) as count_a \n from {{ model }}\n {{groupby_gb_cols}}\n\n\n),\nb as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_equal_rowcount,\n count(*) as count_b \n from {{ compare_model }}\n {{groupby_gb_cols}}\n\n),\nfinal as (\n\n select\n \n {% for c in group_by_columns -%}\n a.{{c}} as {{c}}_a,\n b.{{c}} as {{c}}_b,\n {% endfor %}\n\n count_a,\n count_b,\n abs(count_a - count_b) as diff_count\n\n from a\n full join b\n on\n a.id_dbtutils_test_equal_rowcount = b.id_dbtutils_test_equal_rowcount\n {{join_gb_cols}}\n\n\n)\n\nselect * from final\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.756216, "supported_languages": null}, "macro.dbt_utils.test_relationships_where": {"name": "test_relationships_where", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/relationships_where.sql", "original_file_path": "macros/generic_tests/relationships_where.sql", "unique_id": "macro.dbt_utils.test_relationships_where", "macro_sql": "{% test relationships_where(model, column_name, to, field, from_condition=\"1=1\", to_condition=\"1=1\") %}\n {{ return(adapter.dispatch('test_relationships_where', 'dbt_utils')(model, column_name, to, field, from_condition, to_condition)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_relationships_where"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.75718, "supported_languages": null}, "macro.dbt_utils.default__test_relationships_where": {"name": "default__test_relationships_where", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/relationships_where.sql", "original_file_path": "macros/generic_tests/relationships_where.sql", "unique_id": "macro.dbt_utils.default__test_relationships_where", "macro_sql": "{% macro default__test_relationships_where(model, column_name, to, field, from_condition=\"1=1\", to_condition=\"1=1\") %}\n\n{# T-SQL has no boolean data type so we use 1=1 which returns TRUE #}\n{# ref https://stackoverflow.com/a/7170753/3842610 #}\n\nwith left_table as (\n\n select\n {{column_name}} as id\n\n from {{model}}\n\n where {{column_name}} is not null\n and {{from_condition}}\n\n),\n\nright_table as (\n\n select\n {{field}} as id\n\n from {{to}}\n\n where {{field}} is not null\n and {{to_condition}}\n\n),\n\nexceptions as (\n\n select\n left_table.id,\n right_table.id as right_id\n\n from left_table\n\n left join right_table\n on left_table.id = right_table.id\n\n where right_table.id is null\n\n)\n\nselect * from exceptions\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7575848, "supported_languages": null}, "macro.dbt_utils.test_recency": {"name": "test_recency", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/recency.sql", "original_file_path": "macros/generic_tests/recency.sql", "unique_id": "macro.dbt_utils.test_recency", "macro_sql": "{% test recency(model, field, datepart, interval, ignore_time_component=False, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_recency', 'dbt_utils')(model, field, datepart, interval, ignore_time_component, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_recency"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.758417, "supported_languages": null}, "macro.dbt_utils.default__test_recency": {"name": "default__test_recency", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/recency.sql", "original_file_path": "macros/generic_tests/recency.sql", "unique_id": "macro.dbt_utils.default__test_recency", "macro_sql": "{% macro default__test_recency(model, field, datepart, interval, ignore_time_component, group_by_columns) %}\n\n{% set threshold = 'cast(' ~ dbt.dateadd(datepart, interval * -1, dbt.current_timestamp()) ~ ' as ' ~ ('date' if ignore_time_component else dbt.type_timestamp()) ~ ')' %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n\nwith recency as (\n\n select \n\n {{ select_gb_cols }}\n {% if ignore_time_component %}\n cast(max({{ field }}) as date) as most_recent\n {%- else %}\n max({{ field }}) as most_recent\n {%- endif %}\n\n from {{ model }}\n\n {{ groupby_gb_cols }}\n\n)\n\nselect\n\n {{ select_gb_cols }}\n most_recent,\n {{ threshold }} as threshold\n\nfrom recency\nwhere most_recent < {{ threshold }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dateadd", "macro.dbt.current_timestamp", "macro.dbt.type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.759349, "supported_languages": null}, "macro.dbt_utils.test_not_constant": {"name": "test_not_constant", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_constant.sql", "original_file_path": "macros/generic_tests/not_constant.sql", "unique_id": "macro.dbt_utils.test_not_constant", "macro_sql": "{% test not_constant(model, column_name, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_not_constant', 'dbt_utils')(model, column_name, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_constant"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.759847, "supported_languages": null}, "macro.dbt_utils.default__test_not_constant": {"name": "default__test_not_constant", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_constant.sql", "original_file_path": "macros/generic_tests/not_constant.sql", "unique_id": "macro.dbt_utils.default__test_not_constant", "macro_sql": "{% macro default__test_not_constant(model, column_name, group_by_columns) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n\nselect\n {# In TSQL, subquery aggregate columns need aliases #}\n {# thus: a filler col name, 'filler_column' #}\n {{select_gb_cols}}\n count(distinct {{ column_name }}) as filler_column\n\nfrom {{ model }}\n\n {{groupby_gb_cols}}\n\nhaving count(distinct {{ column_name }}) = 1\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.760349, "supported_languages": null}, "macro.dbt_utils.test_accepted_range": {"name": "test_accepted_range", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/accepted_range.sql", "original_file_path": "macros/generic_tests/accepted_range.sql", "unique_id": "macro.dbt_utils.test_accepted_range", "macro_sql": "{% test accepted_range(model, column_name, min_value=none, max_value=none, inclusive=true) %}\n {{ return(adapter.dispatch('test_accepted_range', 'dbt_utils')(model, column_name, min_value, max_value, inclusive)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_accepted_range"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.761024, "supported_languages": null}, "macro.dbt_utils.default__test_accepted_range": {"name": "default__test_accepted_range", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/accepted_range.sql", "original_file_path": "macros/generic_tests/accepted_range.sql", "unique_id": "macro.dbt_utils.default__test_accepted_range", "macro_sql": "{% macro default__test_accepted_range(model, column_name, min_value=none, max_value=none, inclusive=true) %}\n\nwith meet_condition as(\n select *\n from {{ model }}\n),\n\nvalidation_errors as (\n select *\n from meet_condition\n where\n -- never true, defaults to an empty result set. Exists to ensure any combo of the `or` clauses below succeeds\n 1 = 2\n\n {%- if min_value is not none %}\n -- records with a value >= min_value are permitted. The `not` flips this to find records that don't meet the rule.\n or not {{ column_name }} > {{- \"=\" if inclusive }} {{ min_value }}\n {%- endif %}\n\n {%- if max_value is not none %}\n -- records with a value <= max_value are permitted. The `not` flips this to find records that don't meet the rule.\n or not {{ column_name }} < {{- \"=\" if inclusive }} {{ max_value }}\n {%- endif %}\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7615418, "supported_languages": null}, "macro.dbt_utils.test_not_accepted_values": {"name": "test_not_accepted_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_accepted_values.sql", "original_file_path": "macros/generic_tests/not_accepted_values.sql", "unique_id": "macro.dbt_utils.test_not_accepted_values", "macro_sql": "{% test not_accepted_values(model, column_name, values, quote=True) %}\n {{ return(adapter.dispatch('test_not_accepted_values', 'dbt_utils')(model, column_name, values, quote)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_accepted_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.762156, "supported_languages": null}, "macro.dbt_utils.default__test_not_accepted_values": {"name": "default__test_not_accepted_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_accepted_values.sql", "original_file_path": "macros/generic_tests/not_accepted_values.sql", "unique_id": "macro.dbt_utils.default__test_not_accepted_values", "macro_sql": "{% macro default__test_not_accepted_values(model, column_name, values, quote=True) %}\nwith all_values as (\n\n select distinct\n {{ column_name }} as value_field\n\n from {{ model }}\n\n),\n\nvalidation_errors as (\n\n select\n value_field\n\n from all_values\n where value_field in (\n {% for value in values -%}\n {% if quote -%}\n '{{ value }}'\n {%- else -%}\n {{ value }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {%- endfor %}\n )\n\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7625751, "supported_languages": null}, "macro.dbt_utils.test_at_least_one": {"name": "test_at_least_one", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/at_least_one.sql", "original_file_path": "macros/generic_tests/at_least_one.sql", "unique_id": "macro.dbt_utils.test_at_least_one", "macro_sql": "{% test at_least_one(model, column_name, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_at_least_one', 'dbt_utils')(model, column_name, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_at_least_one"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.763403, "supported_languages": null}, "macro.dbt_utils.default__test_at_least_one": {"name": "default__test_at_least_one", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/at_least_one.sql", "original_file_path": "macros/generic_tests/at_least_one.sql", "unique_id": "macro.dbt_utils.default__test_at_least_one", "macro_sql": "{% macro default__test_at_least_one(model, column_name, group_by_columns) %}\n\n{% set pruned_cols = [column_name] %}\n\n{% if group_by_columns|length() > 0 %}\n\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n {% set pruned_cols = group_by_columns %}\n\n {% if column_name not in pruned_cols %}\n {% do pruned_cols.append(column_name) %}\n {% endif %}\n\n{% endif %}\n\n{% set select_pruned_cols = pruned_cols|join(' ,') %}\n\nselect *\nfrom (\n with pruned_rows as (\n select\n {{ select_pruned_cols }}\n from {{ model }}\n where {{ column_name }} is not null\n limit 1\n )\n select\n {# In TSQL, subquery aggregate columns need aliases #}\n {# thus: a filler col name, 'filler_column' #}\n {{select_gb_cols}}\n count({{ column_name }}) as filler_column\n\n from pruned_rows\n\n {{groupby_gb_cols}}\n\n having count({{ column_name }}) = 0\n\n) validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.76434, "supported_languages": null}, "macro.dbt_utils.test_unique_combination_of_columns": {"name": "test_unique_combination_of_columns", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/unique_combination_of_columns.sql", "original_file_path": "macros/generic_tests/unique_combination_of_columns.sql", "unique_id": "macro.dbt_utils.test_unique_combination_of_columns", "macro_sql": "{% test unique_combination_of_columns(model, combination_of_columns, quote_columns=false) %}\n {{ return(adapter.dispatch('test_unique_combination_of_columns', 'dbt_utils')(model, combination_of_columns, quote_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_unique_combination_of_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.765069, "supported_languages": null}, "macro.dbt_utils.default__test_unique_combination_of_columns": {"name": "default__test_unique_combination_of_columns", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/unique_combination_of_columns.sql", "original_file_path": "macros/generic_tests/unique_combination_of_columns.sql", "unique_id": "macro.dbt_utils.default__test_unique_combination_of_columns", "macro_sql": "{% macro default__test_unique_combination_of_columns(model, combination_of_columns, quote_columns=false) %}\n\n{% if not quote_columns %}\n {%- set column_list=combination_of_columns %}\n{% elif quote_columns %}\n {%- set column_list=[] %}\n {% for column in combination_of_columns -%}\n {% set column_list = column_list.append( adapter.quote(column) ) %}\n {%- endfor %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`quote_columns` argument for unique_combination_of_columns test must be one of [True, False] Got: '\" ~ quote ~\"'.'\"\n ) }}\n{% endif %}\n\n{%- set columns_csv=column_list | join(', ') %}\n\n\nwith validation_errors as (\n\n select\n {{ columns_csv }}\n from {{ model }}\n group by {{ columns_csv }}\n having count(*) > 1\n\n)\n\nselect *\nfrom validation_errors\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.765774, "supported_languages": null}, "macro.dbt_utils.test_cardinality_equality": {"name": "test_cardinality_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/cardinality_equality.sql", "original_file_path": "macros/generic_tests/cardinality_equality.sql", "unique_id": "macro.dbt_utils.test_cardinality_equality", "macro_sql": "{% test cardinality_equality(model, column_name, to, field) %}\n {{ return(adapter.dispatch('test_cardinality_equality', 'dbt_utils')(model, column_name, to, field)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_cardinality_equality"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.766361, "supported_languages": null}, "macro.dbt_utils.default__test_cardinality_equality": {"name": "default__test_cardinality_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/cardinality_equality.sql", "original_file_path": "macros/generic_tests/cardinality_equality.sql", "unique_id": "macro.dbt_utils.default__test_cardinality_equality", "macro_sql": "{% macro default__test_cardinality_equality(model, column_name, to, field) %}\n\n{# T-SQL does not let you use numbers as aliases for columns #}\n{# Thus, no \"GROUP BY 1\" #}\n\nwith table_a as (\nselect\n {{ column_name }},\n count(*) as num_rows\nfrom {{ model }}\ngroup by {{ column_name }}\n),\n\ntable_b as (\nselect\n {{ field }},\n count(*) as num_rows\nfrom {{ to }}\ngroup by {{ field }}\n),\n\nexcept_a as (\n select *\n from table_a\n {{ dbt.except() }}\n select *\n from table_b\n),\n\nexcept_b as (\n select *\n from table_b\n {{ dbt.except() }}\n select *\n from table_a\n),\n\nunioned as (\n select *\n from except_a\n union all\n select *\n from except_b\n)\n\nselect *\nfrom unioned\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.766735, "supported_languages": null}, "macro.dbt_utils.test_expression_is_true": {"name": "test_expression_is_true", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/expression_is_true.sql", "original_file_path": "macros/generic_tests/expression_is_true.sql", "unique_id": "macro.dbt_utils.test_expression_is_true", "macro_sql": "{% test expression_is_true(model, expression, column_name=None) %}\n {{ return(adapter.dispatch('test_expression_is_true', 'dbt_utils')(model, expression, column_name)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_expression_is_true"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.767164, "supported_languages": null}, "macro.dbt_utils.default__test_expression_is_true": {"name": "default__test_expression_is_true", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/expression_is_true.sql", "original_file_path": "macros/generic_tests/expression_is_true.sql", "unique_id": "macro.dbt_utils.default__test_expression_is_true", "macro_sql": "{% macro default__test_expression_is_true(model, expression, column_name) %}\n\n{% set column_list = '*' if should_store_failures() else \"1\" %}\n\nselect\n {{ column_list }}\nfrom {{ model }}\n{% if column_name is none %}\nwhere not({{ expression }})\n{%- else %}\nwhere not({{ column_name }} {{ expression }})\n{%- endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_store_failures"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.767724, "supported_languages": null}, "macro.dbt_utils.test_not_null_proportion": {"name": "test_not_null_proportion", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_null_proportion.sql", "original_file_path": "macros/generic_tests/not_null_proportion.sql", "unique_id": "macro.dbt_utils.test_not_null_proportion", "macro_sql": "{% macro test_not_null_proportion(model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_not_null_proportion', 'dbt_utils')(model, group_by_columns, **kwargs)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_null_proportion"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.768457, "supported_languages": null}, "macro.dbt_utils.default__test_not_null_proportion": {"name": "default__test_not_null_proportion", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_null_proportion.sql", "original_file_path": "macros/generic_tests/not_null_proportion.sql", "unique_id": "macro.dbt_utils.default__test_not_null_proportion", "macro_sql": "{% macro default__test_not_null_proportion(model, group_by_columns) %}\n\n{% set column_name = kwargs.get('column_name', kwargs.get('arg')) %}\n{% set at_least = kwargs.get('at_least', kwargs.get('arg')) %}\n{% set at_most = kwargs.get('at_most', kwargs.get('arg', 1)) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\nwith validation as (\n select\n {{select_gb_cols}}\n sum(case when {{ column_name }} is null then 0 else 1 end) / cast(count(*) as numeric) as not_null_proportion\n from {{ model }}\n {{groupby_gb_cols}}\n),\nvalidation_errors as (\n select\n {{select_gb_cols}}\n not_null_proportion\n from validation\n where not_null_proportion < {{ at_least }} or not_null_proportion > {{ at_most }}\n)\nselect\n *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.769377, "supported_languages": null}, "macro.dbt_utils.test_sequential_values": {"name": "test_sequential_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/sequential_values.sql", "original_file_path": "macros/generic_tests/sequential_values.sql", "unique_id": "macro.dbt_utils.test_sequential_values", "macro_sql": "{% test sequential_values(model, column_name, interval=1, datepart=None, group_by_columns = []) %}\n\n {{ return(adapter.dispatch('test_sequential_values', 'dbt_utils')(model, column_name, interval, datepart, group_by_columns)) }}\n\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_sequential_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7703822, "supported_languages": null}, "macro.dbt_utils.default__test_sequential_values": {"name": "default__test_sequential_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/sequential_values.sql", "original_file_path": "macros/generic_tests/sequential_values.sql", "unique_id": "macro.dbt_utils.default__test_sequential_values", "macro_sql": "{% macro default__test_sequential_values(model, column_name, interval=1, datepart=None, group_by_columns = []) %}\n\n{% set previous_column_name = \"previous_\" ~ dbt_utils.slugify(column_name) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(',') + ', ' %}\n {% set partition_gb_cols = 'partition by ' + group_by_columns|join(',') %}\n{% endif %}\n\nwith windowed as (\n\n select\n {{ select_gb_cols }}\n {{ column_name }},\n lag({{ column_name }}) over (\n {{partition_gb_cols}}\n order by {{ column_name }}\n ) as {{ previous_column_name }}\n from {{ model }}\n),\n\nvalidation_errors as (\n select\n *\n from windowed\n {% if datepart %}\n where not(cast({{ column_name }} as {{ dbt.type_timestamp() }})= cast({{ dbt.dateadd(datepart, interval, previous_column_name) }} as {{ dbt.type_timestamp() }}))\n {% else %}\n where not({{ column_name }} = {{ previous_column_name }} + {{ interval }})\n {% endif %}\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.slugify", "macro.dbt.type_timestamp", "macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7713778, "supported_languages": null}, "macro.dbt_utils.test_equality": {"name": "test_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equality.sql", "original_file_path": "macros/generic_tests/equality.sql", "unique_id": "macro.dbt_utils.test_equality", "macro_sql": "{% test equality(model, compare_model, compare_columns=None) %}\n {{ return(adapter.dispatch('test_equality', 'dbt_utils')(model, compare_model, compare_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_equality"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.772177, "supported_languages": null}, "macro.dbt_utils.default__test_equality": {"name": "default__test_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equality.sql", "original_file_path": "macros/generic_tests/equality.sql", "unique_id": "macro.dbt_utils.default__test_equality", "macro_sql": "{% macro default__test_equality(model, compare_model, compare_columns=None) %}\n\n{% set set_diff %}\n count(*) + coalesce(abs(\n sum(case when which_diff = 'a_minus_b' then 1 else 0 end) -\n sum(case when which_diff = 'b_minus_a' then 1 else 0 end)\n ), 0)\n{% endset %}\n\n{#-- Needs to be set at parse time, before we return '' below --#}\n{{ config(fail_calc = set_diff) }}\n\n{#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n{%- if not execute -%}\n {{ return('') }}\n{% endif %}\n\n-- setup\n{%- do dbt_utils._is_relation(model, 'test_equality') -%}\n\n{#-\nIf the compare_cols arg is provided, we can run this test without querying the\ninformation schema\u00a0\u2014 this allows the model to be an ephemeral model\n-#}\n\n{%- if not compare_columns -%}\n {%- do dbt_utils._is_ephemeral(model, 'test_equality') -%}\n {%- set compare_columns = adapter.get_columns_in_relation(model) | map(attribute='quoted') -%}\n{%- endif -%}\n\n{% set compare_cols_csv = compare_columns | join(', ') %}\n\nwith a as (\n\n select * from {{ model }}\n\n),\n\nb as (\n\n select * from {{ compare_model }}\n\n),\n\na_minus_b as (\n\n select {{compare_cols_csv}} from a\n {{ dbt.except() }}\n select {{compare_cols_csv}} from b\n\n),\n\nb_minus_a as (\n\n select {{compare_cols_csv}} from b\n {{ dbt.except() }}\n select {{compare_cols_csv}} from a\n\n),\n\nunioned as (\n\n select 'a_minus_b' as which_diff, a_minus_b.* from a_minus_b\n union all\n select 'b_minus_a' as which_diff, b_minus_a.* from b_minus_a\n\n)\n\nselect * from unioned\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7731771, "supported_languages": null}, "macro.dbt_utils.test_not_empty_string": {"name": "test_not_empty_string", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_empty_string.sql", "original_file_path": "macros/generic_tests/not_empty_string.sql", "unique_id": "macro.dbt_utils.test_not_empty_string", "macro_sql": "{% test not_empty_string(model, column_name, trim_whitespace=true) %}\n\n {{ return(adapter.dispatch('test_not_empty_string', 'dbt_utils')(model, column_name, trim_whitespace)) }}\n\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_empty_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.773762, "supported_languages": null}, "macro.dbt_utils.default__test_not_empty_string": {"name": "default__test_not_empty_string", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_empty_string.sql", "original_file_path": "macros/generic_tests/not_empty_string.sql", "unique_id": "macro.dbt_utils.default__test_not_empty_string", "macro_sql": "{% macro default__test_not_empty_string(model, column_name, trim_whitespace=true) %}\n\n with\n \n all_values as (\n\n select \n\n\n {% if trim_whitespace == true -%}\n\n trim({{ column_name }}) as {{ column_name }}\n\n {%- else -%}\n\n {{ column_name }}\n\n {%- endif %}\n \n from {{ model }}\n\n ),\n\n errors as (\n\n select * from all_values\n where {{ column_name }} = ''\n\n )\n\n select * from errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.774108, "supported_languages": null}, "macro.dbt_utils.test_mutually_exclusive_ranges": {"name": "test_mutually_exclusive_ranges", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/mutually_exclusive_ranges.sql", "original_file_path": "macros/generic_tests/mutually_exclusive_ranges.sql", "unique_id": "macro.dbt_utils.test_mutually_exclusive_ranges", "macro_sql": "{% test mutually_exclusive_ranges(model, lower_bound_column, upper_bound_column, partition_by=None, gaps='allowed', zero_length_range_allowed=False) %}\n {{ return(adapter.dispatch('test_mutually_exclusive_ranges', 'dbt_utils')(model, lower_bound_column, upper_bound_column, partition_by, gaps, zero_length_range_allowed)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_mutually_exclusive_ranges"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.778005, "supported_languages": null}, "macro.dbt_utils.default__test_mutually_exclusive_ranges": {"name": "default__test_mutually_exclusive_ranges", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/mutually_exclusive_ranges.sql", "original_file_path": "macros/generic_tests/mutually_exclusive_ranges.sql", "unique_id": "macro.dbt_utils.default__test_mutually_exclusive_ranges", "macro_sql": "{% macro default__test_mutually_exclusive_ranges(model, lower_bound_column, upper_bound_column, partition_by=None, gaps='allowed', zero_length_range_allowed=False) %}\n{% if gaps == 'not_allowed' %}\n {% set allow_gaps_operator='=' %}\n {% set allow_gaps_operator_in_words='equal_to' %}\n{% elif gaps == 'allowed' %}\n {% set allow_gaps_operator='<=' %}\n {% set allow_gaps_operator_in_words='less_than_or_equal_to' %}\n{% elif gaps == 'required' %}\n {% set allow_gaps_operator='<' %}\n {% set allow_gaps_operator_in_words='less_than' %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`gaps` argument for mutually_exclusive_ranges test must be one of ['not_allowed', 'allowed', 'required'] Got: '\" ~ gaps ~\"'.'\"\n ) }}\n{% endif %}\n{% if not zero_length_range_allowed %}\n {% set allow_zero_length_operator='<' %}\n {% set allow_zero_length_operator_in_words='less_than' %}\n{% elif zero_length_range_allowed %}\n {% set allow_zero_length_operator='<=' %}\n {% set allow_zero_length_operator_in_words='less_than_or_equal_to' %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`zero_length_range_allowed` argument for mutually_exclusive_ranges test must be one of [true, false] Got: '\" ~ zero_length_range_allowed ~\"'.'\"\n ) }}\n{% endif %}\n\n{% set partition_clause=\"partition by \" ~ partition_by if partition_by else '' %}\n\nwith window_functions as (\n\n select\n {% if partition_by %}\n {{ partition_by }} as partition_by_col,\n {% endif %}\n {{ lower_bound_column }} as lower_bound,\n {{ upper_bound_column }} as upper_bound,\n\n lead({{ lower_bound_column }}) over (\n {{ partition_clause }}\n order by {{ lower_bound_column }}, {{ upper_bound_column }}\n ) as next_lower_bound,\n\n row_number() over (\n {{ partition_clause }}\n order by {{ lower_bound_column }} desc, {{ upper_bound_column }} desc\n ) = 1 as is_last_record\n\n from {{ model }}\n\n),\n\ncalc as (\n -- We want to return records where one of our assumptions fails, so we'll use\n -- the `not` function with `and` statements so we can write our assumptions more cleanly\n select\n *,\n\n -- For each record: lower_bound should be < upper_bound.\n -- Coalesce it to return an error on the null case (implicit assumption\n -- these columns are not_null)\n coalesce(\n lower_bound {{ allow_zero_length_operator }} upper_bound,\n false\n ) as lower_bound_{{ allow_zero_length_operator_in_words }}_upper_bound,\n\n -- For each record: upper_bound {{ allow_gaps_operator }} the next lower_bound.\n -- Coalesce it to handle null cases for the last record.\n coalesce(\n upper_bound {{ allow_gaps_operator }} next_lower_bound,\n is_last_record,\n false\n ) as upper_bound_{{ allow_gaps_operator_in_words }}_next_lower_bound\n\n from window_functions\n\n),\n\nvalidation_errors as (\n\n select\n *\n from calc\n\n where not(\n -- THE FOLLOWING SHOULD BE TRUE --\n lower_bound_{{ allow_zero_length_operator_in_words }}_upper_bound\n and upper_bound_{{ allow_gaps_operator_in_words }}_next_lower_bound\n )\n)\n\nselect * from validation_errors\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7797341, "supported_languages": null}, "macro.dbt_utils.pretty_log_format": {"name": "pretty_log_format", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_log_format.sql", "original_file_path": "macros/jinja_helpers/pretty_log_format.sql", "unique_id": "macro.dbt_utils.pretty_log_format", "macro_sql": "{% macro pretty_log_format(message) %}\n {{ return(adapter.dispatch('pretty_log_format', 'dbt_utils')(message)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pretty_log_format"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7800372, "supported_languages": null}, "macro.dbt_utils.default__pretty_log_format": {"name": "default__pretty_log_format", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_log_format.sql", "original_file_path": "macros/jinja_helpers/pretty_log_format.sql", "unique_id": "macro.dbt_utils.default__pretty_log_format", "macro_sql": "{% macro default__pretty_log_format(message) %}\n {{ return( dbt_utils.pretty_time() ~ ' + ' ~ message) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.pretty_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7802172, "supported_languages": null}, "macro.dbt_utils._is_relation": {"name": "_is_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/_is_relation.sql", "original_file_path": "macros/jinja_helpers/_is_relation.sql", "unique_id": "macro.dbt_utils._is_relation", "macro_sql": "{% macro _is_relation(obj, macro) %}\n {%- if not (obj is mapping and obj.get('metadata', {}).get('type', '').endswith('Relation')) -%}\n {%- do exceptions.raise_compiler_error(\"Macro \" ~ macro ~ \" expected a Relation but received the value: \" ~ obj) -%}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.780698, "supported_languages": null}, "macro.dbt_utils.pretty_time": {"name": "pretty_time", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_time.sql", "original_file_path": "macros/jinja_helpers/pretty_time.sql", "unique_id": "macro.dbt_utils.pretty_time", "macro_sql": "{% macro pretty_time(format='%H:%M:%S') %}\n {{ return(adapter.dispatch('pretty_time', 'dbt_utils')(format)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pretty_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7809951, "supported_languages": null}, "macro.dbt_utils.default__pretty_time": {"name": "default__pretty_time", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_time.sql", "original_file_path": "macros/jinja_helpers/pretty_time.sql", "unique_id": "macro.dbt_utils.default__pretty_time", "macro_sql": "{% macro default__pretty_time(format='%H:%M:%S') %}\n {{ return(modules.datetime.datetime.now().strftime(format)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7812119, "supported_languages": null}, "macro.dbt_utils.log_info": {"name": "log_info", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/log_info.sql", "original_file_path": "macros/jinja_helpers/log_info.sql", "unique_id": "macro.dbt_utils.log_info", "macro_sql": "{% macro log_info(message) %}\n {{ return(adapter.dispatch('log_info', 'dbt_utils')(message)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__log_info"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.781489, "supported_languages": null}, "macro.dbt_utils.default__log_info": {"name": "default__log_info", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/log_info.sql", "original_file_path": "macros/jinja_helpers/log_info.sql", "unique_id": "macro.dbt_utils.default__log_info", "macro_sql": "{% macro default__log_info(message) %}\n {{ log(dbt_utils.pretty_log_format(message), info=True) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.pretty_log_format"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.781672, "supported_languages": null}, "macro.dbt_utils.slugify": {"name": "slugify", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/slugify.sql", "original_file_path": "macros/jinja_helpers/slugify.sql", "unique_id": "macro.dbt_utils.slugify", "macro_sql": "{% macro slugify(string) %}\n\n{#- Lower case the string -#}\n{% set string = string | lower %}\n{#- Replace spaces and dashes with underscores -#}\n{% set string = modules.re.sub('[ -]+', '_', string) %}\n{#- Only take letters, numbers, and underscores -#}\n{% set string = modules.re.sub('[^a-z0-9_]+', '', string) %}\n{#- Prepends \"_\" if string begins with a number -#}\n{% set string = modules.re.sub('^[0-9]', '_' + string[0], string) %}\n\n{{ return(string) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.782341, "supported_languages": null}, "macro.dbt_utils._is_ephemeral": {"name": "_is_ephemeral", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/_is_ephemeral.sql", "original_file_path": "macros/jinja_helpers/_is_ephemeral.sql", "unique_id": "macro.dbt_utils._is_ephemeral", "macro_sql": "{% macro _is_ephemeral(obj, macro) %}\n {%- if obj.is_cte -%}\n {% set ephemeral_prefix = api.Relation.add_ephemeral_prefix('') %}\n {% if obj.name.startswith(ephemeral_prefix) %}\n {% set model_name = obj.name[(ephemeral_prefix|length):] %}\n {% else %}\n {% set model_name = obj.name %}\n {%- endif -%}\n {% set error_message %}\nThe `{{ macro }}` macro cannot be used with ephemeral models, as it relies on the information schema.\n\n`{{ model_name }}` is an ephemeral model. Consider making it a view or table instead.\n {% endset %}\n {%- do exceptions.raise_compiler_error(error_message) -%}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.783253, "supported_languages": null}, "macro.dbt_utils.get_intervals_between": {"name": "get_intervals_between", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.get_intervals_between", "macro_sql": "{% macro get_intervals_between(start_date, end_date, datepart) -%}\n {{ return(adapter.dispatch('get_intervals_between', 'dbt_utils')(start_date, end_date, datepart)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_intervals_between"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.784103, "supported_languages": null}, "macro.dbt_utils.default__get_intervals_between": {"name": "default__get_intervals_between", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.default__get_intervals_between", "macro_sql": "{% macro default__get_intervals_between(start_date, end_date, datepart) -%}\n {%- call statement('get_intervals_between', fetch_result=True) %}\n\n select {{ dbt.datediff(start_date, end_date, datepart) }}\n\n {%- endcall -%}\n\n {%- set value_list = load_result('get_intervals_between') -%}\n\n {%- if value_list and value_list['data'] -%}\n {%- set values = value_list['data'] | map(attribute=0) | list %}\n {{ return(values[0]) }}\n {%- else -%}\n {{ return(1) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.784789, "supported_languages": null}, "macro.dbt_utils.date_spine": {"name": "date_spine", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.date_spine", "macro_sql": "{% macro date_spine(datepart, start_date, end_date) %}\n {{ return(adapter.dispatch('date_spine', 'dbt_utils')(datepart, start_date, end_date)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__date_spine"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.785057, "supported_languages": null}, "macro.dbt_utils.default__date_spine": {"name": "default__date_spine", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.default__date_spine", "macro_sql": "{% macro default__date_spine(datepart, start_date, end_date) %}\n\n\n{# call as follows:\n\ndate_spine(\n \"day\",\n \"to_date('01/01/2016', 'mm/dd/yyyy')\",\n \"dbt.dateadd(week, 1, current_date)\"\n) #}\n\n\nwith rawdata as (\n\n {{dbt_utils.generate_series(\n dbt_utils.get_intervals_between(start_date, end_date, datepart)\n )}}\n\n),\n\nall_periods as (\n\n select (\n {{\n dbt.dateadd(\n datepart,\n \"row_number() over (order by 1) - 1\",\n start_date\n )\n }}\n ) as date_{{datepart}}\n from rawdata\n\n),\n\nfiltered as (\n\n select *\n from all_periods\n where date_{{datepart}} <= {{ end_date }}\n\n)\n\nselect * from filtered\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.generate_series", "macro.dbt_utils.get_intervals_between", "macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.785464, "supported_languages": null}, "macro.dbt_utils.safe_subtract": {"name": "safe_subtract", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_subtract.sql", "original_file_path": "macros/sql/safe_subtract.sql", "unique_id": "macro.dbt_utils.safe_subtract", "macro_sql": "{%- macro safe_subtract(field_list) -%}\n {{ return(adapter.dispatch('safe_subtract', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_subtract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.785897, "supported_languages": null}, "macro.dbt_utils.default__safe_subtract": {"name": "default__safe_subtract", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_subtract.sql", "original_file_path": "macros/sql/safe_subtract.sql", "unique_id": "macro.dbt_utils.default__safe_subtract", "macro_sql": "\n\n{%- macro default__safe_subtract(field_list) -%}\n\n{%- if field_list is not iterable or field_list is string or field_list is mapping -%}\n\n{%- set error_message = '\nWarning: the `safe_subtract` macro takes a single list argument instead of \\\nstring arguments. The {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.raise_compiler_error(error_message) -%}\n\n{%- endif -%}\n\n{% set fields = [] %}\n\n{%- for field in field_list -%}\n\n {% do fields.append(\"coalesce(\" ~ field ~ \", 0)\") %}\n\n{%- endfor -%}\n\n{{ fields|join(' -\\n ') }}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.786528, "supported_languages": null}, "macro.dbt_utils.nullcheck_table": {"name": "nullcheck_table", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck_table.sql", "original_file_path": "macros/sql/nullcheck_table.sql", "unique_id": "macro.dbt_utils.nullcheck_table", "macro_sql": "{% macro nullcheck_table(relation) %}\n {{ return(adapter.dispatch('nullcheck_table', 'dbt_utils')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__nullcheck_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.787025, "supported_languages": null}, "macro.dbt_utils.default__nullcheck_table": {"name": "default__nullcheck_table", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck_table.sql", "original_file_path": "macros/sql/nullcheck_table.sql", "unique_id": "macro.dbt_utils.default__nullcheck_table", "macro_sql": "{% macro default__nullcheck_table(relation) %}\n\n {%- do dbt_utils._is_relation(relation, 'nullcheck_table') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'nullcheck_table') -%}\n {% set cols = adapter.get_columns_in_relation(relation) %}\n\n select {{ dbt_utils.nullcheck(cols) }}\n from {{relation}}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt_utils.nullcheck"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.787436, "supported_languages": null}, "macro.dbt_utils.get_relations_by_pattern": {"name": "get_relations_by_pattern", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_pattern.sql", "original_file_path": "macros/sql/get_relations_by_pattern.sql", "unique_id": "macro.dbt_utils.get_relations_by_pattern", "macro_sql": "{% macro get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_relations_by_pattern', 'dbt_utils')(schema_pattern, table_pattern, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7882318, "supported_languages": null}, "macro.dbt_utils.default__get_relations_by_pattern": {"name": "default__get_relations_by_pattern", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_pattern.sql", "original_file_path": "macros/sql/get_relations_by_pattern.sql", "unique_id": "macro.dbt_utils.default__get_relations_by_pattern", "macro_sql": "{% macro default__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n {{ dbt_utils.get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude, database) }}\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=database,\n schema=row.table_schema,\n identifier=row.table_name,\n type=row.table_type\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_utils.get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.789341, "supported_languages": null}, "macro.dbt_utils.get_powers_of_two": {"name": "get_powers_of_two", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.get_powers_of_two", "macro_sql": "{% macro get_powers_of_two(upper_bound) %}\n {{ return(adapter.dispatch('get_powers_of_two', 'dbt_utils')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.790303, "supported_languages": null}, "macro.dbt_utils.default__get_powers_of_two": {"name": "default__get_powers_of_two", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.default__get_powers_of_two", "macro_sql": "{% macro default__get_powers_of_two(upper_bound) %}\n\n {% if upper_bound <= 0 %}\n {{ exceptions.raise_compiler_error(\"upper bound must be positive\") }}\n {% endif %}\n\n {% for _ in range(1, 100) %}\n {% if upper_bound <= 2 ** loop.index %}{{ return(loop.index) }}{% endif %}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.790773, "supported_languages": null}, "macro.dbt_utils.generate_series": {"name": "generate_series", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.generate_series", "macro_sql": "{% macro generate_series(upper_bound) %}\n {{ return(adapter.dispatch('generate_series', 'dbt_utils')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__generate_series"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.790987, "supported_languages": null}, "macro.dbt_utils.default__generate_series": {"name": "default__generate_series", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.default__generate_series", "macro_sql": "{% macro default__generate_series(upper_bound) %}\n\n {% set n = dbt_utils.get_powers_of_two(upper_bound) %}\n\n with p as (\n select 0 as generated_number union all select 1\n ), unioned as (\n\n select\n\n {% for i in range(n) %}\n p{{i}}.generated_number * power(2, {{i}})\n {% if not loop.last %} + {% endif %}\n {% endfor %}\n + 1\n as generated_number\n\n from\n\n {% for i in range(n) %}\n p as p{{i}}\n {% if not loop.last %} cross join {% endif %}\n {% endfor %}\n\n )\n\n select *\n from unioned\n where generated_number <= {{upper_bound}}\n order by generated_number\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7915552, "supported_languages": null}, "macro.dbt_utils.get_relations_by_prefix": {"name": "get_relations_by_prefix", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_prefix.sql", "original_file_path": "macros/sql/get_relations_by_prefix.sql", "unique_id": "macro.dbt_utils.get_relations_by_prefix", "macro_sql": "{% macro get_relations_by_prefix(schema, prefix, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_relations_by_prefix', 'dbt_utils')(schema, prefix, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_relations_by_prefix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.792323, "supported_languages": null}, "macro.dbt_utils.default__get_relations_by_prefix": {"name": "default__get_relations_by_prefix", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_prefix.sql", "original_file_path": "macros/sql/get_relations_by_prefix.sql", "unique_id": "macro.dbt_utils.default__get_relations_by_prefix", "macro_sql": "{% macro default__get_relations_by_prefix(schema, prefix, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n {{ dbt_utils.get_tables_by_prefix_sql(schema, prefix, exclude, database) }}\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=database,\n schema=row.table_schema,\n identifier=row.table_name,\n type=row.table_type\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_utils.get_tables_by_prefix_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.793247, "supported_languages": null}, "macro.dbt_utils.get_tables_by_prefix_sql": {"name": "get_tables_by_prefix_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_prefix_sql.sql", "original_file_path": "macros/sql/get_tables_by_prefix_sql.sql", "unique_id": "macro.dbt_utils.get_tables_by_prefix_sql", "macro_sql": "{% macro get_tables_by_prefix_sql(schema, prefix, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_tables_by_prefix_sql', 'dbt_utils')(schema, prefix, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_tables_by_prefix_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.7936928, "supported_languages": null}, "macro.dbt_utils.default__get_tables_by_prefix_sql": {"name": "default__get_tables_by_prefix_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_prefix_sql.sql", "original_file_path": "macros/sql/get_tables_by_prefix_sql.sql", "unique_id": "macro.dbt_utils.default__get_tables_by_prefix_sql", "macro_sql": "{% macro default__get_tables_by_prefix_sql(schema, prefix, exclude='', database=target.database) %}\n\n {{ dbt_utils.get_tables_by_pattern_sql(\n schema_pattern = schema,\n table_pattern = prefix ~ '%',\n exclude = exclude,\n database = database\n ) }}\n \n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.794005, "supported_languages": null}, "macro.dbt_utils.star": {"name": "star", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/star.sql", "original_file_path": "macros/sql/star.sql", "unique_id": "macro.dbt_utils.star", "macro_sql": "{% macro star(from, relation_alias=False, except=[], prefix='', suffix='', quote_identifiers=True) -%}\r\n {{ return(adapter.dispatch('star', 'dbt_utils')(from, relation_alias, except, prefix, suffix, quote_identifiers)) }}\r\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__star"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.795428, "supported_languages": null}, "macro.dbt_utils.default__star": {"name": "default__star", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/star.sql", "original_file_path": "macros/sql/star.sql", "unique_id": "macro.dbt_utils.default__star", "macro_sql": "{% macro default__star(from, relation_alias=False, except=[], prefix='', suffix='', quote_identifiers=True) -%}\r\n {%- do dbt_utils._is_relation(from, 'star') -%}\r\n {%- do dbt_utils._is_ephemeral(from, 'star') -%}\r\n\r\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\r\n {%- if not execute -%}\r\n {% do return('*') %}\r\n {%- endif -%}\r\n\r\n {% set cols = dbt_utils.get_filtered_columns_in_relation(from, except) %}\r\n\r\n {%- if cols|length <= 0 -%}\r\n {% if flags.WHICH == 'compile' %}\r\n {% set response %}\r\n*\r\n/* No columns were returned. Maybe the relation doesn't exist yet \r\nor all columns were excluded. This star is only output during \r\ndbt compile, and exists to keep SQLFluff happy. */\r\n {% endset %}\r\n {% do return(response) %}\r\n {% else %}\r\n {% do return(\"/* no columns returned from star() macro */\") %}\r\n {% endif %}\r\n {%- else -%}\r\n {%- for col in cols %}\r\n {%- if relation_alias %}{{ relation_alias }}.{% else %}{%- endif -%}\r\n {%- if quote_identifiers -%}\r\n {{ adapter.quote(col)|trim }} {%- if prefix!='' or suffix!='' %} as {{ adapter.quote(prefix ~ col ~ suffix)|trim }} {%- endif -%}\r\n {%- else -%}\r\n {{ col|trim }} {%- if prefix!='' or suffix!='' %} as {{ (prefix ~ col ~ suffix)|trim }} {%- endif -%}\r\n {% endif %}\r\n {%- if not loop.last %},{{ '\\n ' }}{%- endif -%}\r\n {%- endfor -%}\r\n {% endif %}\r\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt_utils.get_filtered_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.797028, "supported_languages": null}, "macro.dbt_utils.unpivot": {"name": "unpivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/unpivot.sql", "original_file_path": "macros/sql/unpivot.sql", "unique_id": "macro.dbt_utils.unpivot", "macro_sql": "{% macro unpivot(relation=none, cast_to='varchar', exclude=none, remove=none, field_name='field_name', value_name='value') -%}\n {{ return(adapter.dispatch('unpivot', 'dbt_utils')(relation, cast_to, exclude, remove, field_name, value_name)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__unpivot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.798744, "supported_languages": null}, "macro.dbt_utils.default__unpivot": {"name": "default__unpivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/unpivot.sql", "original_file_path": "macros/sql/unpivot.sql", "unique_id": "macro.dbt_utils.default__unpivot", "macro_sql": "{% macro default__unpivot(relation=none, cast_to='varchar', exclude=none, remove=none, field_name='field_name', value_name='value') -%}\n\n {% if not relation %}\n {{ exceptions.raise_compiler_error(\"Error: argument `relation` is required for `unpivot` macro.\") }}\n {% endif %}\n\n {%- set exclude = exclude if exclude is not none else [] %}\n {%- set remove = remove if remove is not none else [] %}\n\n {%- set include_cols = [] %}\n\n {%- set table_columns = {} %}\n\n {%- do table_columns.update({relation: []}) %}\n\n {%- do dbt_utils._is_relation(relation, 'unpivot') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'unpivot') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) %}\n\n {%- for col in cols -%}\n {%- if col.column.lower() not in remove|map('lower') and col.column.lower() not in exclude|map('lower') -%}\n {% do include_cols.append(col) %}\n {%- endif %}\n {%- endfor %}\n\n\n {%- for col in include_cols -%}\n select\n {%- for exclude_col in exclude %}\n {{ exclude_col }},\n {%- endfor %}\n\n cast('{{ col.column }}' as {{ dbt.type_string() }}) as {{ field_name }},\n cast( {% if col.data_type == 'boolean' %}\n {{ dbt.cast_bool_to_text(col.column) }}\n {% else %}\n {{ col.column }}\n {% endif %}\n as {{ cast_to }}) as {{ value_name }}\n\n from {{ relation }}\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n {%- endfor -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.type_string", "macro.dbt.cast_bool_to_text"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.800597, "supported_languages": null}, "macro.dbt_utils.safe_divide": {"name": "safe_divide", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_divide.sql", "original_file_path": "macros/sql/safe_divide.sql", "unique_id": "macro.dbt_utils.safe_divide", "macro_sql": "{% macro safe_divide(numerator, denominator) -%}\n {{ return(adapter.dispatch('safe_divide', 'dbt_utils')(numerator, denominator)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_divide"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8009331, "supported_languages": null}, "macro.dbt_utils.default__safe_divide": {"name": "default__safe_divide", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_divide.sql", "original_file_path": "macros/sql/safe_divide.sql", "unique_id": "macro.dbt_utils.default__safe_divide", "macro_sql": "{% macro default__safe_divide(numerator, denominator) %}\n ( {{ numerator }} ) / nullif( ( {{ denominator }} ), 0)\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8010828, "supported_languages": null}, "macro.dbt_utils.union_relations": {"name": "union_relations", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/union.sql", "original_file_path": "macros/sql/union.sql", "unique_id": "macro.dbt_utils.union_relations", "macro_sql": "{%- macro union_relations(relations, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_relation', where=none) -%}\n {{ return(adapter.dispatch('union_relations', 'dbt_utils')(relations, column_override, include, exclude, source_column_name, where)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__union_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8048089, "supported_languages": null}, "macro.dbt_utils.default__union_relations": {"name": "default__union_relations", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/union.sql", "original_file_path": "macros/sql/union.sql", "unique_id": "macro.dbt_utils.default__union_relations", "macro_sql": "\n\n{%- macro default__union_relations(relations, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_relation', where=none) -%}\n\n {%- if exclude and include -%}\n {{ exceptions.raise_compiler_error(\"Both an exclude and include list were provided to the `union` macro. Only one is allowed\") }}\n {%- endif -%}\n\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. -#}\n {%- if not execute %}\n {{ return('') }}\n {% endif -%}\n\n {%- set column_override = column_override if column_override is not none else {} -%}\n\n {%- set relation_columns = {} -%}\n {%- set column_superset = {} -%}\n {%- set all_excludes = [] -%}\n {%- set all_includes = [] -%}\n\n {%- if exclude -%}\n {%- for exc in exclude -%}\n {%- do all_excludes.append(exc | lower) -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- if include -%}\n {%- for inc in include -%}\n {%- do all_includes.append(inc | lower) -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- for relation in relations -%}\n\n {%- do relation_columns.update({relation: []}) -%}\n\n {%- do dbt_utils._is_relation(relation, 'union_relations') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'union_relations') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) -%}\n {%- for col in cols -%}\n\n {#- If an exclude list was provided and the column is in the list, do nothing -#}\n {%- if exclude and col.column | lower in all_excludes -%}\n\n {#- If an include list was provided and the column is not in the list, do nothing -#}\n {%- elif include and col.column | lower not in all_includes -%}\n\n {#- Otherwise add the column to the column superset -#}\n {%- else -%}\n\n {#- update the list of columns in this relation -#}\n {%- do relation_columns[relation].append(col.column) -%}\n\n {%- if col.column in column_superset -%}\n\n {%- set stored = column_superset[col.column] -%}\n {%- if col.is_string() and stored.is_string() and col.string_size() > stored.string_size() -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif %}\n\n {%- else -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif -%}\n\n {%- endif -%}\n\n {%- endfor -%}\n {%- endfor -%}\n\n {%- set ordered_column_names = column_superset.keys() -%}\n {%- set dbt_command = flags.WHICH -%}\n\n\n {% if dbt_command in ['run', 'build'] %}\n {% if (include | length > 0 or exclude | length > 0) and not column_superset.keys() %}\n {%- set relations_string -%}\n {%- for relation in relations -%}\n {{ relation.name }}\n {%- if not loop.last %}, {% endif -%}\n {%- endfor -%}\n {%- endset -%}\n\n {%- set error_message -%}\n There were no columns found to union for relations {{ relations_string }}\n {%- endset -%}\n\n {{ exceptions.raise_compiler_error(error_message) }}\n {%- endif -%}\n {%- endif -%}\n\n {%- for relation in relations %}\n\n (\n select\n\n {%- if source_column_name is not none %}\n cast({{ dbt.string_literal(relation) }} as {{ dbt.type_string() }}) as {{ source_column_name }},\n {%- endif %}\n\n {% for col_name in ordered_column_names -%}\n\n {%- set col = column_superset[col_name] %}\n {%- set col_type = column_override.get(col.column, col.data_type) %}\n {%- set col_name = adapter.quote(col_name) if col_name in relation_columns[relation] else 'null' %}\n cast({{ col_name }} as {{ col_type }}) as {{ col.quoted }} {% if not loop.last %},{% endif -%}\n\n {%- endfor %}\n\n from {{ relation }}\n\n {% if where -%}\n where {{ where }}\n {%- endif %}\n )\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n\n {%- endfor -%}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.string_literal", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.808854, "supported_languages": null}, "macro.dbt_utils.group_by": {"name": "group_by", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/groupby.sql", "original_file_path": "macros/sql/groupby.sql", "unique_id": "macro.dbt_utils.group_by", "macro_sql": "{%- macro group_by(n) -%}\n {{ return(adapter.dispatch('group_by', 'dbt_utils')(n)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__group_by"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8092291, "supported_languages": null}, "macro.dbt_utils.default__group_by": {"name": "default__group_by", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/groupby.sql", "original_file_path": "macros/sql/groupby.sql", "unique_id": "macro.dbt_utils.default__group_by", "macro_sql": "\n\n{%- macro default__group_by(n) -%}\n\n group by {% for i in range(1, n + 1) -%}\n {{ i }}{{ ',' if not loop.last }} \n {%- endfor -%}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8095071, "supported_languages": null}, "macro.dbt_utils.deduplicate": {"name": "deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.deduplicate", "macro_sql": "{%- macro deduplicate(relation, partition_by, order_by) -%}\n {{ return(adapter.dispatch('deduplicate', 'dbt_utils')(relation, partition_by, order_by)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.postgres__deduplicate"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.810302, "supported_languages": null}, "macro.dbt_utils.default__deduplicate": {"name": "default__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.default__deduplicate", "macro_sql": "\n\n{%- macro default__deduplicate(relation, partition_by, order_by) -%}\n\n with row_numbered as (\n select\n _inner.*,\n row_number() over (\n partition by {{ partition_by }}\n order by {{ order_by }}\n ) as rn\n from {{ relation }} as _inner\n )\n\n select\n distinct data.*\n from {{ relation }} as data\n {#\n -- Not all DBs will support natural joins but the ones that do include:\n -- Oracle, MySQL, SQLite, Redshift, Teradata, Materialize, Databricks\n -- Apache Spark, SingleStore, Vertica\n -- Those that do not appear to support natural joins include:\n -- SQLServer, Trino, Presto, Rockset, Athena\n #}\n natural join row_numbered\n where row_numbered.rn = 1\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.810527, "supported_languages": null}, "macro.dbt_utils.redshift__deduplicate": {"name": "redshift__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.redshift__deduplicate", "macro_sql": "{% macro redshift__deduplicate(relation, partition_by, order_by) -%}\n\n {{ return(dbt_utils.default__deduplicate(relation, partition_by, order_by=order_by)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__deduplicate"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8107488, "supported_languages": null}, "macro.dbt_utils.postgres__deduplicate": {"name": "postgres__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.postgres__deduplicate", "macro_sql": "\n{%- macro postgres__deduplicate(relation, partition_by, order_by) -%}\n\n select\n distinct on ({{ partition_by }}) *\n from {{ relation }}\n order by {{ partition_by }}{{ ',' ~ order_by }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8109598, "supported_languages": null}, "macro.dbt_utils.snowflake__deduplicate": {"name": "snowflake__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.snowflake__deduplicate", "macro_sql": "\n{%- macro snowflake__deduplicate(relation, partition_by, order_by) -%}\n\n select *\n from {{ relation }}\n qualify\n row_number() over (\n partition by {{ partition_by }}\n order by {{ order_by }}\n ) = 1\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.811136, "supported_languages": null}, "macro.dbt_utils.bigquery__deduplicate": {"name": "bigquery__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.bigquery__deduplicate", "macro_sql": "\n{%- macro bigquery__deduplicate(relation, partition_by, order_by) -%}\n\n select unique.*\n from (\n select\n array_agg (\n original\n order by {{ order_by }}\n limit 1\n )[offset(0)] unique\n from {{ relation }} original\n group by {{ partition_by }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.811317, "supported_languages": null}, "macro.dbt_utils.surrogate_key": {"name": "surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/surrogate_key.sql", "original_file_path": "macros/sql/surrogate_key.sql", "unique_id": "macro.dbt_utils.surrogate_key", "macro_sql": "{%- macro surrogate_key(field_list) -%}\n {% set frustrating_jinja_feature = varargs %}\n {{ return(adapter.dispatch('surrogate_key', 'dbt_utils')(field_list, *varargs)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__surrogate_key"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.811717, "supported_languages": null}, "macro.dbt_utils.default__surrogate_key": {"name": "default__surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/surrogate_key.sql", "original_file_path": "macros/sql/surrogate_key.sql", "unique_id": "macro.dbt_utils.default__surrogate_key", "macro_sql": "\n\n{%- macro default__surrogate_key(field_list) -%}\n\n{%- set error_message = '\nWarning: `dbt_utils.surrogate_key` has been replaced by \\\n`dbt_utils.generate_surrogate_key`. The new macro treats null values \\\ndifferently to empty strings. To restore the behaviour of the original \\\nmacro, add a global variable in dbt_project.yml called \\\n`surrogate_key_treat_nulls_as_empty_strings` to your \\\ndbt_project.yml file with a value of True. \\\nThe {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.raise_compiler_error(error_message) -%}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8119612, "supported_languages": null}, "macro.dbt_utils.safe_add": {"name": "safe_add", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_add.sql", "original_file_path": "macros/sql/safe_add.sql", "unique_id": "macro.dbt_utils.safe_add", "macro_sql": "{%- macro safe_add(field_list) -%}\n {{ return(adapter.dispatch('safe_add', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_add"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.812358, "supported_languages": null}, "macro.dbt_utils.default__safe_add": {"name": "default__safe_add", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_add.sql", "original_file_path": "macros/sql/safe_add.sql", "unique_id": "macro.dbt_utils.default__safe_add", "macro_sql": "\n\n{%- macro default__safe_add(field_list) -%}\n\n{%- if field_list is not iterable or field_list is string or field_list is mapping -%}\n\n{%- set error_message = '\nWarning: the `safe_add` macro now takes a single list argument instead of \\\nstring arguments. The {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.warn(error_message) -%}\n\n{%- endif -%}\n\n{% set fields = [] %}\n\n{%- for field in field_list -%}\n\n {% do fields.append(\"coalesce(\" ~ field ~ \", 0)\") %}\n\n{%- endfor -%}\n\n{{ fields|join(' +\\n ') }}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.812924, "supported_languages": null}, "macro.dbt_utils.nullcheck": {"name": "nullcheck", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck.sql", "original_file_path": "macros/sql/nullcheck.sql", "unique_id": "macro.dbt_utils.nullcheck", "macro_sql": "{% macro nullcheck(cols) %}\n {{ return(adapter.dispatch('nullcheck', 'dbt_utils')(cols)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__nullcheck"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8132858, "supported_languages": null}, "macro.dbt_utils.default__nullcheck": {"name": "default__nullcheck", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck.sql", "original_file_path": "macros/sql/nullcheck.sql", "unique_id": "macro.dbt_utils.default__nullcheck", "macro_sql": "{% macro default__nullcheck(cols) %}\n{%- for col in cols %}\n\n {% if col.is_string() -%}\n\n nullif({{col.name}},'') as {{col.name}}\n\n {%- else -%}\n\n {{col.name}}\n\n {%- endif -%}\n\n{%- if not loop.last -%} , {%- endif -%}\n\n{%- endfor -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.813636, "supported_languages": null}, "macro.dbt_utils.get_tables_by_pattern_sql": {"name": "get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.get_tables_by_pattern_sql", "macro_sql": "{% macro get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_tables_by_pattern_sql', 'dbt_utils')\n (schema_pattern, table_pattern, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.815592, "supported_languages": null}, "macro.dbt_utils.default__get_tables_by_pattern_sql": {"name": "default__get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.default__get_tables_by_pattern_sql", "macro_sql": "{% macro default__get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n select distinct\n table_schema as {{ adapter.quote('table_schema') }},\n table_name as {{ adapter.quote('table_name') }},\n {{ dbt_utils.get_table_types_sql() }}\n from {{ database }}.information_schema.tables\n where table_schema ilike '{{ schema_pattern }}'\n and table_name ilike '{{ table_pattern }}'\n and table_name not ilike '{{ exclude }}'\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.815994, "supported_languages": null}, "macro.dbt_utils.bigquery__get_tables_by_pattern_sql": {"name": "bigquery__get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.bigquery__get_tables_by_pattern_sql", "macro_sql": "{% macro bigquery__get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {% if '%' in schema_pattern %}\n {% set schemata=dbt_utils._bigquery__get_matching_schemata(schema_pattern, database) %}\n {% else %}\n {% set schemata=[schema_pattern] %}\n {% endif %}\n\n {% set sql %}\n {% for schema in schemata %}\n select distinct\n table_schema,\n table_name,\n {{ dbt_utils.get_table_types_sql() }}\n\n from {{ adapter.quote(database) }}.{{ schema }}.INFORMATION_SCHEMA.TABLES\n where lower(table_name) like lower ('{{ table_pattern }}')\n and lower(table_name) not like lower ('{{ exclude }}')\n\n {% if not loop.last %} union all {% endif %}\n\n {% endfor %}\n {% endset %}\n\n {{ return(sql) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._bigquery__get_matching_schemata", "macro.dbt_utils.get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.816861, "supported_languages": null}, "macro.dbt_utils._bigquery__get_matching_schemata": {"name": "_bigquery__get_matching_schemata", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils._bigquery__get_matching_schemata", "macro_sql": "{% macro _bigquery__get_matching_schemata(schema_pattern, database) %}\n {% if execute %}\n\n {% set sql %}\n select schema_name from {{ adapter.quote(database) }}.INFORMATION_SCHEMA.SCHEMATA\n where lower(schema_name) like lower('{{ schema_pattern }}')\n {% endset %}\n\n {% set results=run_query(sql) %}\n\n {% set schemata=results.columns['schema_name'].values() %}\n\n {{ return(schemata) }}\n\n {% else %}\n\n {{ return([]) }}\n\n {% endif %}\n\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8175628, "supported_languages": null}, "macro.dbt_utils.get_column_values": {"name": "get_column_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_column_values.sql", "original_file_path": "macros/sql/get_column_values.sql", "unique_id": "macro.dbt_utils.get_column_values", "macro_sql": "{% macro get_column_values(table, column, order_by='count(*) desc', max_records=none, default=none, where=none) -%}\n {{ return(adapter.dispatch('get_column_values', 'dbt_utils')(table, column, order_by, max_records, default, where)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_column_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.818859, "supported_languages": null}, "macro.dbt_utils.default__get_column_values": {"name": "default__get_column_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_column_values.sql", "original_file_path": "macros/sql/get_column_values.sql", "unique_id": "macro.dbt_utils.default__get_column_values", "macro_sql": "{% macro default__get_column_values(table, column, order_by='count(*) desc', max_records=none, default=none, where=none) -%}\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n {%- if not execute -%}\n {% set default = [] if not default %}\n {{ return(default) }}\n {% endif %}\n\n {%- do dbt_utils._is_ephemeral(table, 'get_column_values') -%}\n\n {# Not all relations are tables. Renaming for internal clarity without breaking functionality for anyone using named arguments #}\n {# TODO: Change the method signature in a future 0.x.0 release #}\n {%- set target_relation = table -%}\n\n {# adapter.load_relation is a convenience wrapper to avoid building a Relation when we already have one #}\n {% set relation_exists = (load_relation(target_relation)) is not none %}\n\n {%- call statement('get_column_values', fetch_result=true) %}\n\n {%- if not relation_exists and default is none -%}\n\n {{ exceptions.raise_compiler_error(\"In get_column_values(): relation \" ~ target_relation ~ \" does not exist and no default value was provided.\") }}\n\n {%- elif not relation_exists and default is not none -%}\n\n {{ log(\"Relation \" ~ target_relation ~ \" does not exist. Returning the default value: \" ~ default) }}\n\n {{ return(default) }}\n\n {%- else -%}\n\n\n select\n {{ column }} as value\n\n from {{ target_relation }}\n\n {% if where is not none %}\n where {{ where }}\n {% endif %}\n\n group by {{ column }}\n order by {{ order_by }}\n\n {% if max_records is not none %}\n limit {{ max_records }}\n {% endif %}\n\n {% endif %}\n\n {%- endcall -%}\n\n {%- set value_list = load_result('get_column_values') -%}\n\n {%- if value_list and value_list['data'] -%}\n {%- set values = value_list['data'] | map(attribute=0) | list %}\n {{ return(values) }}\n {%- else -%}\n {{ return(default) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_ephemeral", "macro.dbt.load_relation", "macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8205261, "supported_languages": null}, "macro.dbt_utils.pivot": {"name": "pivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/pivot.sql", "original_file_path": "macros/sql/pivot.sql", "unique_id": "macro.dbt_utils.pivot", "macro_sql": "{% macro pivot(column,\n values,\n alias=True,\n agg='sum',\n cmp='=',\n prefix='',\n suffix='',\n then_value=1,\n else_value=0,\n quote_identifiers=True,\n distinct=False) %}\n {{ return(adapter.dispatch('pivot', 'dbt_utils')(column, values, alias, agg, cmp, prefix, suffix, then_value, else_value, quote_identifiers, distinct)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pivot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.821878, "supported_languages": null}, "macro.dbt_utils.default__pivot": {"name": "default__pivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/pivot.sql", "original_file_path": "macros/sql/pivot.sql", "unique_id": "macro.dbt_utils.default__pivot", "macro_sql": "{% macro default__pivot(column,\n values,\n alias=True,\n agg='sum',\n cmp='=',\n prefix='',\n suffix='',\n then_value=1,\n else_value=0,\n quote_identifiers=True,\n distinct=False) %}\n {% for value in values %}\n {{ agg }}(\n {% if distinct %} distinct {% endif %}\n case\n when {{ column }} {{ cmp }} '{{ dbt.escape_single_quotes(value) }}'\n then {{ then_value }}\n else {{ else_value }}\n end\n )\n {% if alias %}\n {% if quote_identifiers %}\n as {{ adapter.quote(prefix ~ value ~ suffix) }}\n {% else %}\n as {{ dbt_utils.slugify(prefix ~ value ~ suffix) }}\n {% endif %}\n {% endif %}\n {% if not loop.last %},{% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.escape_single_quotes", "macro.dbt_utils.slugify"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.822863, "supported_languages": null}, "macro.dbt_utils.get_filtered_columns_in_relation": {"name": "get_filtered_columns_in_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_filtered_columns_in_relation.sql", "original_file_path": "macros/sql/get_filtered_columns_in_relation.sql", "unique_id": "macro.dbt_utils.get_filtered_columns_in_relation", "macro_sql": "{% macro get_filtered_columns_in_relation(from, except=[]) -%}\n {{ return(adapter.dispatch('get_filtered_columns_in_relation', 'dbt_utils')(from, except)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_filtered_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.823412, "supported_languages": null}, "macro.dbt_utils.default__get_filtered_columns_in_relation": {"name": "default__get_filtered_columns_in_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_filtered_columns_in_relation.sql", "original_file_path": "macros/sql/get_filtered_columns_in_relation.sql", "unique_id": "macro.dbt_utils.default__get_filtered_columns_in_relation", "macro_sql": "{% macro default__get_filtered_columns_in_relation(from, except=[]) -%}\n {%- do dbt_utils._is_relation(from, 'get_filtered_columns_in_relation') -%}\n {%- do dbt_utils._is_ephemeral(from, 'get_filtered_columns_in_relation') -%}\n\n {# -- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n {%- if not execute -%}\n {{ return('') }}\n {% endif %}\n\n {%- set include_cols = [] %}\n {%- set cols = adapter.get_columns_in_relation(from) -%}\n {%- set except = except | map(\"lower\") | list %}\n {%- for col in cols -%}\n {%- if col.column|lower not in except -%}\n {% do include_cols.append(col.column) %}\n {%- endif %}\n {%- endfor %}\n\n {{ return(include_cols) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.824211, "supported_languages": null}, "macro.dbt_utils.width_bucket": {"name": "width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.width_bucket", "macro_sql": "{% macro width_bucket(expr, min_value, max_value, num_buckets) %}\n {{ return(adapter.dispatch('width_bucket', 'dbt_utils') (expr, min_value, max_value, num_buckets)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__width_bucket"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.825068, "supported_languages": null}, "macro.dbt_utils.default__width_bucket": {"name": "default__width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.default__width_bucket", "macro_sql": "{% macro default__width_bucket(expr, min_value, max_value, num_buckets) -%}\n\n {% set bin_size -%}\n (( {{ max_value }} - {{ min_value }} ) / {{ num_buckets }} )\n {%- endset %}\n (\n -- to break ties when the amount is eaxtly at the bucket egde\n case\n when\n mod(\n {{ dbt.safe_cast(expr, dbt.type_numeric() ) }},\n {{ dbt.safe_cast(bin_size, dbt.type_numeric() ) }}\n ) = 0\n then 1\n else 0\n end\n ) +\n -- Anything over max_value goes the N+1 bucket\n least(\n ceil(\n ({{ expr }} - {{ min_value }})/{{ bin_size }}\n ),\n {{ num_buckets }} + 1\n )\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.safe_cast", "macro.dbt.type_numeric"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8255749, "supported_languages": null}, "macro.dbt_utils.snowflake__width_bucket": {"name": "snowflake__width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.snowflake__width_bucket", "macro_sql": "{% macro snowflake__width_bucket(expr, min_value, max_value, num_buckets) %}\n width_bucket({{ expr }}, {{ min_value }}, {{ max_value }}, {{ num_buckets }} )\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8257852, "supported_languages": null}, "macro.dbt_utils.get_query_results_as_dict": {"name": "get_query_results_as_dict", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_query_results_as_dict.sql", "original_file_path": "macros/sql/get_query_results_as_dict.sql", "unique_id": "macro.dbt_utils.get_query_results_as_dict", "macro_sql": "{% macro get_query_results_as_dict(query) %}\n {{ return(adapter.dispatch('get_query_results_as_dict', 'dbt_utils')(query)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_query_results_as_dict"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8262122, "supported_languages": null}, "macro.dbt_utils.default__get_query_results_as_dict": {"name": "default__get_query_results_as_dict", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_query_results_as_dict.sql", "original_file_path": "macros/sql/get_query_results_as_dict.sql", "unique_id": "macro.dbt_utils.default__get_query_results_as_dict", "macro_sql": "{% macro default__get_query_results_as_dict(query) %}\n\n{# This macro returns a dictionary of the form {column_name: (tuple_of_results)} #}\n\n {%- call statement('get_query_results', fetch_result=True,auto_begin=false) -%}\n\n {{ query }}\n\n {%- endcall -%}\n\n {% set sql_results={} %}\n\n {%- if execute -%}\n {% set sql_results_table = load_result('get_query_results').table.columns %}\n {% for column_name, column in sql_results_table.items() %}\n {% do sql_results.update({column_name: column.values()}) %}\n {% endfor %}\n {%- endif -%}\n\n {{ return(sql_results) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.826856, "supported_languages": null}, "macro.dbt_utils.generate_surrogate_key": {"name": "generate_surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_surrogate_key.sql", "original_file_path": "macros/sql/generate_surrogate_key.sql", "unique_id": "macro.dbt_utils.generate_surrogate_key", "macro_sql": "{%- macro generate_surrogate_key(field_list) -%}\n {{ return(adapter.dispatch('generate_surrogate_key', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__generate_surrogate_key"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.827363, "supported_languages": null}, "macro.dbt_utils.default__generate_surrogate_key": {"name": "default__generate_surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_surrogate_key.sql", "original_file_path": "macros/sql/generate_surrogate_key.sql", "unique_id": "macro.dbt_utils.default__generate_surrogate_key", "macro_sql": "\n\n{%- macro default__generate_surrogate_key(field_list) -%}\n\n{%- if var('surrogate_key_treat_nulls_as_empty_strings', False) -%}\n {%- set default_null_value = \"\" -%}\n{%- else -%}\n {%- set default_null_value = '_dbt_utils_surrogate_key_null_' -%}\n{%- endif -%}\n\n{%- set fields = [] -%}\n\n{%- for field in field_list -%}\n\n {%- do fields.append(\n \"coalesce(cast(\" ~ field ~ \" as \" ~ dbt.type_string() ~ \"), '\" ~ default_null_value ~\"')\"\n ) -%}\n\n {%- if not loop.last %}\n {%- do fields.append(\"'-'\") -%}\n {%- endif -%}\n\n{%- endfor -%}\n\n{{ dbt.hash(dbt.concat(fields)) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.type_string", "macro.dbt.hash", "macro.dbt.concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.828043, "supported_languages": null}, "macro.dbt_utils.get_table_types_sql": {"name": "get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.get_table_types_sql", "macro_sql": "{%- macro get_table_types_sql() -%}\n {{ return(adapter.dispatch('get_table_types_sql', 'dbt_utils')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_utils.postgres__get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.828623, "supported_languages": null}, "macro.dbt_utils.default__get_table_types_sql": {"name": "default__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.default__get_table_types_sql", "macro_sql": "{% macro default__get_table_types_sql() %}\n case table_type\n when 'BASE TABLE' then 'table'\n when 'EXTERNAL TABLE' then 'external'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.828777, "supported_languages": null}, "macro.dbt_utils.postgres__get_table_types_sql": {"name": "postgres__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.postgres__get_table_types_sql", "macro_sql": "{% macro postgres__get_table_types_sql() %}\n case table_type\n when 'BASE TABLE' then 'table'\n when 'FOREIGN' then 'external'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.828929, "supported_languages": null}, "macro.dbt_utils.databricks__get_table_types_sql": {"name": "databricks__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.databricks__get_table_types_sql", "macro_sql": "{% macro databricks__get_table_types_sql() %}\n case table_type\n when 'MANAGED' then 'table'\n when 'BASE TABLE' then 'table'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.82908, "supported_languages": null}, "macro.dbt_utils.get_single_value": {"name": "get_single_value", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_single_value.sql", "original_file_path": "macros/sql/get_single_value.sql", "unique_id": "macro.dbt_utils.get_single_value", "macro_sql": "{% macro get_single_value(query, default=none) %}\n {{ return(adapter.dispatch('get_single_value', 'dbt_utils')(query, default)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_single_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.82965, "supported_languages": null}, "macro.dbt_utils.default__get_single_value": {"name": "default__get_single_value", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_single_value.sql", "original_file_path": "macros/sql/get_single_value.sql", "unique_id": "macro.dbt_utils.default__get_single_value", "macro_sql": "{% macro default__get_single_value(query, default) %}\n\n{# This macro returns the (0, 0) record in a query, i.e. the first row of the first column #}\n\n {%- call statement('get_query_result', fetch_result=True, auto_begin=false) -%}\n\n {{ query }}\n\n {%- endcall -%}\n\n {%- if execute -%}\n\n {% set r = load_result('get_query_result').table.columns[0].values() %}\n {% if r | length == 0 %}\n {% do print('Query `' ~ query ~ '` returned no rows. Using the default value: ' ~ default) %}\n {% set sql_result = default %}\n {% else %}\n {% set sql_result = r[0] %}\n {% endif %}\n \n {%- else -%}\n \n {% set sql_result = default %}\n \n {%- endif -%}\n\n {% do return(sql_result) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8305972, "supported_languages": null}, "macro.dbt_utils.degrees_to_radians": {"name": "degrees_to_radians", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.degrees_to_radians", "macro_sql": "{% macro degrees_to_radians(degrees) -%}\n acos(-1) * {{degrees}} / 180\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.831897, "supported_languages": null}, "macro.dbt_utils.haversine_distance": {"name": "haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.haversine_distance", "macro_sql": "{% macro haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n {{ return(adapter.dispatch('haversine_distance', 'dbt_utils')(lat1,lon1,lat2,lon2,unit)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__haversine_distance"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.832227, "supported_languages": null}, "macro.dbt_utils.default__haversine_distance": {"name": "default__haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.default__haversine_distance", "macro_sql": "{% macro default__haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n{%- if unit == 'mi' %}\n {% set conversion_rate = 1 %}\n{% elif unit == 'km' %}\n {% set conversion_rate = 1.60934 %}\n{% else %}\n {{ exceptions.raise_compiler_error(\"unit input must be one of 'mi' or 'km'. Got \" ~ unit) }}\n{% endif %}\n\n 2 * 3961 * asin(sqrt(power((sin(radians(({{ lat2 }} - {{ lat1 }}) / 2))), 2) +\n cos(radians({{lat1}})) * cos(radians({{lat2}})) *\n power((sin(radians(({{ lon2 }} - {{ lon1 }}) / 2))), 2))) * {{ conversion_rate }}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.832829, "supported_languages": null}, "macro.dbt_utils.bigquery__haversine_distance": {"name": "bigquery__haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.bigquery__haversine_distance", "macro_sql": "{% macro bigquery__haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n{% set radians_lat1 = dbt_utils.degrees_to_radians(lat1) %}\n{% set radians_lat2 = dbt_utils.degrees_to_radians(lat2) %}\n{% set radians_lon1 = dbt_utils.degrees_to_radians(lon1) %}\n{% set radians_lon2 = dbt_utils.degrees_to_radians(lon2) %}\n{%- if unit == 'mi' %}\n {% set conversion_rate = 1 %}\n{% elif unit == 'km' %}\n {% set conversion_rate = 1.60934 %}\n{% else %}\n {{ exceptions.raise_compiler_error(\"unit input must be one of 'mi' or 'km'. Got \" ~ unit) }}\n{% endif %}\n 2 * 3961 * asin(sqrt(power(sin(({{ radians_lat2 }} - {{ radians_lat1 }}) / 2), 2) +\n cos({{ radians_lat1 }}) * cos({{ radians_lat2 }}) *\n power(sin(({{ radians_lon2 }} - {{ radians_lon1 }}) / 2), 2))) * {{ conversion_rate }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.degrees_to_radians"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8336809, "supported_languages": null}, "macro.spark_utils.get_tables": {"name": "get_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_tables", "macro_sql": "{% macro get_tables(table_regex_pattern='.*') %}\n\n {% set tables = [] %}\n {% for database in spark__list_schemas('not_used') %}\n {% for table in spark__list_relations_without_caching(database[0]) %}\n {% set db_tablename = database[0] ~ \".\" ~ table[1] %}\n {% set is_match = modules.re.match(table_regex_pattern, db_tablename) %}\n {% if is_match %}\n {% call statement('table_detail', fetch_result=True) -%}\n describe extended {{ db_tablename }}\n {% endcall %}\n\n {% set table_type = load_result('table_detail').table|reverse|selectattr(0, 'in', ('type', 'TYPE', 'Type'))|first %}\n {% if table_type[1]|lower != 'view' %}\n {{ tables.append(db_tablename) }}\n {% endif %}\n {% endif %}\n {% endfor %}\n {% endfor %}\n {{ return(tables) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.839608, "supported_languages": null}, "macro.spark_utils.get_delta_tables": {"name": "get_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_delta_tables", "macro_sql": "{% macro get_delta_tables(table_regex_pattern='.*') %}\n\n {% set delta_tables = [] %}\n {% for db_tablename in get_tables(table_regex_pattern) %}\n {% call statement('table_detail', fetch_result=True) -%}\n describe extended {{ db_tablename }}\n {% endcall %}\n\n {% set table_type = load_result('table_detail').table|reverse|selectattr(0, 'in', ('provider', 'PROVIDER', 'Provider'))|first %}\n {% if table_type[1]|lower == 'delta' %}\n {{ delta_tables.append(db_tablename) }}\n {% endif %}\n {% endfor %}\n {{ return(delta_tables) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_tables", "macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.840399, "supported_languages": null}, "macro.spark_utils.get_statistic_columns": {"name": "get_statistic_columns", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_statistic_columns", "macro_sql": "{% macro get_statistic_columns(table) %}\n\n {% call statement('input_columns', fetch_result=True) %}\n SHOW COLUMNS IN {{ table }}\n {% endcall %}\n {% set input_columns = load_result('input_columns').table %}\n\n {% set output_columns = [] %}\n {% for column in input_columns %}\n {% call statement('column_information', fetch_result=True) %}\n DESCRIBE TABLE {{ table }} `{{ column[0] }}`\n {% endcall %}\n {% if not load_result('column_information').table[1][1].startswith('struct') and not load_result('column_information').table[1][1].startswith('array') %}\n {{ output_columns.append('`' ~ column[0] ~ '`') }}\n {% endif %}\n {% endfor %}\n {{ return(output_columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8413901, "supported_languages": null}, "macro.spark_utils.spark_optimize_delta_tables": {"name": "spark_optimize_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_optimize_delta_tables", "macro_sql": "{% macro spark_optimize_delta_tables(table_regex_pattern='.*') %}\n\n {% for table in get_delta_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Optimizing \" ~ table) }}\n {% do run_query(\"optimize \" ~ table) %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_delta_tables", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8422139, "supported_languages": null}, "macro.spark_utils.spark_vacuum_delta_tables": {"name": "spark_vacuum_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_vacuum_delta_tables", "macro_sql": "{% macro spark_vacuum_delta_tables(table_regex_pattern='.*') %}\n\n {% for table in get_delta_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Vacuuming \" ~ table) }}\n {% do run_query(\"vacuum \" ~ table) %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_delta_tables", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.84302, "supported_languages": null}, "macro.spark_utils.spark_analyze_tables": {"name": "spark_analyze_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_analyze_tables", "macro_sql": "{% macro spark_analyze_tables(table_regex_pattern='.*') %}\n\n {% for table in get_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set columns = get_statistic_columns(table) | join(',') %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Analyzing \" ~ table) }}\n {% if columns != '' %}\n {% do run_query(\"analyze table \" ~ table ~ \" compute statistics for columns \" ~ columns) %}\n {% endif %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_tables", "macro.spark_utils.get_statistic_columns", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.844065, "supported_languages": null}, "macro.spark_utils.spark__concat": {"name": "spark__concat", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/concat.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/concat.sql", "unique_id": "macro.spark_utils.spark__concat", "macro_sql": "{% macro spark__concat(fields) -%}\n concat({{ fields|join(', ') }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8442628, "supported_languages": null}, "macro.spark_utils.spark__type_numeric": {"name": "spark__type_numeric", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/datatypes.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/datatypes.sql", "unique_id": "macro.spark_utils.spark__type_numeric", "macro_sql": "{% macro spark__type_numeric() %}\n decimal(28, 6)\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.844383, "supported_languages": null}, "macro.spark_utils.spark__dateadd": {"name": "spark__dateadd", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/dateadd.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/dateadd.sql", "unique_id": "macro.spark_utils.spark__dateadd", "macro_sql": "{% macro spark__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n {%- set clock_component -%}\n {# make sure the dates + timestamps are real, otherwise raise an error asap #}\n to_unix_timestamp({{ spark_utils.assert_not_null('to_timestamp', from_date_or_timestamp) }})\n - to_unix_timestamp({{ spark_utils.assert_not_null('date', from_date_or_timestamp) }})\n {%- endset -%}\n\n {%- if datepart in ['day', 'week'] -%}\n \n {%- set multiplier = 7 if datepart == 'week' else 1 -%}\n\n to_timestamp(\n to_unix_timestamp(\n date_add(\n {{ spark_utils.assert_not_null('date', from_date_or_timestamp) }},\n cast({{interval}} * {{multiplier}} as int)\n )\n ) + {{clock_component}}\n )\n\n {%- elif datepart in ['month', 'quarter', 'year'] -%}\n \n {%- set multiplier -%} \n {%- if datepart == 'month' -%} 1\n {%- elif datepart == 'quarter' -%} 3\n {%- elif datepart == 'year' -%} 12\n {%- endif -%}\n {%- endset -%}\n\n to_timestamp(\n to_unix_timestamp(\n add_months(\n {{ spark_utils.assert_not_null('date', from_date_or_timestamp) }},\n cast({{interval}} * {{multiplier}} as int)\n )\n ) + {{clock_component}}\n )\n\n {%- elif datepart in ('hour', 'minute', 'second', 'millisecond', 'microsecond') -%}\n \n {%- set multiplier -%} \n {%- if datepart == 'hour' -%} 3600\n {%- elif datepart == 'minute' -%} 60\n {%- elif datepart == 'second' -%} 1\n {%- elif datepart == 'millisecond' -%} (1/1000000)\n {%- elif datepart == 'microsecond' -%} (1/1000000)\n {%- endif -%}\n {%- endset -%}\n\n to_timestamp(\n {{ spark_utils.assert_not_null('to_unix_timestamp', from_date_or_timestamp) }}\n + cast({{interval}} * {{multiplier}} as int)\n )\n\n {%- else -%}\n\n {{ exceptions.raise_compiler_error(\"macro dateadd not implemented for datepart ~ '\" ~ datepart ~ \"' ~ on Spark\") }}\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.847529, "supported_languages": null}, "macro.spark_utils.spark__datediff": {"name": "spark__datediff", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/datediff.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/datediff.sql", "unique_id": "macro.spark_utils.spark__datediff", "macro_sql": "{% macro spark__datediff(first_date, second_date, datepart) %}\n\n {%- if datepart in ['day', 'week', 'month', 'quarter', 'year'] -%}\n \n {# make sure the dates are real, otherwise raise an error asap #}\n {% set first_date = spark_utils.assert_not_null('date', first_date) %}\n {% set second_date = spark_utils.assert_not_null('date', second_date) %}\n \n {%- endif -%}\n \n {%- if datepart == 'day' -%}\n \n datediff({{second_date}}, {{first_date}})\n \n {%- elif datepart == 'week' -%}\n \n case when {{first_date}} < {{second_date}}\n then floor(datediff({{second_date}}, {{first_date}})/7)\n else ceil(datediff({{second_date}}, {{first_date}})/7)\n end\n \n -- did we cross a week boundary (Sunday)?\n + case\n when {{first_date}} < {{second_date}} and dayofweek({{second_date}}) < dayofweek({{first_date}}) then 1\n when {{first_date}} > {{second_date}} and dayofweek({{second_date}}) > dayofweek({{first_date}}) then -1\n else 0 end\n\n {%- elif datepart == 'month' -%}\n\n case when {{first_date}} < {{second_date}}\n then floor(months_between(date({{second_date}}), date({{first_date}})))\n else ceil(months_between(date({{second_date}}), date({{first_date}})))\n end\n \n -- did we cross a month boundary?\n + case\n when {{first_date}} < {{second_date}} and dayofmonth({{second_date}}) < dayofmonth({{first_date}}) then 1\n when {{first_date}} > {{second_date}} and dayofmonth({{second_date}}) > dayofmonth({{first_date}}) then -1\n else 0 end\n \n {%- elif datepart == 'quarter' -%}\n \n case when {{first_date}} < {{second_date}}\n then floor(months_between(date({{second_date}}), date({{first_date}}))/3)\n else ceil(months_between(date({{second_date}}), date({{first_date}}))/3)\n end\n \n -- did we cross a quarter boundary?\n + case\n when {{first_date}} < {{second_date}} and (\n (dayofyear({{second_date}}) - (quarter({{second_date}}) * 365/4))\n < (dayofyear({{first_date}}) - (quarter({{first_date}}) * 365/4))\n ) then 1\n when {{first_date}} > {{second_date}} and (\n (dayofyear({{second_date}}) - (quarter({{second_date}}) * 365/4))\n > (dayofyear({{first_date}}) - (quarter({{first_date}}) * 365/4))\n ) then -1\n else 0 end\n\n {%- elif datepart == 'year' -%}\n \n year({{second_date}}) - year({{first_date}})\n\n {%- elif datepart in ('hour', 'minute', 'second', 'millisecond', 'microsecond') -%}\n \n {%- set divisor -%} \n {%- if datepart == 'hour' -%} 3600\n {%- elif datepart == 'minute' -%} 60\n {%- elif datepart == 'second' -%} 1\n {%- elif datepart == 'millisecond' -%} (1/1000)\n {%- elif datepart == 'microsecond' -%} (1/1000000)\n {%- endif -%}\n {%- endset -%}\n\n case when {{first_date}} < {{second_date}}\n then ceil((\n {# make sure the timestamps are real, otherwise raise an error asap #}\n {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', second_date)) }}\n - {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', first_date)) }}\n ) / {{divisor}})\n else floor((\n {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', second_date)) }}\n - {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', first_date)) }}\n ) / {{divisor}})\n end\n \n {% if datepart == 'millisecond' %}\n + cast(date_format({{second_date}}, 'SSS') as int)\n - cast(date_format({{first_date}}, 'SSS') as int)\n {% endif %}\n \n {% if datepart == 'microsecond' %} \n {% set capture_str = '[0-9]{4}-[0-9]{2}-[0-9]{2}.[0-9]{2}:[0-9]{2}:[0-9]{2}.([0-9]{6})' %}\n -- Spark doesn't really support microseconds, so this is a massive hack!\n -- It will only work if the timestamp-string is of the format\n -- 'yyyy-MM-dd-HH mm.ss.SSSSSS'\n + cast(regexp_extract({{second_date}}, '{{capture_str}}', 1) as int)\n - cast(regexp_extract({{first_date}}, '{{capture_str}}', 1) as int) \n {% endif %}\n\n {%- else -%}\n\n {{ exceptions.raise_compiler_error(\"macro datediff not implemented for datepart ~ '\" ~ datepart ~ \"' ~ on Spark\") }}\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.856082, "supported_languages": null}, "macro.spark_utils.spark__current_timestamp": {"name": "spark__current_timestamp", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "unique_id": "macro.spark_utils.spark__current_timestamp", "macro_sql": "{% macro spark__current_timestamp() %}\n current_timestamp()\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.856317, "supported_languages": null}, "macro.spark_utils.spark__current_timestamp_in_utc": {"name": "spark__current_timestamp_in_utc", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "unique_id": "macro.spark_utils.spark__current_timestamp_in_utc", "macro_sql": "{% macro spark__current_timestamp_in_utc() %}\n unix_timestamp()\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.856409, "supported_languages": null}, "macro.spark_utils.spark__split_part": {"name": "spark__split_part", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/split_part.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/split_part.sql", "unique_id": "macro.spark_utils.spark__split_part", "macro_sql": "{% macro spark__split_part(string_text, delimiter_text, part_number) %}\n\n {% set delimiter_expr %}\n \n -- escape if starts with a special character\n case when regexp_extract({{ delimiter_text }}, '([^A-Za-z0-9])(.*)', 1) != '_'\n then concat('\\\\', {{ delimiter_text }})\n else {{ delimiter_text }} end\n \n {% endset %}\n\n {% set split_part_expr %}\n \n split(\n {{ string_text }},\n {{ delimiter_expr }}\n )[({{ part_number - 1 }})]\n \n {% endset %}\n \n {{ return(split_part_expr) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.857065, "supported_languages": null}, "macro.spark_utils.spark__get_relations_by_pattern": {"name": "spark__get_relations_by_pattern", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_relations_by_pattern", "macro_sql": "{% macro spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n show table extended in {{ schema_pattern }} like '{{ table_pattern }}'\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=None,\n schema=row[0],\n identifier=row[1],\n type=('view' if 'Type: VIEW' in row[3] else 'table')\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.858837, "supported_languages": null}, "macro.spark_utils.spark__get_relations_by_prefix": {"name": "spark__get_relations_by_prefix", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_relations_by_prefix", "macro_sql": "{% macro spark__get_relations_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {% set table_pattern = table_pattern ~ '*' %}\n {{ return(spark_utils.spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.859209, "supported_languages": null}, "macro.spark_utils.spark__get_tables_by_pattern": {"name": "spark__get_tables_by_pattern", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_tables_by_pattern", "macro_sql": "{% macro spark__get_tables_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(spark_utils.spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.859513, "supported_languages": null}, "macro.spark_utils.spark__get_tables_by_prefix": {"name": "spark__get_tables_by_prefix", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_tables_by_prefix", "macro_sql": "{% macro spark__get_tables_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(spark_utils.spark__get_relations_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_prefix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.85981, "supported_languages": null}, "macro.spark_utils.assert_not_null": {"name": "assert_not_null", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/etc/assert_not_null.sql", "original_file_path": "macros/etc/assert_not_null.sql", "unique_id": "macro.spark_utils.assert_not_null", "macro_sql": "{% macro assert_not_null(function, arg) -%}\n {{ return(adapter.dispatch('assert_not_null', 'spark_utils')(function, arg)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.spark_utils.default__assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8601658, "supported_languages": null}, "macro.spark_utils.default__assert_not_null": {"name": "default__assert_not_null", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/etc/assert_not_null.sql", "original_file_path": "macros/etc/assert_not_null.sql", "unique_id": "macro.spark_utils.default__assert_not_null", "macro_sql": "{% macro default__assert_not_null(function, arg) %}\n\n coalesce({{function}}({{arg}}), nvl2({{function}}({{arg}}), assert_true({{function}}({{arg}}) is not null), null))\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.860383, "supported_languages": null}, "macro.spark_utils.spark__convert_timezone": {"name": "spark__convert_timezone", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/snowplow/convert_timezone.sql", "original_file_path": "macros/snowplow/convert_timezone.sql", "unique_id": "macro.spark_utils.spark__convert_timezone", "macro_sql": "{% macro spark__convert_timezone(in_tz, out_tz, in_timestamp) %}\n from_utc_timestamp(to_utc_timestamp({{in_timestamp}}, {{in_tz}}), {{out_tz}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.860606, "supported_languages": null}, "macro.fivetran_utils.enabled_vars": {"name": "enabled_vars", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/enabled_vars.sql", "original_file_path": "macros/enabled_vars.sql", "unique_id": "macro.fivetran_utils.enabled_vars", "macro_sql": "{% macro enabled_vars(vars) %}\n\n{% for v in vars %}\n \n {% if var(v, True) == False %}\n {{ return(False) }}\n {% endif %}\n\n{% endfor %}\n\n{{ return(True) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.861038, "supported_languages": null}, "macro.fivetran_utils.percentile": {"name": "percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.percentile", "macro_sql": "{% macro percentile(percentile_field, partition_field, percent) -%}\n\n{{ adapter.dispatch('percentile', 'fivetran_utils') (percentile_field, partition_field, percent) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__percentile"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.862072, "supported_languages": null}, "macro.fivetran_utils.default__percentile": {"name": "default__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.default__percentile", "macro_sql": "{% macro default__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n over ( partition by {{ partition_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8622541, "supported_languages": null}, "macro.fivetran_utils.redshift__percentile": {"name": "redshift__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.redshift__percentile", "macro_sql": "{% macro redshift__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n over ( partition by {{ partition_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8624341, "supported_languages": null}, "macro.fivetran_utils.bigquery__percentile": {"name": "bigquery__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.bigquery__percentile", "macro_sql": "{% macro bigquery__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percentile_field }}, \n {{ percent }}) \n over (partition by {{ partition_field }} \n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.862612, "supported_languages": null}, "macro.fivetran_utils.postgres__percentile": {"name": "postgres__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.postgres__percentile", "macro_sql": "{% macro postgres__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n /* have to group by partition field */\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.862769, "supported_languages": null}, "macro.fivetran_utils.spark__percentile": {"name": "spark__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.spark__percentile", "macro_sql": "{% macro spark__percentile(percentile_field, partition_field, percent) %}\n\n percentile( \n {{ percentile_field }}, \n {{ percent }}) \n over (partition by {{ partition_field }} \n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.862944, "supported_languages": null}, "macro.fivetran_utils.pivot_json_extract": {"name": "pivot_json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/pivot_json_extract.sql", "original_file_path": "macros/pivot_json_extract.sql", "unique_id": "macro.fivetran_utils.pivot_json_extract", "macro_sql": "{% macro pivot_json_extract(string, list_of_properties) %}\n\n{%- for property in list_of_properties -%}\n{%- if property is mapping -%}\nreplace( {{ fivetran_utils.json_extract(string, property.name) }}, '\"', '') as {{ property.alias if property.alias else property.name | replace(' ', '_') | replace('.', '_') | lower }}\n\n{%- else -%}\nreplace( {{ fivetran_utils.json_extract(string, property) }}, '\"', '') as {{ property | replace(' ', '_') | lower }}\n\n{%- endif -%}\n{%- if not loop.last -%},{%- endif %}\n{% endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.json_extract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8638852, "supported_languages": null}, "macro.fivetran_utils.persist_pass_through_columns": {"name": "persist_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/persist_pass_through_columns.sql", "original_file_path": "macros/persist_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.persist_pass_through_columns", "macro_sql": "{% macro persist_pass_through_columns(pass_through_variable, identifier=none, transform='') %}\n\n{% if var(pass_through_variable, none) %}\n {% for field in var(pass_through_variable) %}\n , {{ transform ~ '(' ~ (identifier ~ '.' if identifier else '') ~ (field.alias if field.alias else field.name) ~ ')' }} as {{ field.alias if field.alias else field.name }}\n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8645859, "supported_languages": null}, "macro.fivetran_utils.json_parse": {"name": "json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.json_parse", "macro_sql": "{% macro json_parse(string, string_path) -%}\n\n{{ adapter.dispatch('json_parse', 'fivetran_utils') (string, string_path) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__json_parse"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.865806, "supported_languages": null}, "macro.fivetran_utils.default__json_parse": {"name": "default__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.default__json_parse", "macro_sql": "{% macro default__json_parse(string, string_path) %}\n\n json_extract_path_text({{string}}, {%- for s in string_path -%}'{{ s }}'{%- if not loop.last -%},{%- endif -%}{%- endfor -%} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.86607, "supported_languages": null}, "macro.fivetran_utils.redshift__json_parse": {"name": "redshift__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.redshift__json_parse", "macro_sql": "{% macro redshift__json_parse(string, string_path) %}\n\n json_extract_path_text({{string}}, {%- for s in string_path -%}'{{ s }}'{%- if not loop.last -%},{%- endif -%}{%- endfor -%} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8663309, "supported_languages": null}, "macro.fivetran_utils.bigquery__json_parse": {"name": "bigquery__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.bigquery__json_parse", "macro_sql": "{% macro bigquery__json_parse(string, string_path) %}\n\n \n json_extract_scalar({{string}}, '$.{%- for s in string_path -%}{{ s }}{%- if not loop.last -%}.{%- endif -%}{%- endfor -%} ')\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.866582, "supported_languages": null}, "macro.fivetran_utils.postgres__json_parse": {"name": "postgres__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.postgres__json_parse", "macro_sql": "{% macro postgres__json_parse(string, string_path) %}\n\n {{string}}::json #>> '{ {%- for s in string_path -%}{{ s }}{%- if not loop.last -%},{%- endif -%}{%- endfor -%} }'\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8668349, "supported_languages": null}, "macro.fivetran_utils.snowflake__json_parse": {"name": "snowflake__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.snowflake__json_parse", "macro_sql": "{% macro snowflake__json_parse(string, string_path) %}\n\n parse_json( {{string}} ) {%- for s in string_path -%}{% if s is number %}[{{ s }}]{% else %}['{{ s }}']{% endif %}{%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.867111, "supported_languages": null}, "macro.fivetran_utils.spark__json_parse": {"name": "spark__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.spark__json_parse", "macro_sql": "{% macro spark__json_parse(string, string_path) %}\n\n {{string}} : {%- for s in string_path -%}{% if s is number %}[{{ s }}]{% else %}['{{ s }}']{% endif %}{%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.867389, "supported_languages": null}, "macro.fivetran_utils.max_bool": {"name": "max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.max_bool", "macro_sql": "{% macro max_bool(boolean_field) -%}\n\n{{ adapter.dispatch('max_bool', 'fivetran_utils') (boolean_field) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__max_bool"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.867727, "supported_languages": null}, "macro.fivetran_utils.default__max_bool": {"name": "default__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.default__max_bool", "macro_sql": "{% macro default__max_bool(boolean_field) %}\n\n bool_or( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8678348, "supported_languages": null}, "macro.fivetran_utils.snowflake__max_bool": {"name": "snowflake__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.snowflake__max_bool", "macro_sql": "{% macro snowflake__max_bool(boolean_field) %}\n\n max( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8679411, "supported_languages": null}, "macro.fivetran_utils.bigquery__max_bool": {"name": "bigquery__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.bigquery__max_bool", "macro_sql": "{% macro bigquery__max_bool(boolean_field) %}\n\n max( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.868046, "supported_languages": null}, "macro.fivetran_utils.calculated_fields": {"name": "calculated_fields", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/calculated_fields.sql", "original_file_path": "macros/calculated_fields.sql", "unique_id": "macro.fivetran_utils.calculated_fields", "macro_sql": "{% macro calculated_fields(variable) -%}\n\n{% if var(variable, none) %}\n {% for field in var(variable) %}\n , {{ field.transform_sql }} as {{ field.name }} \n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.868433, "supported_languages": null}, "macro.fivetran_utils.drop_schemas_automation": {"name": "drop_schemas_automation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/drop_schemas_automation.sql", "original_file_path": "macros/drop_schemas_automation.sql", "unique_id": "macro.fivetran_utils.drop_schemas_automation", "macro_sql": "{% macro drop_schemas_automation(drop_target_schema=true) %}\n {{ return(adapter.dispatch('drop_schemas_automation', 'fivetran_utils')(drop_target_schema)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__drop_schemas_automation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.869168, "supported_languages": null}, "macro.fivetran_utils.default__drop_schemas_automation": {"name": "default__drop_schemas_automation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/drop_schemas_automation.sql", "original_file_path": "macros/drop_schemas_automation.sql", "unique_id": "macro.fivetran_utils.default__drop_schemas_automation", "macro_sql": "{% macro default__drop_schemas_automation(drop_target_schema=true) %}\n\n{% set fetch_list_sql %}\n {% if target.type not in ('databricks', 'spark') %}\n select schema_name\n from \n {{ wrap_in_quotes(target.database) }}.INFORMATION_SCHEMA.SCHEMATA\n where lower(schema_name) like '{{ target.schema | lower }}{%- if not drop_target_schema -%}_{%- endif -%}%'\n {% else %}\n SHOW SCHEMAS LIKE '{{ target.schema }}{%- if not drop_target_schema -%}_{%- endif -%}*'\n {% endif %}\n{% endset %}\n\n{% set results = run_query(fetch_list_sql) %}\n\n{% if execute %}\n {% set results_list = results.columns[0].values() %}\n{% else %}\n {% set results_list = [] %}\n{% endif %}\n\n{% for schema_to_drop in results_list %}\n {% do adapter.drop_schema(api.Relation.create(database=target.database, schema=schema_to_drop)) %}\n {{ print('Schema ' ~ schema_to_drop ~ ' successfully dropped from the ' ~ target.database ~ ' database.\\n')}}\n{% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.wrap_in_quotes", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.87028, "supported_languages": null}, "macro.fivetran_utils.seed_data_helper": {"name": "seed_data_helper", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/seed_data_helper.sql", "original_file_path": "macros/seed_data_helper.sql", "unique_id": "macro.fivetran_utils.seed_data_helper", "macro_sql": "{% macro seed_data_helper(seed_name, warehouses) %}\n\n{% if target.type in warehouses %}\n {% for w in warehouses %}\n {% if target.type == w %}\n {{ return(ref(seed_name ~ \"_\" ~ w ~ \"\")) }}\n {% endif %}\n {% endfor %}\n{% else %}\n{{ return(ref(seed_name)) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8708942, "supported_languages": null}, "macro.fivetran_utils.fill_pass_through_columns": {"name": "fill_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_pass_through_columns.sql", "original_file_path": "macros/fill_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.fill_pass_through_columns", "macro_sql": "{% macro fill_pass_through_columns(pass_through_variable) %}\n\n{% if var(pass_through_variable) %}\n {% for field in var(pass_through_variable) %}\n {% if field is mapping %}\n {% if field.transform_sql %}\n , {{ field.transform_sql }} as {{ field.alias if field.alias else field.name }}\n {% else %}\n , {{ field.alias if field.alias else field.name }}\n {% endif %}\n {% else %}\n , {{ field }}\n {% endif %}\n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.87204, "supported_languages": null}, "macro.fivetran_utils.string_agg": {"name": "string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.string_agg", "macro_sql": "{% macro string_agg(field_to_agg, delimiter) -%}\n\n{{ adapter.dispatch('string_agg', 'fivetran_utils') (field_to_agg, delimiter) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__string_agg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8726258, "supported_languages": null}, "macro.fivetran_utils.default__string_agg": {"name": "default__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.default__string_agg", "macro_sql": "{% macro default__string_agg(field_to_agg, delimiter) %}\n string_agg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.872784, "supported_languages": null}, "macro.fivetran_utils.snowflake__string_agg": {"name": "snowflake__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.snowflake__string_agg", "macro_sql": "{% macro snowflake__string_agg(field_to_agg, delimiter) %}\n listagg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8729322, "supported_languages": null}, "macro.fivetran_utils.redshift__string_agg": {"name": "redshift__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.redshift__string_agg", "macro_sql": "{% macro redshift__string_agg(field_to_agg, delimiter) %}\n listagg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.873077, "supported_languages": null}, "macro.fivetran_utils.spark__string_agg": {"name": "spark__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.spark__string_agg", "macro_sql": "{% macro spark__string_agg(field_to_agg, delimiter) %}\n -- collect set will remove duplicates\n replace(replace(replace(cast( collect_set({{ field_to_agg }}) as string), '[', ''), ']', ''), ', ', {{ delimiter }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.873228, "supported_languages": null}, "macro.fivetran_utils.timestamp_diff": {"name": "timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.timestamp_diff", "macro_sql": "{% macro timestamp_diff(first_date, second_date, datepart) %}\n {{ adapter.dispatch('timestamp_diff', 'fivetran_utils')(first_date, second_date, datepart) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__timestamp_diff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.876576, "supported_languages": null}, "macro.fivetran_utils.default__timestamp_diff": {"name": "default__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.default__timestamp_diff", "macro_sql": "{% macro default__timestamp_diff(first_date, second_date, datepart) %}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.876758, "supported_languages": null}, "macro.fivetran_utils.redshift__timestamp_diff": {"name": "redshift__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.redshift__timestamp_diff", "macro_sql": "{% macro redshift__timestamp_diff(first_date, second_date, datepart) %}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.876933, "supported_languages": null}, "macro.fivetran_utils.bigquery__timestamp_diff": {"name": "bigquery__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.bigquery__timestamp_diff", "macro_sql": "{% macro bigquery__timestamp_diff(first_date, second_date, datepart) %}\n\n timestamp_diff(\n {{second_date}},\n {{first_date}},\n {{datepart}}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.877105, "supported_languages": null}, "macro.fivetran_utils.postgres__timestamp_diff": {"name": "postgres__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.postgres__timestamp_diff", "macro_sql": "{% macro postgres__timestamp_diff(first_date, second_date, datepart) %}\n\n {% if datepart == 'year' %}\n (date_part('year', ({{second_date}})::date) - date_part('year', ({{first_date}})::date))\n {% elif datepart == 'quarter' %}\n ({{ dbt.datediff(first_date, second_date, 'year') }} * 4 + date_part('quarter', ({{second_date}})::date) - date_part('quarter', ({{first_date}})::date))\n {% elif datepart == 'month' %}\n ({{ dbt.datediff(first_date, second_date, 'year') }} * 12 + date_part('month', ({{second_date}})::date) - date_part('month', ({{first_date}})::date))\n {% elif datepart == 'day' %}\n (({{second_date}})::date - ({{first_date}})::date)\n {% elif datepart == 'week' %}\n ({{ dbt.datediff(first_date, second_date, 'day') }} / 7 + case\n when date_part('dow', ({{first_date}})::timestamp) <= date_part('dow', ({{second_date}})::timestamp) then\n case when {{first_date}} <= {{second_date}} then 0 else -1 end\n else\n case when {{first_date}} <= {{second_date}} then 1 else 0 end\n end)\n {% elif datepart == 'hour' %}\n ({{ dbt.datediff(first_date, second_date, 'day') }} * 24 + date_part('hour', ({{second_date}})::timestamp) - date_part('hour', ({{first_date}})::timestamp))\n {% elif datepart == 'minute' %}\n ({{ dbt.datediff(first_date, second_date, 'hour') }} * 60 + date_part('minute', ({{second_date}})::timestamp) - date_part('minute', ({{first_date}})::timestamp))\n {% elif datepart == 'second' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60 + floor(date_part('second', ({{second_date}})::timestamp)) - floor(date_part('second', ({{first_date}})::timestamp)))\n {% elif datepart == 'millisecond' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60000 + floor(date_part('millisecond', ({{second_date}})::timestamp)) - floor(date_part('millisecond', ({{first_date}})::timestamp)))\n {% elif datepart == 'microsecond' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60000000 + floor(date_part('microsecond', ({{second_date}})::timestamp)) - floor(date_part('microsecond', ({{first_date}})::timestamp)))\n {% else %}\n {{ exceptions.raise_compiler_error(\"Unsupported datepart for macro datediff in postgres: {!r}\".format(datepart)) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8789902, "supported_languages": null}, "macro.fivetran_utils.try_cast": {"name": "try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.try_cast", "macro_sql": "{% macro try_cast(field, type) %}\n {{ adapter.dispatch('try_cast', 'fivetran_utils') (field, type) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__try_cast"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.879942, "supported_languages": null}, "macro.fivetran_utils.default__safe_cast": {"name": "default__safe_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.default__safe_cast", "macro_sql": "{% macro default__safe_cast(field, type) %}\n {# most databases don't support this function yet\n so we just need to use cast #}\n cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.880099, "supported_languages": null}, "macro.fivetran_utils.redshift__try_cast": {"name": "redshift__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.redshift__try_cast", "macro_sql": "{% macro redshift__try_cast(field, type) %}\n{%- if type == 'numeric' -%}\n\n case\n when trim({{field}}) ~ '^(0|[1-9][0-9]*)$' then trim({{field}})\n else null\n end::{{type}}\n\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"non-numeric datatypes are not currently supported\") }}\n\n{% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8804018, "supported_languages": null}, "macro.fivetran_utils.postgres__try_cast": {"name": "postgres__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.postgres__try_cast", "macro_sql": "{% macro postgres__try_cast(field, type) %}\n{%- if type == 'numeric' -%}\n\n case\n when replace(cast({{field}} as varchar),cast(' ' as varchar),cast('' as varchar)) ~ '^(0|[1-9][0-9]*)$' \n then replace(cast({{field}} as varchar),cast(' ' as varchar),cast('' as varchar))\n else null\n end::{{type}}\n\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"non-numeric datatypes are not currently supported\") }}\n\n{% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.880724, "supported_languages": null}, "macro.fivetran_utils.snowflake__try_cast": {"name": "snowflake__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.snowflake__try_cast", "macro_sql": "{% macro snowflake__try_cast(field, type) %}\n try_cast(cast({{field}} as varchar) as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.880865, "supported_languages": null}, "macro.fivetran_utils.bigquery__try_cast": {"name": "bigquery__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.bigquery__try_cast", "macro_sql": "{% macro bigquery__try_cast(field, type) %}\n safe_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.881014, "supported_languages": null}, "macro.fivetran_utils.spark__try_cast": {"name": "spark__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.spark__try_cast", "macro_sql": "{% macro spark__try_cast(field, type) %}\n try_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.88115, "supported_languages": null}, "macro.fivetran_utils.source_relation": {"name": "source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/source_relation.sql", "original_file_path": "macros/source_relation.sql", "unique_id": "macro.fivetran_utils.source_relation", "macro_sql": "{% macro source_relation(union_schema_variable='union_schemas', union_database_variable='union_databases') -%}\n\n{{ adapter.dispatch('source_relation', 'fivetran_utils') (union_schema_variable, union_database_variable) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__source_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.881697, "supported_languages": null}, "macro.fivetran_utils.default__source_relation": {"name": "default__source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/source_relation.sql", "original_file_path": "macros/source_relation.sql", "unique_id": "macro.fivetran_utils.default__source_relation", "macro_sql": "{% macro default__source_relation(union_schema_variable, union_database_variable) %}\n\n{% if var(union_schema_variable, none) %}\n, case\n {% for schema in var(union_schema_variable) %}\n when lower(replace(replace(_dbt_source_relation,'\"',''),'`','')) like '%.{{ schema|lower }}.%' then '{{ schema|lower }}'\n {% endfor %}\n end as source_relation\n{% elif var(union_database_variable, none) %}\n, case\n {% for database in var(union_database_variable) %}\n when lower(replace(replace(_dbt_source_relation,'\"',''),'`','')) like '%{{ database|lower }}.%' then '{{ database|lower }}'\n {% endfor %}\n end as source_relation\n{% else %}\n, cast('' as {{ dbt.type_string() }}) as source_relation\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.882339, "supported_languages": null}, "macro.fivetran_utils.first_value": {"name": "first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.first_value", "macro_sql": "{% macro first_value(first_value_field, partition_field, order_by_field, order=\"asc\") -%}\n\n{{ adapter.dispatch('first_value', 'fivetran_utils') (first_value_field, partition_field, order_by_field, order) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__first_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8828921, "supported_languages": null}, "macro.fivetran_utils.default__first_value": {"name": "default__first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.default__first_value", "macro_sql": "{% macro default__first_value(first_value_field, partition_field, order_by_field, order=\"asc\") %}\n\n first_value( {{ first_value_field }} ignore nulls ) over (partition by {{ partition_field }} order by {{ order_by_field }} {{ order }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8831239, "supported_languages": null}, "macro.fivetran_utils.redshift__first_value": {"name": "redshift__first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.redshift__first_value", "macro_sql": "{% macro redshift__first_value(first_value_field, partition_field, order_by_field, order=\"asc\") %}\n\n first_value( {{ first_value_field }} ignore nulls ) over (partition by {{ partition_field }} order by {{ order_by_field }} {{ order }} , {{ partition_field }} rows unbounded preceding )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.883371, "supported_languages": null}, "macro.fivetran_utils.add_dbt_source_relation": {"name": "add_dbt_source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/add_dbt_source_relation.sql", "original_file_path": "macros/add_dbt_source_relation.sql", "unique_id": "macro.fivetran_utils.add_dbt_source_relation", "macro_sql": "{% macro add_dbt_source_relation() %}\n\n{% if var('union_schemas', none) or var('union_databases', none) %}\n, _dbt_source_relation\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.883662, "supported_languages": null}, "macro.fivetran_utils.add_pass_through_columns": {"name": "add_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/add_pass_through_columns.sql", "original_file_path": "macros/add_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.add_pass_through_columns", "macro_sql": "{% macro add_pass_through_columns(base_columns, pass_through_var) %}\n\n {% if pass_through_var %}\n\n {% for column in pass_through_var %}\n\n {% if column is mapping %}\n\n {% if column.alias %}\n\n {% do base_columns.append({ \"name\": column.name, \"alias\": column.alias, \"datatype\": column.datatype if column.datatype else dbt.type_string()}) %}\n\n {% else %}\n\n {% do base_columns.append({ \"name\": column.name, \"datatype\": column.datatype if column.datatype else dbt.type_string()}) %}\n \n {% endif %}\n\n {% else %}\n\n {% do base_columns.append({ \"name\": column, \"datatype\": dbt.type_string()}) %}\n\n {% endif %}\n\n {% endfor %}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.884932, "supported_languages": null}, "macro.fivetran_utils.union_relations": {"name": "union_relations", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_relations.sql", "original_file_path": "macros/union_relations.sql", "unique_id": "macro.fivetran_utils.union_relations", "macro_sql": "{%- macro union_relations(relations, aliases=none, column_override=none, include=[], exclude=[], source_column_name=none) -%}\n\n {%- if exclude and include -%}\n {{ exceptions.raise_compiler_error(\"Both an exclude and include list were provided to the `union` macro. Only one is allowed\") }}\n {%- endif -%}\n\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. -#}\n {%- if not execute %}\n {{ return('') }}\n {% endif -%}\n\n {%- set column_override = column_override if column_override is not none else {} -%}\n {%- set source_column_name = source_column_name if source_column_name is not none else '_dbt_source_relation' -%}\n\n {%- set relation_columns = {} -%}\n {%- set column_superset = {} -%}\n\n {%- for relation in relations -%}\n\n {%- do relation_columns.update({relation: []}) -%}\n\n {%- do dbt_utils._is_relation(relation, 'union_relations') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) -%}\n {%- for col in cols -%}\n\n {#- If an exclude list was provided and the column is in the list, do nothing -#}\n {%- if exclude and col.column in exclude -%}\n\n {#- If an include list was provided and the column is not in the list, do nothing -#}\n {%- elif include and col.column not in include -%}\n\n {#- Otherwise add the column to the column superset -#}\n {%- else -%}\n\n {#- update the list of columns in this relation -#}\n {%- do relation_columns[relation].append(col.column) -%}\n\n {%- if col.column in column_superset -%}\n\n {%- set stored = column_superset[col.column] -%}\n {%- if col.is_string() and stored.is_string() and col.string_size() > stored.string_size() -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif %}\n\n {%- else -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif -%}\n\n {%- endif -%}\n\n {%- endfor -%}\n {%- endfor -%}\n\n {%- set ordered_column_names = column_superset.keys() -%}\n\n {%- for relation in relations %}\n\n (\n select\n\n cast({{ dbt.string_literal(relation) }} as {{ dbt.type_string() }}) as {{ source_column_name }},\n {% for col_name in ordered_column_names -%}\n\n {%- set col = column_superset[col_name] %}\n {%- set col_type = column_override.get(col.column, col.data_type) %}\n {%- set col_name = adapter.quote(col_name) if col_name in relation_columns[relation] else 'null' %}\n cast({{ col_name }} as {{ col_type }}) as {{ col.quoted }} {% if not loop.last %},{% endif -%}\n\n {%- endfor %}\n\n from {{ aliases[loop.index0] if aliases else relation }}\n )\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n\n {%- endfor -%}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt.string_literal", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.889617, "supported_languages": null}, "macro.fivetran_utils.union_tables": {"name": "union_tables", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_relations.sql", "original_file_path": "macros/union_relations.sql", "unique_id": "macro.fivetran_utils.union_tables", "macro_sql": "{%- macro union_tables(tables, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_table') -%}\n\n {%- do exceptions.warn(\"Warning: the `union_tables` macro is no longer supported and will be deprecated in a future release of dbt-utils. Use the `union_relations` macro instead\") -%}\n\n {{ return(dbt_utils.union_relations(tables, column_override, include, exclude, source_column_name)) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils.union_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8903182, "supported_languages": null}, "macro.fivetran_utils.snowflake_seed_data": {"name": "snowflake_seed_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/snowflake_seed_data.sql", "original_file_path": "macros/snowflake_seed_data.sql", "unique_id": "macro.fivetran_utils.snowflake_seed_data", "macro_sql": "{% macro snowflake_seed_data(seed_name) %}\n\n{% if target.type == 'snowflake' %}\n{{ return(ref(seed_name ~ '_snowflake')) }}\n{% else %}\n{{ return(ref(seed_name)) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.89076, "supported_languages": null}, "macro.fivetran_utils.fill_staging_columns": {"name": "fill_staging_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_staging_columns.sql", "original_file_path": "macros/fill_staging_columns.sql", "unique_id": "macro.fivetran_utils.fill_staging_columns", "macro_sql": "{% macro fill_staging_columns(source_columns, staging_columns) -%}\n\n{%- set source_column_names = source_columns|map(attribute='name')|map('lower')|list -%}\n\n{%- for column in staging_columns %}\n {% if column.name|lower in source_column_names -%}\n {{ fivetran_utils.quote_column(column) }} as \n {%- if 'alias' in column %} {{ column.alias }} {% else %} {{ fivetran_utils.quote_column(column) }} {%- endif -%}\n {%- else -%}\n cast(null as {{ column.datatype }})\n {%- if 'alias' in column %} as {{ column.alias }} {% else %} as {{ fivetran_utils.quote_column(column) }} {% endif -%}\n {%- endif -%}\n {%- if not loop.last -%} , {% endif -%}\n{% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.quote_column"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.892564, "supported_languages": null}, "macro.fivetran_utils.quote_column": {"name": "quote_column", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_staging_columns.sql", "original_file_path": "macros/fill_staging_columns.sql", "unique_id": "macro.fivetran_utils.quote_column", "macro_sql": "{% macro quote_column(column) %}\n {% if 'quote' in column %}\n {% if column.quote %}\n {% if target.type in ('bigquery', 'spark', 'databricks') %}\n `{{ column.name }}`\n {% elif target.type == 'snowflake' %}\n \"{{ column.name | upper }}\"\n {% else %}\n \"{{ column.name }}\"\n {% endif %}\n {% else %}\n {{ column.name }}\n {% endif %}\n {% else %}\n {{ column.name }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8931851, "supported_languages": null}, "macro.fivetran_utils.json_extract": {"name": "json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.json_extract", "macro_sql": "{% macro json_extract(string, string_path) -%}\n\n{{ adapter.dispatch('json_extract', 'fivetran_utils') (string, string_path) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__json_extract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.893816, "supported_languages": null}, "macro.fivetran_utils.default__json_extract": {"name": "default__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.default__json_extract", "macro_sql": "{% macro default__json_extract(string, string_path) %}\n\n json_extract_path_text({{string}}, {{ \"'\" ~ string_path ~ \"'\" }} )\n \n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8939881, "supported_languages": null}, "macro.fivetran_utils.snowflake__json_extract": {"name": "snowflake__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.snowflake__json_extract", "macro_sql": "{% macro snowflake__json_extract(string, string_path) %}\n\n json_extract_path_text(try_parse_json( {{string}} ), {{ \"'\" ~ string_path ~ \"'\" }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.894159, "supported_languages": null}, "macro.fivetran_utils.redshift__json_extract": {"name": "redshift__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.redshift__json_extract", "macro_sql": "{% macro redshift__json_extract(string, string_path) %}\n\n case when is_valid_json( {{string}} ) then json_extract_path_text({{string}}, {{ \"'\" ~ string_path ~ \"'\" }} ) else null end\n \n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.894345, "supported_languages": null}, "macro.fivetran_utils.bigquery__json_extract": {"name": "bigquery__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.bigquery__json_extract", "macro_sql": "{% macro bigquery__json_extract(string, string_path) %}\n\n json_extract_scalar({{string}}, {{ \"'$.\" ~ string_path ~ \"'\" }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8945122, "supported_languages": null}, "macro.fivetran_utils.postgres__json_extract": {"name": "postgres__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.postgres__json_extract", "macro_sql": "{% macro postgres__json_extract(string, string_path) %}\n\n {{string}}::json->>{{\"'\" ~ string_path ~ \"'\" }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.894679, "supported_languages": null}, "macro.fivetran_utils.collect_freshness": {"name": "collect_freshness", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/collect_freshness.sql", "original_file_path": "macros/collect_freshness.sql", "unique_id": "macro.fivetran_utils.collect_freshness", "macro_sql": "{% macro collect_freshness(source, loaded_at_field, filter) %}\n {{ return(adapter.dispatch('collect_freshness')(source, loaded_at_field, filter))}}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__collect_freshness"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8956091, "supported_languages": null}, "macro.fivetran_utils.default__collect_freshness": {"name": "default__collect_freshness", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/collect_freshness.sql", "original_file_path": "macros/collect_freshness.sql", "unique_id": "macro.fivetran_utils.default__collect_freshness", "macro_sql": "{% macro default__collect_freshness(source, loaded_at_field, filter) %}\n {% call statement('collect_freshness', fetch_result=True, auto_begin=False) -%}\n\n {%- set enabled_array = [] -%}\n {% for node in graph.sources.values() %}\n {% if node.identifier == source.identifier %}\n {% if (node.meta['is_enabled'] | default(true)) %}\n {%- do enabled_array.append(1) -%}\n {% endif %}\n {% endif %}\n {% endfor %}\n {% set is_enabled = (enabled_array != []) %}\n\n select\n {% if is_enabled %}\n max({{ loaded_at_field }})\n {% else %} \n {{ current_timestamp() }} {% endif %} as max_loaded_at,\n {{ current_timestamp() }} as snapshotted_at\n\n {% if is_enabled %}\n from {{ source }}\n {% if filter %}\n where {{ filter }}\n {% endif %}\n {% endif %}\n\n {% endcall %}\n {{ return(load_result('collect_freshness').table) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.896683, "supported_languages": null}, "macro.fivetran_utils.timestamp_add": {"name": "timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.timestamp_add", "macro_sql": "{% macro timestamp_add(datepart, interval, from_timestamp) -%}\n\n{{ adapter.dispatch('timestamp_add', 'fivetran_utils') (datepart, interval, from_timestamp) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.postgres__timestamp_add"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.897472, "supported_languages": null}, "macro.fivetran_utils.default__timestamp_add": {"name": "default__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.default__timestamp_add", "macro_sql": "{% macro default__timestamp_add(datepart, interval, from_timestamp) %}\n\n timestampadd(\n {{ datepart }},\n {{ interval }},\n {{ from_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.89765, "supported_languages": null}, "macro.fivetran_utils.bigquery__timestamp_add": {"name": "bigquery__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.bigquery__timestamp_add", "macro_sql": "{% macro bigquery__timestamp_add(datepart, interval, from_timestamp) %}\n\n timestamp_add({{ from_timestamp }}, interval {{ interval }} {{ datepart }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.897822, "supported_languages": null}, "macro.fivetran_utils.redshift__timestamp_add": {"name": "redshift__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.redshift__timestamp_add", "macro_sql": "{% macro redshift__timestamp_add(datepart, interval, from_timestamp) %}\n\n dateadd(\n {{ datepart }},\n {{ interval }},\n {{ from_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8979998, "supported_languages": null}, "macro.fivetran_utils.postgres__timestamp_add": {"name": "postgres__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.postgres__timestamp_add", "macro_sql": "{% macro postgres__timestamp_add(datepart, interval, from_timestamp) %}\n\n {{ from_timestamp }} + ((interval '1 {{ datepart }}') * ({{ interval }}))\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.89817, "supported_languages": null}, "macro.fivetran_utils.spark__timestamp_add": {"name": "spark__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.spark__timestamp_add", "macro_sql": "{% macro spark__timestamp_add(datepart, interval, from_timestamp) %}\n\n {{ dbt.dateadd(datepart, interval, from_timestamp) }}\n \n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.89836, "supported_languages": null}, "macro.fivetran_utils.ceiling": {"name": "ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.ceiling", "macro_sql": "{% macro ceiling(num) -%}\n\n{{ adapter.dispatch('ceiling', 'fivetran_utils') (num) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__ceiling"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.898632, "supported_languages": null}, "macro.fivetran_utils.default__ceiling": {"name": "default__ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.default__ceiling", "macro_sql": "{% macro default__ceiling(num) %}\n ceiling({{ num }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8987432, "supported_languages": null}, "macro.fivetran_utils.snowflake__ceiling": {"name": "snowflake__ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.snowflake__ceiling", "macro_sql": "{% macro snowflake__ceiling(num) %}\n ceil({{ num }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.8989298, "supported_languages": null}, "macro.fivetran_utils.remove_prefix_from_columns": {"name": "remove_prefix_from_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/remove_prefix_from_columns.sql", "original_file_path": "macros/remove_prefix_from_columns.sql", "unique_id": "macro.fivetran_utils.remove_prefix_from_columns", "macro_sql": "{% macro remove_prefix_from_columns(columns, prefix='', exclude=[]) %}\n\n {%- for col in columns if col.name not in exclude -%}\n {%- if col.name[:prefix|length]|lower == prefix -%}\n {{ col.name }} as {{ col.name[prefix|length:] }}\n {%- else -%}\n {{ col.name }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {% endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.899617, "supported_languages": null}, "macro.fivetran_utils.union_data": {"name": "union_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_data.sql", "original_file_path": "macros/union_data.sql", "unique_id": "macro.fivetran_utils.union_data", "macro_sql": "{%- macro union_data(table_identifier, database_variable, schema_variable, default_database, default_schema, default_variable, union_schema_variable='union_schemas', union_database_variable='union_databases') -%}\n\n{{ adapter.dispatch('union_data', 'fivetran_utils') (\n table_identifier, \n database_variable, \n schema_variable, \n default_database, \n default_schema, \n default_variable,\n union_schema_variable,\n union_database_variable\n ) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.fivetran_utils.default__union_data"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.9033878, "supported_languages": null}, "macro.fivetran_utils.default__union_data": {"name": "default__union_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_data.sql", "original_file_path": "macros/union_data.sql", "unique_id": "macro.fivetran_utils.default__union_data", "macro_sql": "{%- macro default__union_data(\n table_identifier, \n database_variable, \n schema_variable, \n default_database, \n default_schema, \n default_variable,\n union_schema_variable,\n union_database_variable\n ) -%}\n\n{%- if var(union_schema_variable, none) -%}\n\n {%- set relations = [] -%}\n \n {%- if var(union_schema_variable) is string -%}\n {%- set trimmed = var(union_schema_variable)|trim('[')|trim(']') -%}\n {%- set schemas = trimmed.split(',')|map('trim',\" \")|map('trim','\"')|map('trim',\"'\") -%}\n {%- else -%}\n {%- set schemas = var(union_schema_variable) -%}\n {%- endif -%}\n\n {%- for schema in var(union_schema_variable) -%}\n {%- set relation=adapter.get_relation(\n database=source(schema, table_identifier).database if var('has_defined_sources', false) else var(database_variable, default_database),\n schema=source(schema, table_identifier).schema if var('has_defined_sources', false) else schema,\n identifier=source(schema, table_identifier).identifier if var('has_defined_sources', false) else table_identifier\n ) -%}\n \n {%- set relation_exists=relation is not none -%}\n\n {%- if relation_exists -%}\n {%- do relations.append(relation) -%}\n {%- endif -%}\n\n {%- endfor -%}\n \n {%- if relations != [] -%}\n {{ dbt_utils.union_relations(relations) }}\n {%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n {%- endif -%}\n\n{%- elif var(union_database_variable, none) -%}\n\n {%- set relations = [] -%}\n\n {%- for database in var(union_database_variable) -%}\n {%- set relation=adapter.get_relation(\n database=source(schema, table_identifier).database if var('has_defined_sources', false) else database,\n schema=source(schema, table_identifier).schema if var('has_defined_sources', false) else var(schema_variable, default_schema),\n identifier=source(schema, table_identifier).identifier if var('has_defined_sources', false) else table_identifier\n ) -%}\n\n {%- set relation_exists=relation is not none -%}\n\n {%- if relation_exists -%}\n {%- do relations.append(relation) -%}\n {%- endif -%}\n\n {%- endfor -%}\n\n {%- if relations != [] -%}\n {{ dbt_utils.union_relations(relations) }}\n {%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n {%- endif -%}\n\n{%- else -%}\n {% set exception_schemas = {\"linkedin_company_pages\": \"linkedin_pages\", \"instagram_business_pages\": \"instagram_business\"} %}\n {% set relation = namespace(value=\"\") %}\n {% if default_schema in exception_schemas.keys() %}\n {% for corrected_schema_name in exception_schemas.items() %} \n {% if default_schema in corrected_schema_name %}\n {# In order for this macro to effectively work within upstream integration tests (mainly used by the Fivetran dbt package maintainers), this identifier variable selection is required to use the macro with different identifier names. #}\n {% set identifier_var = corrected_schema_name[1] + \"_\" + table_identifier + \"_identifier\" %}\n {%- set relation.value=adapter.get_relation(\n database=source(corrected_schema_name[1], table_identifier).database,\n schema=source(corrected_schema_name[1], table_identifier).schema,\n identifier=var(identifier_var, table_identifier)\n ) -%}\n {% endif %}\n {% endfor %}\n {% else %}\n {# In order for this macro to effectively work within upstream integration tests (mainly used by the Fivetran dbt package maintainers), this identifier variable selection is required to use the macro with different identifier names. #}\n {% set identifier_var = default_schema + \"_\" + table_identifier + \"_identifier\" %}\n {# Unfortunately the Twitter Organic identifiers were misspelled. As such, we will need to account for this in the model. This will be adjusted in the Twitter Organic package, but to ensure backwards compatibility, this needs to be included. #}\n {% if var(identifier_var, none) is none %} \n {% set identifier_var = default_schema + \"_\" + table_identifier + \"_identifer\" %}\n {% endif %}\n {%- set relation.value=adapter.get_relation(\n database=source(default_schema, table_identifier).database,\n schema=source(default_schema, table_identifier).schema,\n identifier=var(identifier_var, table_identifier)\n ) -%}\n {% endif %}\n{%- set table_exists=relation.value is not none -%}\n\n{%- if table_exists -%}\n select * \n from {{ relation.value }}\n{%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n{%- endif -%}\n{%- endif -%}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils.union_relations", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.908661, "supported_languages": null}, "macro.fivetran_utils.dummy_coalesce_value": {"name": "dummy_coalesce_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/dummy_coalesce_value.sql", "original_file_path": "macros/dummy_coalesce_value.sql", "unique_id": "macro.fivetran_utils.dummy_coalesce_value", "macro_sql": "{% macro dummy_coalesce_value(column) %}\n\n{% set coalesce_value = {\n 'STRING': \"'DUMMY_STRING'\",\n 'BOOLEAN': 'null',\n 'INT': 999999999,\n 'FLOAT': 999999999.99,\n 'TIMESTAMP': 'cast(\"2099-12-31\" as timestamp)',\n 'DATE': 'cast(\"2099-12-31\" as date)',\n} %}\n\n{% if column.is_float() %}\n{{ return(coalesce_value['FLOAT']) }}\n\n{% elif column.is_numeric() %}\n{{ return(coalesce_value['INT']) }}\n\n{% elif column.is_string() %}\n{{ return(coalesce_value['STRING']) }}\n\n{% elif column.data_type|lower == 'boolean' %}\n{{ return(coalesce_value['BOOLEAN']) }}\n\n{% elif 'timestamp' in column.data_type|lower %}\n{{ return(coalesce_value['TIMESTAMP']) }}\n\n{% elif 'date' in column.data_type|lower %}\n{{ return(coalesce_value['DATE']) }}\n\n{% elif 'int' in column.data_type|lower %}\n{{ return(coalesce_value['INT']) }}\n\n{% endif %}\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.910305, "supported_languages": null}, "macro.fivetran_utils.wrap_in_quotes": {"name": "wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.wrap_in_quotes", "macro_sql": "{%- macro wrap_in_quotes(object_to_quote) -%}\n\n{{ return(adapter.dispatch('wrap_in_quotes', 'fivetran_utils')(object_to_quote)) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.fivetran_utils.postgres__wrap_in_quotes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.910688, "supported_languages": null}, "macro.fivetran_utils.default__wrap_in_quotes": {"name": "default__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.default__wrap_in_quotes", "macro_sql": "{%- macro default__wrap_in_quotes(object_to_quote) -%}\n{# bigquery, spark, databricks #}\n `{{ object_to_quote }}`\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.910811, "supported_languages": null}, "macro.fivetran_utils.snowflake__wrap_in_quotes": {"name": "snowflake__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.snowflake__wrap_in_quotes", "macro_sql": "{%- macro snowflake__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote | upper }}\"\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.910934, "supported_languages": null}, "macro.fivetran_utils.redshift__wrap_in_quotes": {"name": "redshift__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.redshift__wrap_in_quotes", "macro_sql": "{%- macro redshift__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote }}\"\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.91104, "supported_languages": null}, "macro.fivetran_utils.postgres__wrap_in_quotes": {"name": "postgres__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.postgres__wrap_in_quotes", "macro_sql": "{%- macro postgres__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote }}\"\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.911146, "supported_languages": null}, "macro.fivetran_utils.array_agg": {"name": "array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.array_agg", "macro_sql": "{% macro array_agg(field_to_agg) -%}\n\n{{ adapter.dispatch('array_agg', 'fivetran_utils') (field_to_agg) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__array_agg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.911422, "supported_languages": null}, "macro.fivetran_utils.default__array_agg": {"name": "default__array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.default__array_agg", "macro_sql": "{% macro default__array_agg(field_to_agg) %}\n array_agg({{ field_to_agg }})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.91153, "supported_languages": null}, "macro.fivetran_utils.redshift__array_agg": {"name": "redshift__array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.redshift__array_agg", "macro_sql": "{% macro redshift__array_agg(field_to_agg) %}\n listagg({{ field_to_agg }}, ',')\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.9116359, "supported_languages": null}, "macro.fivetran_utils.empty_variable_warning": {"name": "empty_variable_warning", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/empty_variable_warning.sql", "original_file_path": "macros/empty_variable_warning.sql", "unique_id": "macro.fivetran_utils.empty_variable_warning", "macro_sql": "{% macro empty_variable_warning(variable, downstream_model) %}\n\n{% if not var(variable) %}\n{{ log(\n \"\"\"\n Warning: You have passed an empty list to the \"\"\" ~ variable ~ \"\"\".\n As a result, you won't see the history of any columns in the \"\"\" ~ downstream_model ~ \"\"\" model.\n \"\"\",\n info=True\n) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.912053, "supported_languages": null}, "macro.fivetran_utils.enabled_vars_one_true": {"name": "enabled_vars_one_true", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/enabled_vars_one_true.sql", "original_file_path": "macros/enabled_vars_one_true.sql", "unique_id": "macro.fivetran_utils.enabled_vars_one_true", "macro_sql": "{% macro enabled_vars_one_true(vars) %}\n\n{% for v in vars %}\n \n {% if var(v, False) == True %}\n {{ return(True) }}\n {% endif %}\n\n{% endfor %}\n\n{{ return(False) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.9124649, "supported_languages": null}, "macro.marketo_source.get_activity_merge_leads_columns": {"name": "get_activity_merge_leads_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_merge_leads_columns.sql", "original_file_path": "macros/get_activity_merge_leads_columns.sql", "unique_id": "macro.marketo_source.get_activity_merge_leads_columns", "macro_sql": "{% macro get_activity_merge_leads_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"master_updated\", \"datatype\": \"boolean\"},\n {\"name\": \"merge_ids\", \"datatype\": dbt.type_string()},\n {\"name\": \"merge_source\", \"datatype\": dbt.type_string()},\n {\"name\": \"merged_in_sales\", \"datatype\": \"boolean\"},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.913895, "supported_languages": null}, "macro.marketo_source.get_activity_open_email_columns": {"name": "get_activity_open_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_open_email_columns.sql", "original_file_path": "macros/get_activity_open_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_open_email_columns", "macro_sql": "{% macro get_activity_open_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"device\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_mobile_device\", \"datatype\": \"boolean\"},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"platform\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.91601, "supported_languages": null}, "macro.marketo_source.get_email_template_history_columns": {"name": "get_email_template_history_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_email_template_history_columns.sql", "original_file_path": "macros/get_email_template_history_columns.sql", "unique_id": "macro.marketo_source.get_email_template_history_columns", "macro_sql": "{% macro get_email_template_history_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_folder_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_value\", \"datatype\": dbt.type_int()},\n {\"name\": \"from_email\", \"datatype\": dbt.type_string()},\n {\"name\": \"from_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"operational\", \"datatype\": \"boolean\"},\n {\"name\": \"program_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"publish_to_msi\", \"datatype\": \"boolean\"},\n {\"name\": \"reply_email\", \"datatype\": dbt.type_string()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()},\n {\"name\": \"subject\", \"datatype\": dbt.type_string()},\n {\"name\": \"template\", \"datatype\": dbt.type_int()},\n {\"name\": \"text_only\", \"datatype\": \"boolean\"},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"url\", \"datatype\": dbt.type_string()},\n {\"name\": \"version\", \"datatype\": dbt.type_int()},\n {\"name\": \"web_view\", \"datatype\": \"boolean\"},\n {\"name\": \"workspace\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.91887, "supported_languages": null}, "macro.marketo_source.get_lead_describe_columns": {"name": "get_lead_describe_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_lead_describe_columns.sql", "original_file_path": "macros/get_lead_describe_columns.sql", "unique_id": "macro.marketo_source.get_lead_describe_columns", "macro_sql": "{% macro get_lead_describe_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"data_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"display_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"length\", \"datatype\": dbt.type_int()},\n {\"name\": \"restname\", \"datatype\": dbt.type_string()},\n {\"name\": \"restread_only\", \"datatype\": \"boolean\"},\n {\"name\": \"soapname\", \"datatype\": dbt.type_string()},\n {\"name\": \"soapread_only\", \"datatype\": \"boolean\"}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.920021, "supported_languages": null}, "macro.marketo_source.get_activity_send_email_columns": {"name": "get_activity_send_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_send_email_columns.sql", "original_file_path": "macros/get_activity_send_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_send_email_columns", "macro_sql": "{% macro get_activity_send_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ fivetran_utils.add_pass_through_columns(columns, var('marketo__activity_send_email_passthrough_columns')) }}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string", "macro.fivetran_utils.add_pass_through_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.921691, "supported_languages": null}, "macro.marketo_source.get_campaign_columns": {"name": "get_campaign_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_campaign_columns.sql", "original_file_path": "macros/get_campaign_columns.sql", "unique_id": "macro.marketo_source.get_campaign_columns", "macro_sql": "{% macro get_campaign_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"_fivetran_deleted\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"active\", \"datatype\": \"boolean\"},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"program_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"type\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"workspace_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"computed_url\", \"datatype\": dbt.type_string()},\n {\"name\": \"flow_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_communication_limit_enabled\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"is_requestable\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"is_system\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"max_members\", \"datatype\": dbt.type_int()},\n {\"name\": \"qualification_rule_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"qualification_rule_interval\", \"datatype\": dbt.type_int()},\n {\"name\": \"qualification_rule_unit\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_start_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"recurrence_end_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"recurrence_interval_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_interval\", \"datatype\": dbt.type_int()},\n {\"name\": \"recurrence_weekday_only\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"recurrence_day_of_month\", \"datatype\": dbt.type_int()},\n {\"name\": \"recurrence_day_of_week\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_week_of_month\", \"datatype\": dbt.type_int()},\n {\"name\": \"smart_list_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_boolean", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.926253, "supported_languages": null}, "macro.marketo_source.get_activity_delete_lead_columns": {"name": "get_activity_delete_lead_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_delete_lead_columns.sql", "original_file_path": "macros/get_activity_delete_lead_columns.sql", "unique_id": "macro.marketo_source.get_activity_delete_lead_columns", "macro_sql": "{% macro get_activity_delete_lead_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign\", \"datatype\": dbt.type_string()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.927464, "supported_languages": null}, "macro.marketo_source.get_activity_unsubscribe_email_columns": {"name": "get_activity_unsubscribe_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_unsubscribe_email_columns.sql", "original_file_path": "macros/get_activity_unsubscribe_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_unsubscribe_email_columns", "macro_sql": "{% macro get_activity_unsubscribe_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"client_ip_address\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"form_fields\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"query_parameters\", \"datatype\": dbt.type_string()},\n {\"name\": \"referrer_url\", \"datatype\": dbt.type_string()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()},\n {\"name\": \"webform_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"webpage_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.929749, "supported_languages": null}, "macro.marketo_source.get_program_columns": {"name": "get_program_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_program_columns.sql", "original_file_path": "macros/get_program_columns.sql", "unique_id": "macro.marketo_source.get_program_columns", "macro_sql": "{% macro get_program_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"_fivetran_deleted\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"channel\", \"datatype\": dbt.type_string()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"end_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"sfdc_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"sfdc_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"start_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()},\n {\"name\": \"type\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"url\", \"datatype\": dbt.type_string()},\n {\"name\": \"workspace\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ fivetran_utils.add_pass_through_columns(columns, var('marketo__program_passthrough_columns')) }}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_boolean", "macro.dbt.type_string", "macro.dbt.type_int", "macro.fivetran_utils.add_pass_through_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.9318578, "supported_languages": null}, "macro.marketo_source.get_activity_email_bounced_columns": {"name": "get_activity_email_bounced_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_email_bounced_columns.sql", "original_file_path": "macros/get_activity_email_bounced_columns.sql", "unique_id": "macro.marketo_source.get_activity_email_bounced_columns", "macro_sql": "{% macro get_activity_email_bounced_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"category\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"details\", \"datatype\": dbt.type_string()},\n {\"name\": \"email\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"subcategory\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.93387, "supported_languages": null}, "macro.marketo_source.get_lead_columns": {"name": "get_lead_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_lead_columns.sql", "original_file_path": "macros/get_lead_columns.sql", "unique_id": "macro.marketo_source.get_lead_columns", "macro_sql": "{% macro get_lead_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"email\", \"datatype\": dbt.type_string()},\n {\"name\": \"first_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"last_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()}\n] %}\n\n{{ fivetran_utils.add_pass_through_columns(columns, var('marketo__lead_passthrough_columns')) }}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int", "macro.fivetran_utils.add_pass_through_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.934905, "supported_languages": null}, "macro.marketo_source.get_activity_email_delivered_columns": {"name": "get_activity_email_delivered_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_email_delivered_columns.sql", "original_file_path": "macros/get_activity_email_delivered_columns.sql", "unique_id": "macro.marketo_source.get_activity_email_delivered_columns", "macro_sql": "{% macro get_activity_email_delivered_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.9365, "supported_languages": null}, "macro.marketo_source.get_activity_click_email_columns": {"name": "get_activity_click_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_click_email_columns.sql", "original_file_path": "macros/get_activity_click_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_click_email_columns", "macro_sql": "{% macro get_activity_click_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"device\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_mobile_device\", \"datatype\": \"boolean\"},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"link\", \"datatype\": dbt.type_string()},\n {\"name\": \"link_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"platform\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.938794, "supported_languages": null}, "macro.marketo_source.get_activity_change_data_value_columns": {"name": "get_activity_change_data_value_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_change_data_value_columns.sql", "original_file_path": "macros/get_activity_change_data_value_columns.sql", "unique_id": "macro.marketo_source.get_activity_change_data_value_columns", "macro_sql": "{% macro get_activity_change_data_value_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"api_method_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"modifying_user\", \"datatype\": dbt.type_string()},\n {\"name\": \"new_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"old_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"reason\", \"datatype\": dbt.type_string()},\n {\"name\": \"request_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"source\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1689004582.940647, "supported_languages": null}}, "docs": {"doc.dbt.__overview__": {"name": "__overview__", "resource_type": "doc", "package_name": "dbt", "path": "overview.md", "original_file_path": "docs/overview.md", "unique_id": "doc.dbt.__overview__", "block_contents": "### Welcome!\n\nWelcome to the auto-generated documentation for your dbt project!\n\n### Navigation\n\nYou can use the `Project` and `Database` navigation tabs on the left side of the window to explore the models\nin your project.\n\n#### Project Tab\nThe `Project` tab mirrors the directory structure of your dbt project. In this tab, you can see all of the\nmodels defined in your dbt project, as well as models imported from dbt packages.\n\n#### Database Tab\nThe `Database` tab also exposes your models, but in a format that looks more like a database explorer. This view\nshows relations (tables and views) grouped into database schemas. Note that ephemeral models are _not_ shown\nin this interface, as they do not exist in the database.\n\n### Graph Exploration\nYou can click the blue icon on the bottom-right corner of the page to view the lineage graph of your models.\n\nOn model pages, you'll see the immediate parents and children of the model you're exploring. By clicking the `Expand`\nbutton at the top-right of this lineage pane, you'll be able to see all of the models that are used to build,\nor are built from, the model you're exploring.\n\nOnce expanded, you'll be able to use the `--select` and `--exclude` model selection syntax to filter the\nmodels in the graph. For more information on model selection, check out the [dbt docs](https://docs.getdbt.com/docs/model-selection-syntax).\n\nNote that you can also right-click on models to interactively filter and explore the graph.\n\n---\n\n### More information\n\n- [What is dbt](https://docs.getdbt.com/docs/introduction)?\n- Read the [dbt viewpoint](https://docs.getdbt.com/docs/viewpoint)\n- [Installation](https://docs.getdbt.com/docs/installation)\n- Join the [dbt Community](https://www.getdbt.com/community/) for questions and discussion"}}, "exposures": {}, "metrics": {}, "groups": {}, "selectors": {}, "disabled": {"model.marketo_source.stg_marketo__activity_delete_lead": [{"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_delete_lead", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_delete_lead.sql", "original_file_path": "models/stg_marketo__activity_delete_lead.sql", "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead", "fqn": ["marketo_source", "stg_marketo__activity_delete_lead"], "alias": "stg_marketo__activity_delete_lead", "checksum": {"name": "sha256", "checksum": "6292ea92f47a23c77b7d04e7add11037d84706a4d4aba0991e1e9101d18474d9"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "Table with deleted lead activities", "columns": {"activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_name": {"name": "campaign_name", "description": "The name of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": false}, "created_at": 1689004583.688162, "config_call_dict": {"enabled": false}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_delete_lead\"", "raw_code": "{{ config(enabled=var('marketo__activity_delete_lead_enabled', True)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__activity_delete_lead_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_delete_lead_tmp')),\n staging_columns=get_activity_delete_lead_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign as campaign_name,\n campaign_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_delete_lead_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_delete_lead_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_delete_lead_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}], "model.marketo_source.stg_marketo__activity_delete_lead_tmp": [{"database": "postgres", "schema": "marketo_source_integration_tests_8_marketo_source", "name": "stg_marketo__activity_delete_lead_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_delete_lead_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_delete_lead_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_delete_lead_tmp"], "alias": "stg_marketo__activity_delete_lead_tmp", "checksum": {"name": "sha256", "checksum": "c117443fd98cebcfa1400ed04ad0efa75858e7bcdbe3101bed1f332214a140ae"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false}, "post-hook": [], "pre-hook": []}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": false}, "created_at": 1689004583.514744, "config_call_dict": {"enabled": false}, "relation_name": "\"postgres\".\"marketo_source_integration_tests_8_marketo_source\".\"stg_marketo__activity_delete_lead_tmp\"", "raw_code": "{{ config(enabled=var('marketo__activity_delete_lead_enabled', True)) }}\n\nselect *\nfrom {{ var('activity_delete_lead') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_delete_lead"]], "metrics": [], "depends_on": {"macros": [], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null}]}, "parent_map": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": [], "seed.marketo_source_integration_tests.marketo_email_template_history_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": [], "seed.marketo_source_integration_tests.marketo_lead_describe_data": [], "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": [], "seed.marketo_source_integration_tests.marketo_campaign_data": [], "seed.marketo_source_integration_tests.marketo_program_data": [], "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": [], "seed.marketo_source_integration_tests.marketo_activity_click_email_data": [], "seed.marketo_source_integration_tests.marketo_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_open_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": [], "model.marketo_source.stg_marketo__activity_merge_leads": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp", "model.marketo_source.stg_marketo__activity_merge_leads_tmp"], "model.marketo_source.stg_marketo__activity_open_email": ["model.marketo_source.stg_marketo__activity_open_email_tmp", "model.marketo_source.stg_marketo__activity_open_email_tmp"], "model.marketo_source.stg_marketo__activity_send_email": ["model.marketo_source.stg_marketo__activity_send_email_tmp", "model.marketo_source.stg_marketo__activity_send_email_tmp"], "model.marketo_source.stg_marketo__email_template_history": ["model.marketo_source.stg_marketo__email_template_history_tmp", "model.marketo_source.stg_marketo__email_template_history_tmp"], "model.marketo_source.stg_marketo__activity_email_bounced": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp", "model.marketo_source.stg_marketo__activity_email_bounced_tmp"], "model.marketo_source.stg_marketo__activity_change_data_value": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp", "model.marketo_source.stg_marketo__activity_change_data_value_tmp"], "model.marketo_source.stg_marketo__lead": ["model.marketo_source.stg_marketo__lead_tmp", "model.marketo_source.stg_marketo__lead_tmp"], "model.marketo_source.stg_marketo__activity_email_delivered": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp", "model.marketo_source.stg_marketo__activity_email_delivered_tmp"], "model.marketo_source.stg_marketo__activity_click_email": ["model.marketo_source.stg_marketo__activity_click_email_tmp", "model.marketo_source.stg_marketo__activity_click_email_tmp"], "model.marketo_source.stg_marketo__lead_describe": ["model.marketo_source.stg_marketo__lead_describe_tmp", "model.marketo_source.stg_marketo__lead_describe_tmp"], "model.marketo_source.stg_marketo__activity_unsubscribe_email": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp", "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"], "model.marketo_source.stg_marketo__activity_email_delivered_tmp": ["source.marketo_source.marketo.activity_email_delivered"], "model.marketo_source.stg_marketo__activity_click_email_tmp": ["source.marketo_source.marketo.activity_click_email"], "model.marketo_source.stg_marketo__campaign_tmp": ["source.marketo_source.marketo.campaign"], "model.marketo_source.stg_marketo__lead_describe_tmp": ["source.marketo_source.marketo.lead_describe"], "model.marketo_source.stg_marketo__activity_change_data_value_tmp": ["source.marketo_source.marketo.activity_change_data_value"], "model.marketo_source.stg_marketo__activity_email_bounced_tmp": ["source.marketo_source.marketo.activity_email_bounced"], "model.marketo_source.stg_marketo__activity_open_email_tmp": ["source.marketo_source.marketo.activity_open_email"], "model.marketo_source.stg_marketo__activity_merge_leads_tmp": ["source.marketo_source.marketo.activity_merge_leads"], "model.marketo_source.stg_marketo__program_tmp": ["source.marketo_source.marketo.program"], "model.marketo_source.stg_marketo__activity_send_email_tmp": ["source.marketo_source.marketo.activity_send_email"], "model.marketo_source.stg_marketo__email_template_history_tmp": ["source.marketo_source.marketo.email_template_history"], "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": ["source.marketo_source.marketo.activity_unsubscribe_email"], "model.marketo_source.stg_marketo__lead_tmp": ["source.marketo_source.marketo.lead"], "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": ["model.marketo_source.stg_marketo__activity_change_data_value"], "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": ["model.marketo_source.stg_marketo__activity_change_data_value"], "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": ["model.marketo_source.stg_marketo__activity_click_email"], "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": ["model.marketo_source.stg_marketo__activity_click_email"], "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": ["model.marketo_source.stg_marketo__activity_email_bounced"], "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": ["model.marketo_source.stg_marketo__activity_email_bounced"], "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": ["model.marketo_source.stg_marketo__activity_email_delivered"], "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": ["model.marketo_source.stg_marketo__activity_email_delivered"], "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": ["model.marketo_source.stg_marketo__activity_open_email"], "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": ["model.marketo_source.stg_marketo__activity_open_email"], "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": ["model.marketo_source.stg_marketo__activity_send_email"], "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": ["model.marketo_source.stg_marketo__activity_send_email"], "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"], "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"], "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": ["model.marketo_source.stg_marketo__email_template_history"], "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": ["model.marketo_source.stg_marketo__email_template_history"], "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": ["model.marketo_source.stg_marketo__lead_describe"], "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": ["model.marketo_source.stg_marketo__lead_describe"], "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": ["model.marketo_source.stg_marketo__lead"], "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": ["model.marketo_source.stg_marketo__lead"], "model.marketo_source.stg_marketo__program": ["model.marketo_source.stg_marketo__program_tmp", "model.marketo_source.stg_marketo__program_tmp"], "model.marketo_source.stg_marketo__campaigns": ["model.marketo_source.stg_marketo__campaign_tmp", "model.marketo_source.stg_marketo__campaign_tmp"], "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": ["model.marketo_source.stg_marketo__program"], "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": ["model.marketo_source.stg_marketo__program"], "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": ["model.marketo_source.stg_marketo__campaigns"], "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": ["model.marketo_source.stg_marketo__campaigns"], "source.marketo_source.marketo.lead": [], "source.marketo_source.marketo.lead_describe": [], "source.marketo_source.marketo.activity_change_data_value": [], "source.marketo_source.marketo.campaign": [], "source.marketo_source.marketo.program": [], "source.marketo_source.marketo.email_template_history": [], "source.marketo_source.marketo.activity_click_email": [], "source.marketo_source.marketo.activity_email_delivered": [], "source.marketo_source.marketo.activity_email_bounced": [], "source.marketo_source.marketo.activity_open_email": [], "source.marketo_source.marketo.activity_unsubscribe_email": [], "source.marketo_source.marketo.activity_send_email": [], "source.marketo_source.marketo.activity_delete_lead": [], "source.marketo_source.marketo.activity_merge_leads": []}, "child_map": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": [], "seed.marketo_source_integration_tests.marketo_email_template_history_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": [], "seed.marketo_source_integration_tests.marketo_lead_describe_data": [], "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": [], "seed.marketo_source_integration_tests.marketo_campaign_data": [], "seed.marketo_source_integration_tests.marketo_program_data": [], "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": [], "seed.marketo_source_integration_tests.marketo_activity_click_email_data": [], "seed.marketo_source_integration_tests.marketo_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_open_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": [], "model.marketo_source.stg_marketo__activity_merge_leads": [], "model.marketo_source.stg_marketo__activity_open_email": ["test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396", "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6"], "model.marketo_source.stg_marketo__activity_send_email": ["test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8", "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1"], "model.marketo_source.stg_marketo__email_template_history": ["test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa", "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2"], "model.marketo_source.stg_marketo__activity_email_bounced": ["test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2", "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3"], "model.marketo_source.stg_marketo__activity_change_data_value": ["test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108", "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd"], "model.marketo_source.stg_marketo__lead": ["test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055", "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f"], "model.marketo_source.stg_marketo__activity_email_delivered": ["test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885", "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87"], "model.marketo_source.stg_marketo__activity_click_email": ["test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd", "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0"], "model.marketo_source.stg_marketo__lead_describe": ["test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879", "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1"], "model.marketo_source.stg_marketo__activity_unsubscribe_email": ["test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0", "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06"], "model.marketo_source.stg_marketo__activity_email_delivered_tmp": ["model.marketo_source.stg_marketo__activity_email_delivered", "model.marketo_source.stg_marketo__activity_email_delivered"], "model.marketo_source.stg_marketo__activity_click_email_tmp": ["model.marketo_source.stg_marketo__activity_click_email", "model.marketo_source.stg_marketo__activity_click_email"], "model.marketo_source.stg_marketo__campaign_tmp": ["model.marketo_source.stg_marketo__campaigns", "model.marketo_source.stg_marketo__campaigns"], "model.marketo_source.stg_marketo__lead_describe_tmp": ["model.marketo_source.stg_marketo__lead_describe", "model.marketo_source.stg_marketo__lead_describe"], "model.marketo_source.stg_marketo__activity_change_data_value_tmp": ["model.marketo_source.stg_marketo__activity_change_data_value", "model.marketo_source.stg_marketo__activity_change_data_value"], "model.marketo_source.stg_marketo__activity_email_bounced_tmp": ["model.marketo_source.stg_marketo__activity_email_bounced", "model.marketo_source.stg_marketo__activity_email_bounced"], "model.marketo_source.stg_marketo__activity_open_email_tmp": ["model.marketo_source.stg_marketo__activity_open_email", "model.marketo_source.stg_marketo__activity_open_email"], "model.marketo_source.stg_marketo__activity_merge_leads_tmp": ["model.marketo_source.stg_marketo__activity_merge_leads", "model.marketo_source.stg_marketo__activity_merge_leads"], "model.marketo_source.stg_marketo__program_tmp": ["model.marketo_source.stg_marketo__program", "model.marketo_source.stg_marketo__program"], "model.marketo_source.stg_marketo__activity_send_email_tmp": ["model.marketo_source.stg_marketo__activity_send_email", "model.marketo_source.stg_marketo__activity_send_email"], "model.marketo_source.stg_marketo__email_template_history_tmp": ["model.marketo_source.stg_marketo__email_template_history", "model.marketo_source.stg_marketo__email_template_history"], "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": ["model.marketo_source.stg_marketo__activity_unsubscribe_email", "model.marketo_source.stg_marketo__activity_unsubscribe_email"], "model.marketo_source.stg_marketo__lead_tmp": ["model.marketo_source.stg_marketo__lead", "model.marketo_source.stg_marketo__lead"], "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": [], "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": [], "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": [], "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": [], "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": [], "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": [], "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": [], "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": [], "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": [], "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": [], "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": [], "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": [], "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": [], "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": [], "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": [], "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": [], "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": [], "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": [], "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": [], "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": [], "model.marketo_source.stg_marketo__program": ["test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f", "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c"], "model.marketo_source.stg_marketo__campaigns": ["test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112", "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925"], "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": [], "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": [], "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": [], "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": [], "source.marketo_source.marketo.lead": ["model.marketo_source.stg_marketo__lead_tmp"], "source.marketo_source.marketo.lead_describe": ["model.marketo_source.stg_marketo__lead_describe_tmp"], "source.marketo_source.marketo.activity_change_data_value": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp"], "source.marketo_source.marketo.campaign": ["model.marketo_source.stg_marketo__campaign_tmp"], "source.marketo_source.marketo.program": ["model.marketo_source.stg_marketo__program_tmp"], "source.marketo_source.marketo.email_template_history": ["model.marketo_source.stg_marketo__email_template_history_tmp"], "source.marketo_source.marketo.activity_click_email": ["model.marketo_source.stg_marketo__activity_click_email_tmp"], "source.marketo_source.marketo.activity_email_delivered": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp"], "source.marketo_source.marketo.activity_email_bounced": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp"], "source.marketo_source.marketo.activity_open_email": ["model.marketo_source.stg_marketo__activity_open_email_tmp"], "source.marketo_source.marketo.activity_unsubscribe_email": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"], "source.marketo_source.marketo.activity_send_email": ["model.marketo_source.stg_marketo__activity_send_email_tmp"], "source.marketo_source.marketo.activity_delete_lead": [], "source.marketo_source.marketo.activity_merge_leads": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp"]}, "group_map": {}} \ No newline at end of file +{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/manifest/v11.json", "dbt_version": "1.7.8", "generated_at": "2024-02-29T15:28:12.192737Z", "invocation_id": "9b425e78-4d62-4b80-9b3f-a4c4a37e5435", "env": {}, "project_name": "marketo_source_integration_tests", "project_id": "a72643f3c0e6cd4df80476b9de14c1e4", "user_id": "2bfa9082-ea6e-467b-abdc-d0514ab111d9", "send_anonymous_usage_stats": true, "adapter_type": "bigquery"}, "nodes": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_send_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_send_email_data.csv", "original_file_path": "seeds/marketo_activity_send_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_send_email_data"], "alias": "marketo_activity_send_email_data", "checksum": {"name": "sha256", "checksum": "fb2bad0f381304d118073d9983f45eb46e5febee8dca957914a648b4ddff637e"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.464355, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_send_email_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_change_data_value_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_change_data_value_data.csv", "original_file_path": "seeds/marketo_activity_change_data_value_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_change_data_value_data"], "alias": "marketo_activity_change_data_value_data", "checksum": {"name": "sha256", "checksum": "50150cbdd92fde6155258db2e872f0ada8aa08c9d1d86b944e4895f9f4b457af"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.472893, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_change_data_value_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_email_template_history_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_email_template_history_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_email_template_history_data.csv", "original_file_path": "seeds/marketo_email_template_history_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data", "fqn": ["marketo_source_integration_tests", "marketo_email_template_history_data"], "alias": "marketo_email_template_history_data", "checksum": {"name": "sha256", "checksum": "88720f1d192884ba6a37ef4b5d7c6d71854d4317881e3c05527c647f3110819c"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.474733, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_email_template_history_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_email_delivered_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_email_delivered_data.csv", "original_file_path": "seeds/marketo_activity_email_delivered_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_email_delivered_data"], "alias": "marketo_activity_email_delivered_data", "checksum": {"name": "sha256", "checksum": "b2243d0565a9b1d4f98aaf79cf1ee52b48f8f2015eea1e748d126925bf15cad6"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.4760451, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_email_delivered_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_lead_describe_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_lead_describe_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_lead_describe_data.csv", "original_file_path": "seeds/marketo_lead_describe_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data", "fqn": ["marketo_source_integration_tests", "marketo_lead_describe_data"], "alias": "marketo_lead_describe_data", "checksum": {"name": "sha256", "checksum": "82b41788229917c7b5e11620f8093c5664ac80b42f055810c66c2c30a22dad65"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.477327, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_lead_describe_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_delete_lead_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_delete_lead_data.csv", "original_file_path": "seeds/marketo_activity_delete_lead_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_delete_lead_data"], "alias": "marketo_activity_delete_lead_data", "checksum": {"name": "sha256", "checksum": "4798018fe3ad445e062842e31f2ab12d165e11784128c0374a24622af39d9851"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.478626, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_delete_lead_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_unsubscribe_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_unsubscribe_email_data.csv", "original_file_path": "seeds/marketo_activity_unsubscribe_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_unsubscribe_email_data"], "alias": "marketo_activity_unsubscribe_email_data", "checksum": {"name": "sha256", "checksum": "9e875888fdd08766cdd8ed980dc75c0fe6d0875af6bd9e32e31df4e1e2e6a1f8"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.479916, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_unsubscribe_email_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_campaign_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_campaign_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_campaign_data.csv", "original_file_path": "seeds/marketo_campaign_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data", "fqn": ["marketo_source_integration_tests", "marketo_campaign_data"], "alias": "marketo_campaign_data", "checksum": {"name": "sha256", "checksum": "c2dec4e9b5d9551cc21da6efb838d60c2d4f1a015c40a7765753bf3bb1f6a56a"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.481345, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_campaign_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_program_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_program_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_program_data.csv", "original_file_path": "seeds/marketo_program_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_program_data", "fqn": ["marketo_source_integration_tests", "marketo_program_data"], "alias": "marketo_program_data", "checksum": {"name": "sha256", "checksum": "b8086d8f192438267b139c516bcccfc9a52364633d951bef3c60254cd002bd55"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.482626, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_program_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_merge_leads_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_merge_leads_data.csv", "original_file_path": "seeds/marketo_activity_merge_leads_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_merge_leads_data"], "alias": "marketo_activity_merge_leads_data", "checksum": {"name": "sha256", "checksum": "24ad90300354e3399ee9da754c62c3d76e3d36f3d57be16c71e7734545a104a8"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.4838889, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_merge_leads_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_click_email_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_click_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_click_email_data.csv", "original_file_path": "seeds/marketo_activity_click_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_click_email_data"], "alias": "marketo_activity_click_email_data", "checksum": {"name": "sha256", "checksum": "97c60db60ffb7cef6797417f9eeeed5c72e0f8e8a0001972911b2b74884591c5"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.4851441, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_click_email_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_lead_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_lead_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_lead_data.csv", "original_file_path": "seeds/marketo_lead_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data", "fqn": ["marketo_source_integration_tests", "marketo_lead_data"], "alias": "marketo_lead_data", "checksum": {"name": "sha256", "checksum": "f31f8f352f46ccc6cbb1a26d0f277aff3b231a8cc8b79a948962b90687566a1a"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.486599, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_lead_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_open_email_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_open_email_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_open_email_data.csv", "original_file_path": "seeds/marketo_activity_open_email_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_open_email_data"], "alias": "marketo_activity_open_email_data", "checksum": {"name": "sha256", "checksum": "c2e6f02fb886b1acf308d01f7ac0c8123d6bf83ed235e93cf776d0b03bf48194"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.48786, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_open_email_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "marketo_activity_email_bounced_data", "resource_type": "seed", "package_name": "marketo_source_integration_tests", "path": "marketo_activity_email_bounced_data.csv", "original_file_path": "seeds/marketo_activity_email_bounced_data.csv", "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data", "fqn": ["marketo_source_integration_tests", "marketo_activity_email_bounced_data"], "alias": "marketo_activity_email_bounced_data", "checksum": {"name": "sha256", "checksum": "84ad6102d1351832188e16498b2b5253479cbe9e5fd9d77ccb9f97b210af8f67"}, "config": {"enabled": true, "alias": null, "schema": null, "database": null, "tags": [], "meta": {}, "group": null, "materialized": "seed", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "delimiter": ",", "quote_columns": null}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220403.489121, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_email_bounced_data`", "raw_code": "", "root_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "depends_on": {"macros": []}}, "model.marketo_source.stg_marketo__activity_merge_leads": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_merge_leads", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_merge_leads.sql", "original_file_path": "models/stg_marketo__activity_merge_leads.sql", "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads", "fqn": ["marketo_source", "stg_marketo__activity_merge_leads"], "alias": "stg_marketo__activity_merge_leads", "checksum": {"name": "sha256", "checksum": "d0c946ed7fab89435ed0a3de1fca940a6e3e5d8a89e49dc8d32d1545690f7164"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "Table with merged lead activities", "columns": {"activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merged_lead_id": {"name": "merged_lead_id", "description": "ID of the lead that the lead was merged into.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "master_updated": {"name": "master_updated", "description": "Boolean if master was updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merge_source": {"name": "merge_source", "description": "Source of the merge.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merged_in_sales": {"name": "merged_in_sales", "description": "Boolean if merged in sales.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.994345, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_merge_leads_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_merge_leads_tmp')),\n staging_columns=get_activity_merge_leads_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n cast(lead_id as {{ dbt.type_int() }}) as lead_id,\n master_updated,\n cast(replace(trim(trim(merge_ids,']'),'['), ',', ', ') as {{ dbt.type_string() }}) as merged_lead_id,\n merge_source,\n merged_in_sales,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_merge_leads_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_merge_leads_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_merge_leads_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"], "nodes": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_merge_leads.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads_tmp`\n\n), macro as (\n\n select\n \n \n \n _fivetran_synced\n \n as \n \n _fivetran_synced\n \n, \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n master_updated\n \n as \n \n master_updated\n \n, \n \n \n merge_ids\n \n as \n \n merge_ids\n \n, \n \n \n merge_source\n \n as \n \n merge_source\n \n, \n \n \n merged_in_sales\n \n as \n \n merged_in_sales\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n cast(lead_id as INT64) as lead_id,\n master_updated,\n cast(replace(trim(trim(merge_ids,']'),'['), ',', ', ') as string) as merged_lead_id,\n merge_source,\n merged_in_sales,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_open_email": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_open_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_open_email.sql", "original_file_path": "models/stg_marketo__activity_open_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_open_email", "fqn": ["marketo_source", "stg_marketo__activity_open_email"], "alias": "stg_marketo__activity_open_email", "checksum": {"name": "sha256", "checksum": "1a2a4bd5e302bc781fe9297ef000dab7c24b639267cc6c6aabf9873484bdc9ab"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Identifies whether a mobile device was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "platform": {"name": "platform", "description": "The platform that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.982829, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_open_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_open_email_tmp')),\n staging_columns=get_activity_open_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_open_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_open_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_open_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_send_email": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_send_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_send_email.sql", "original_file_path": "models/stg_marketo__activity_send_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_send_email", "fqn": ["marketo_source", "stg_marketo__activity_send_email"], "alias": "stg_marketo__activity_send_email", "checksum": {"name": "sha256", "checksum": "ddb3c66943091e1448ef6ecd7db0a026b3b967ed6853228bfb04e92667d0789f"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.983331, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_send_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_send_email_tmp')),\n staging_columns=get_activity_send_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n\n {{ fivetran_utils.fill_pass_through_columns('marketo__activity_send_email_passthrough_columns') }}\n\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_send_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_send_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.fivetran_utils.fill_pass_through_columns", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_send_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n\n \n\n\n\n\n\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__email_template_history": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__email_template_history", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__email_template_history.sql", "original_file_path": "models/stg_marketo__email_template_history.sql", "unique_id": "model.marketo_source.stg_marketo__email_template_history", "fqn": ["marketo_source", "stg_marketo__email_template_history"], "alias": "stg_marketo__email_template_history", "checksum": {"name": "sha256", "checksum": "97162d775e448bbc12c74be0edebd8c57571129d1d23298c0f415e0cd000e348"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"email_template_history_id": {"name": "email_template_history_id", "description": "ID of the version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp the email template was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_subject": {"name": "email_subject", "description": "Subject line of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "ID of the email template", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_name": {"name": "email_template_name", "description": "Name of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_status": {"name": "email_template_status", "description": "Status filter for draft or approved versions.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_url": {"name": "email_template_url", "description": "URL of the email template in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_name": {"name": "folder_name", "description": "The name of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_value": {"name": "folder_value", "description": "The value of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_email": {"name": "from_email", "description": "The 'From' address of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_name": {"name": "from_name", "description": "The 'From' name of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "has_web_view_enabled": {"name": "has_web_view_enabled", "description": "Whether 'View as Webpage' function is enabled for the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_version": {"name": "inferred_version", "description": "Incrementing integer version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_most_recent_version": {"name": "is_most_recent_version", "description": "Whether it is the most recent version of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_operational": {"name": "is_operational", "description": "Whether the email is operational. Operational emails bypass unsubscribe status. Defaults to false.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_text_only": {"name": "is_text_only", "description": "Setting to include text-only version of email when sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "parent_template_id": {"name": "parent_template_id", "description": "ID of the parent template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "The ID of the email template's program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "publish_to_msi": {"name": "publish_to_msi", "description": "Whether the email is published to Marketo Sales Insight.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reply_email": {"name": "reply_email", "description": "Reply-To address of the Email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "total_count_of_versions": {"name": "total_count_of_versions", "description": "Count of versions of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp the email template was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "valid_from": {"name": "valid_from", "description": "When the version of the email template was is valid from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "valid_to": {"name": "valid_to", "description": "When the version of the email template was is valid to.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "version_type": {"name": "version_type", "description": "The type version of the email, either '1' or '2'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.9886599, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__email_template_history_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__email_template_history_tmp')),\n staging_columns=get_email_template_history_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n created_at as created_timestamp,\n description,\n folder_folder_name as folder_name,\n folder_id,\n folder_type,\n folder_value,\n from_email,\n from_name,\n id as email_template_id,\n name as email_template_name,\n operational as is_operational,\n program_id,\n publish_to_msi,\n reply_email,\n status as email_template_status,\n subject as email_subject,\n template as parent_template_id,\n text_only as is_text_only,\n updated_at as updated_timestamp,\n url as email_template_url,\n version as version_type,\n web_view as has_web_view_enabled,\n workspace as workspace_name\n from macro\n\n), versions as (\n\n select \n *,\n row_number() over (partition by email_template_id order by updated_timestamp) as inferred_version,\n count(*) over (partition by email_template_id) as total_count_of_versions\n from fields\n\n), valid as (\n\n select \n *, \n case\n when inferred_version = 1 then created_timestamp\n else updated_timestamp\n end as valid_from,\n lead(updated_timestamp) over (partition by email_template_id order by updated_timestamp) as valid_to,\n inferred_version = total_count_of_versions as is_most_recent_version\n from versions\n\n), surrogate_key as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['email_template_id','inferred_version'] )}} as email_template_history_id\n from valid\n\n)\n\nselect *\nfrom surrogate_key", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history_tmp", "package": null, "version": null}, {"name": "stg_marketo__email_template_history_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_email_template_history_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__email_template_history_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__email_template_history.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n description\n \n as \n \n description\n \n, \n \n \n folder_folder_name\n \n as \n \n folder_folder_name\n \n, \n \n \n folder_id\n \n as \n \n folder_id\n \n, \n \n \n folder_type\n \n as \n \n folder_type\n \n, \n \n \n folder_value\n \n as \n \n folder_value\n \n, \n \n \n from_email\n \n as \n \n from_email\n \n, \n \n \n from_name\n \n as \n \n from_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n name\n \n as \n \n name\n \n, \n \n \n operational\n \n as \n \n operational\n \n, \n \n \n program_id\n \n as \n \n program_id\n \n, \n \n \n publish_to_msi\n \n as \n \n publish_to_msi\n \n, \n \n \n reply_email\n \n as \n \n reply_email\n \n, \n \n \n status\n \n as \n \n status\n \n, \n \n \n subject\n \n as \n \n subject\n \n, \n \n \n template\n \n as \n \n template\n \n, \n \n \n text_only\n \n as \n \n text_only\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n, \n \n \n url\n \n as \n \n url\n \n, \n \n \n version\n \n as \n \n version\n \n, \n \n \n web_view\n \n as \n \n web_view\n \n, \n \n \n workspace\n \n as \n \n workspace\n \n\n\n\n from base\n\n), fields as (\n\n select \n created_at as created_timestamp,\n description,\n folder_folder_name as folder_name,\n folder_id,\n folder_type,\n folder_value,\n from_email,\n from_name,\n id as email_template_id,\n name as email_template_name,\n operational as is_operational,\n program_id,\n publish_to_msi,\n reply_email,\n status as email_template_status,\n subject as email_subject,\n template as parent_template_id,\n text_only as is_text_only,\n updated_at as updated_timestamp,\n url as email_template_url,\n version as version_type,\n web_view as has_web_view_enabled,\n workspace as workspace_name\n from macro\n\n), versions as (\n\n select \n *,\n row_number() over (partition by email_template_id order by updated_timestamp) as inferred_version,\n count(*) over (partition by email_template_id) as total_count_of_versions\n from fields\n\n), valid as (\n\n select \n *, \n case\n when inferred_version = 1 then created_timestamp\n else updated_timestamp\n end as valid_from,\n lead(updated_timestamp) over (partition by email_template_id order by updated_timestamp) as valid_to,\n inferred_version = total_count_of_versions as is_most_recent_version\n from versions\n\n), surrogate_key as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(email_template_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(inferred_version as string), '_dbt_utils_surrogate_key_null_') as string))) as email_template_history_id\n from valid\n\n)\n\nselect *\nfrom surrogate_key", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_email_bounced": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_bounced", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_email_bounced.sql", "original_file_path": "models/stg_marketo__activity_email_bounced.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced", "fqn": ["marketo_source", "stg_marketo__activity_email_bounced"], "alias": "stg_marketo__activity_email_bounced", "checksum": {"name": "sha256", "checksum": "753f37b9c30bc8d70b6eda0c72605ec91c320eb1b05e832c393cda5ab921a6c6"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "bounce_category": {"name": "bounce_category", "description": "The category associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "bounce_subcategory": {"name": "bounce_subcategory", "description": "The subcategory associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "details": {"name": "details", "description": "Details about why the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_address": {"name": "email_address", "description": "The email address that bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.9817019, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_email_bounced_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_email_bounced_tmp')),\n staging_columns=get_activity_email_bounced_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n category as bounce_category,\n choice_number,\n details,\n email as email_address,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n subcategory as bounce_subcategory\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_email_bounced_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_email_bounced_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_email_bounced.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n category\n \n as \n \n category\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n details\n \n as \n \n details\n \n, \n \n \n email\n \n as \n \n email\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n \n \n subcategory\n \n as \n \n subcategory\n \n, \n cast(null as INT64) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n category as bounce_category,\n choice_number,\n details,\n email as email_address,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n subcategory as bounce_subcategory\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_change_data_value": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_change_data_value", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_change_data_value.sql", "original_file_path": "models/stg_marketo__activity_change_data_value.sql", "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value", "fqn": ["marketo_source", "stg_marketo__activity_change_data_value"], "alias": "stg_marketo__activity_change_data_value", "checksum": {"name": "sha256", "checksum": "16a382cec11b4b08da9f9bc6a11d51ccbeb7d985b1c6ffd22e81adff5b9f71da"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "Timestamp of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "api_method_name": {"name": "api_method_name", "description": "API method used for change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "change_reason": {"name": "change_reason", "description": "Reason for the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "change_source": {"name": "change_source", "description": "Source of the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "Id of the lead associated to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "modifying_user_id": {"name": "modifying_user_id", "description": "The user who instigated the change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "new_value": {"name": "new_value", "description": "New value after the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "old_value": {"name": "old_value", "description": "Old value before the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "Value of the primary attribute.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "ID of the primary attribute field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "request_id": {"name": "request_id", "description": "ID of the request made.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.979319, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_change_data_value_tmp') }}\n\n), macro as (\n\n select \n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_change_data_value_tmp')),\n staging_columns=get_activity_change_data_value_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n api_method_name,\n campaign_id,\n id as activity_id,\n lead_id,\n modifying_user as modifying_user_id,\n new_value,\n old_value,\n primary_attribute_value,\n primary_attribute_value_id,\n reason as change_reason,\n request_id,\n source as change_source\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_change_data_value_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_change_data_value_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_change_data_value.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value_tmp`\n\n), macro as (\n\n select \n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n api_method_name\n \n as \n \n api_method_name\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n modifying_user\n \n as \n \n modifying_user\n \n, \n \n \n new_value\n \n as \n \n new_value\n \n, \n \n \n old_value\n \n as \n \n old_value\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n reason\n \n as \n \n reason\n \n, \n \n \n request_id\n \n as \n \n request_id\n \n, \n \n \n source\n \n as \n \n source\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n api_method_name,\n campaign_id,\n id as activity_id,\n lead_id,\n modifying_user as modifying_user_id,\n new_value,\n old_value,\n primary_attribute_value,\n primary_attribute_value_id,\n reason as change_reason,\n request_id,\n source as change_source\n from macro\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_delete_lead": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_delete_lead", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_delete_lead.sql", "original_file_path": "models/stg_marketo__activity_delete_lead.sql", "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead", "fqn": ["marketo_source", "stg_marketo__activity_delete_lead"], "alias": "stg_marketo__activity_delete_lead", "checksum": {"name": "sha256", "checksum": "6292ea92f47a23c77b7d04e7add11037d84706a4d4aba0991e1e9101d18474d9"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "Table with deleted lead activities", "columns": {"activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_name": {"name": "campaign_name", "description": "The name of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": true}, "created_at": 1709220403.993314, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead`", "raw_code": "{{ config(enabled=var('marketo__activity_delete_lead_enabled', True)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__activity_delete_lead_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_delete_lead_tmp')),\n staging_columns=get_activity_delete_lead_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign as campaign_name,\n campaign_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__activity_delete_lead_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_delete_lead_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_delete_lead_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp"], "nodes": ["model.marketo_source.stg_marketo__activity_delete_lead_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_delete_lead.sql", "compiled": true, "compiled_code": "\n\nwith base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead_tmp`\n\n), macro as (\n\n select\n \n \n \n _fivetran_synced\n \n as \n \n _fivetran_synced\n \n, \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign\n \n as \n \n campaign\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign as campaign_name,\n campaign_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__lead": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__lead.sql", "original_file_path": "models/stg_marketo__lead.sql", "unique_id": "model.marketo_source.stg_marketo__lead", "fqn": ["marketo_source", "stg_marketo__lead"], "alias": "stg_marketo__lead", "checksum": {"name": "sha256", "checksum": "5eb998d2c1b6a6fc4e2a7d739f41bbe376d9fb73756975a96e3392b2b5a7f2fd"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"lead_id": {"name": "lead_id", "description": "ID of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "The timestamp at which each lead object was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "The timestamp at which each lead object was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "first_name": {"name": "first_name", "description": "The first name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "last_name": {"name": "last_name", "description": "The last name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "phone": {"name": "phone", "description": "Lead\u2019s Phone Number.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "main_phone": {"name": "main_phone", "description": "Primary phone number of the lead\u2019s company", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "mobile_phone": {"name": "mobile_phone", "description": "Lead\u2019s mobile phone number", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "company": {"name": "company", "description": "Lead\u2019s company name", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_company": {"name": "inferred_company", "description": "Company name inferred by reverse IP lookup of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "address_lead": {"name": "address_lead", "description": "Second address associated with the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "address": {"name": "address", "description": "Lead\u2019s address.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "city": {"name": "city", "description": "Lead\u2019s city", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "state": {"name": "state", "description": "Lead\u2019s state", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "state_code": {"name": "state_code", "description": "Alpha-2 code of the Lead\u2019s state", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "country": {"name": "country", "description": "Lead\u2019s country", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "country_code": {"name": "country_code", "description": "Alpha-2 code of the Lead\u2019s country", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "postal_code": {"name": "postal_code", "description": "Lead\u2019s postal code", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_street": {"name": "billing_street", "description": "Billing street address of the lead\u2019s company", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_city": {"name": "billing_city", "description": "City of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_state": {"name": "billing_state", "description": "State or province of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_state_code": {"name": "billing_state_code", "description": "Alpha-2 code of the state or province of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_country": {"name": "billing_country", "description": "Country of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_country_code": {"name": "billing_country_code", "description": "Alpha-2 code of the country of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_postal_code": {"name": "billing_postal_code", "description": "Postal code of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_city": {"name": "inferred_city", "description": "Lead\u2019s city inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_state_region": {"name": "inferred_state_region", "description": "Lead\u2019s state region inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_country": {"name": "inferred_country", "description": "Country inferred by reverse IP lookup of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_postal_code": {"name": "inferred_postal_code", "description": "Lead\u2019s postal code inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_phone_area_code": {"name": "inferred_phone_area_code", "description": "Lead\u2019s phone area code inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "anonymous_ip": {"name": "anonymous_ip", "description": "IP address of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_unsubscribed": {"name": "is_unsubscribed", "description": "Lead\u2019s email-unsubscribed status (boolean). Partially system managed. Will prevent receipt of non-operational emails if set to true.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_email_invalid": {"name": "is_email_invalid", "description": "Email invalid status (boolean). All emails to the address will be blocked if set to true. Bounces indicating that the email is invalid will automatically set this field to true.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "do_not_call": {"name": "do_not_call", "description": "Lead\u2019s do-not-call preference (boolean)", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.9915462, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__lead_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__lead_tmp')),\n staging_columns=get_lead_columns()\n )\n }}\n -- This will check if there are non-default columns to bring in\n {% set default_cols = ['id', 'created_at', 'updated_at', 'email', 'first_name', 'last_name', '_fivetran_synced',\n 'phone', 'main_phone', 'mobile_phone', 'company', 'inferred_company', 'address_lead', 'address', 'city', 'state',\n 'state_code', 'country', 'country_code', 'postal_code', 'billing_street', 'billing_city', 'billing_state', \n 'billing_state_code', 'billing_country', 'billing_country_code', 'billing_postal_code', 'inferred_city', 'inferred_state_region', \n 'inferred_country', 'inferred_postal_code', 'inferred_phone_area_code', 'anonymous_ip', 'unsubscribed', 'email_invalid', 'do_not_call'] %}\n \n {% set new_cols = dbt_utils.star(from=ref('stg_marketo__lead_tmp'), except=default_cols) %}\n {% if new_cols != '/* no columns returned from star() macro */' %}\n ,{{ new_cols }} \n {% endif %}\n \n from base\n\n)\n\nselect *\nfrom macro", "language": "sql", "refs": [{"name": "stg_marketo__lead_tmp", "package": null, "version": null}, {"name": "stg_marketo__lead_tmp", "package": null, "version": null}, {"name": "stg_marketo__lead_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_lead_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt_utils.star"], "nodes": ["model.marketo_source.stg_marketo__lead_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__lead.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as created_timestamp , \n \n \n email\n \n as \n \n email\n \n, \n \n \n first_name\n \n as \n \n first_name\n \n, \n \n \n id\n \n as lead_id , \n \n \n last_name\n \n as \n \n last_name\n \n, \n \n \n updated_at\n \n as updated_timestamp , \n cast(null as string) as \n \n phone\n \n , \n cast(null as string) as \n \n main_phone\n \n , \n cast(null as string) as \n \n mobile_phone\n \n , \n cast(null as string) as \n \n company\n \n , \n cast(null as string) as \n \n inferred_company\n \n , \n cast(null as string) as \n \n address_lead\n \n , \n cast(null as string) as \n \n address\n \n , \n cast(null as string) as \n \n city\n \n , \n cast(null as string) as \n \n state\n \n , \n cast(null as string) as \n \n state_code\n \n , \n cast(null as string) as \n \n country\n \n , \n cast(null as string) as \n \n country_code\n \n , \n cast(null as string) as \n \n postal_code\n \n , \n cast(null as string) as \n \n billing_street\n \n , \n cast(null as string) as \n \n billing_city\n \n , \n cast(null as string) as \n \n billing_state\n \n , \n cast(null as string) as \n \n billing_state_code\n \n , \n cast(null as string) as \n \n billing_country\n \n , \n cast(null as string) as \n \n billing_country_code\n \n , \n cast(null as string) as \n \n billing_postal_code\n \n , \n cast(null as string) as \n \n inferred_city\n \n , \n cast(null as string) as \n \n inferred_state_region\n \n , \n cast(null as string) as \n \n inferred_country\n \n , \n cast(null as string) as \n \n inferred_postal_code\n \n , \n cast(null as string) as \n \n inferred_phone_area_code\n \n , \n cast(null as string) as \n \n anonymous_ip\n \n , \n cast(null as boolean) as is_unsubscribed , \n cast(null as boolean) as is_email_invalid , \n cast(null as boolean) as \n \n do_not_call\n \n \n\n\n -- This will check if there are non-default columns to bring in\n \n \n \n \n \n from base\n\n)\n\nselect *\nfrom macro", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_email_delivered": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_delivered", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_email_delivered.sql", "original_file_path": "models/stg_marketo__activity_email_delivered.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered", "fqn": ["marketo_source", "stg_marketo__activity_email_delivered"], "alias": "stg_marketo__activity_email_delivered", "checksum": {"name": "sha256", "checksum": "e728feee6ece5169f52932e6da4505652ddc4a6dfea62ea64fedf31089727f4e"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the email was delivered.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.982207, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_email_delivered_tmp') }}\n\n), macro as (\n\n select \n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_email_delivered_tmp')),\n staging_columns=get_activity_email_delivered_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id, \n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_email_delivered_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_email_delivered_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_email_delivered.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered_tmp`\n\n), macro as (\n\n select \n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id, \n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_click_email": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_click_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_click_email.sql", "original_file_path": "models/stg_marketo__activity_click_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_click_email", "fqn": ["marketo_source", "stg_marketo__activity_click_email"], "alias": "stg_marketo__activity_click_email", "checksum": {"name": "sha256", "checksum": "0ebc3224a6a77f9be542e93fcafdc8ab408bcc0ef43d55ac53fac3a787466d54"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "Timestamp of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "click_device": {"name": "click_device", "description": "The device type the activity occurred on.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "click_link_url": {"name": "click_link_url", "description": "The URL of the link clicked.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Whether the activity occurred on a mobile device.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The Web browser user agent information obtained when the lead clicked the email link.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_platform": {"name": "user_platform", "description": "The user's operating platform.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.9806678, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_click_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_click_email_tmp')),\n staging_columns=get_activity_click_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device as click_device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n link as click_link_url,\n platform as user_platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_click_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_click_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_click_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n link\n \n as \n \n link\n \n, \n cast(null as string) as \n \n link_id\n \n , \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device as click_device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n link as click_link_url,\n platform as user_platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__lead_describe": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_describe", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__lead_describe.sql", "original_file_path": "models/stg_marketo__lead_describe.sql", "unique_id": "model.marketo_source.stg_marketo__lead_describe", "fqn": ["marketo_source", "stg_marketo__lead_describe"], "alias": "stg_marketo__lead_describe", "checksum": {"name": "sha256", "checksum": "9c4c01161855f5da7ecfcfcb6e37be812b71b0cb2b29b130d896d6abcd3b89a1"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"lead_describe_id": {"name": "lead_describe_id", "description": "ID of the description.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "data_type": {"name": "data_type", "description": "Datatype of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "display_name": {"name": "display_name", "description": "UI display-name of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "field_max_length": {"name": "field_max_length", "description": "Max length of the field. Only applicable to text, string, and text area.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_rest_readonly": {"name": "is_rest_readonly", "description": "Whether the field is only available via the REST API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_soap_readonly": {"name": "is_soap_readonly", "description": "Whether the field is only available via the SOAP API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "rest_name": {"name": "rest_name", "description": "Description of REST API usage attributes in camel case.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "rest_name_xf": {"name": "rest_name_xf", "description": "Description of REST API usage attributes in snake case.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soap_name": {"name": "soap_name", "description": "Description of SOAP API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.990129, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__lead_describe_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__lead_describe_tmp')),\n staging_columns=get_lead_describe_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n data_type,\n display_name,\n id as lead_describe_id,\n length as field_max_length,\n restname as rest_name,\n restread_only as is_rest_readonly,\n soapname as soap_name,\n soapread_only as is_soap_readonly\n from macro\n\n), regex as (\n\n select \n *,\n case\n when rest_name like '%\\\\_\\\\_c%' then lower(rest_name)\n else ltrim(lower(regexp_replace(rest_name, '[A-Z]','_\\\\0')),'_')\n end as rest_name_xf\n from fields\n\n)\n\nselect *\nfrom regex", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe_tmp", "package": null, "version": null}, {"name": "stg_marketo__lead_describe_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_lead_describe_columns", "macro.fivetran_utils.fill_staging_columns"], "nodes": ["model.marketo_source.stg_marketo__lead_describe_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__lead_describe.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n data_type\n \n as \n \n data_type\n \n, \n \n \n display_name\n \n as \n \n display_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n length\n \n as \n \n length\n \n, \n \n \n restname\n \n as \n \n restname\n \n, \n \n \n restread_only\n \n as \n \n restread_only\n \n, \n \n \n soapname\n \n as \n \n soapname\n \n, \n \n \n soapread_only\n \n as \n \n soapread_only\n \n\n\n\n from base\n\n), fields as (\n\n select\n data_type,\n display_name,\n id as lead_describe_id,\n length as field_max_length,\n restname as rest_name,\n restread_only as is_rest_readonly,\n soapname as soap_name,\n soapread_only as is_soap_readonly\n from macro\n\n), regex as (\n\n select \n *,\n case\n when rest_name like '%\\\\_\\\\_c%' then lower(rest_name)\n else ltrim(lower(regexp_replace(rest_name, '[A-Z]','_\\\\0')),'_')\n end as rest_name_xf\n from fields\n\n)\n\nselect *\nfrom regex", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_unsubscribe_email": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_unsubscribe_email", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__activity_unsubscribe_email.sql", "original_file_path": "models/stg_marketo__activity_unsubscribe_email.sql", "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email", "fqn": ["marketo_source", "stg_marketo__activity_unsubscribe_email"], "alias": "stg_marketo__activity_unsubscribe_email", "checksum": {"name": "sha256", "checksum": "f4edf9b66113b6470b0bd0e8eae2726d3de6c2545e904944f706dcfb39ab2f4e"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"activity_id": {"name": "activity_id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_timestamp": {"name": "activity_timestamp", "description": "The timestamp the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "client_ip_address": {"name": "client_ip_address", "description": "The IP address of the client that unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_send_id": {"name": "email_send_id", "description": "The inferred ID for the email sent. This is created by concatenating primary_attribute_value_id, campaign_id, campaign_run_id, and lead_id.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "form_fields": {"name": "form_fields", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "query_parameters": {"name": "query_parameters", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "referrer_url": {"name": "referrer_url", "description": "The URL of the referrer used to identify where the form visit originated from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webform_id": {"name": "webform_id", "description": "The ID of the unsubscribe web page.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webpage_id": {"name": "webpage_id", "description": "The ID of the unsubscribe web form.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source"}, "created_at": 1709220403.9839349, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`", "raw_code": "with base as (\n\n select *\n from {{ ref('stg_marketo__activity_unsubscribe_email_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__activity_unsubscribe_email_tmp')),\n staging_columns=get_activity_unsubscribe_email_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as {{ dbt.type_timestamp() }}) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n client_ip_address,\n email_template_id,\n form_fields,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n query_parameters,\n referrer_url,\n user_agent,\n webform_id,\n webpage_id\n from macro\n\n), surrogate as (\n\n select \n *,\n {{ dbt_utils.generate_surrogate_key(['primary_attribute_value_id','campaign_id','campaign_run_id','lead_id']) }} as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email_tmp", "package": null, "version": null}, {"name": "stg_marketo__activity_unsubscribe_email_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_activity_unsubscribe_email_columns", "macro.fivetran_utils.fill_staging_columns", "macro.dbt.type_timestamp", "macro.dbt_utils.generate_surrogate_key"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo__activity_unsubscribe_email.sql", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n client_ip_address\n \n as \n \n client_ip_address\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n form_fields\n \n as \n \n form_fields\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n query_parameters\n \n as \n \n query_parameters\n \n, \n \n \n referrer_url\n \n as \n \n referrer_url\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n, \n \n \n webform_id\n \n as \n \n webform_id\n \n, \n \n \n webpage_id\n \n as \n \n webpage_id\n \n\n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n client_ip_address,\n email_template_id,\n form_fields,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n query_parameters,\n referrer_url,\n user_agent,\n webform_id,\n webpage_id\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_email_delivered_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_delivered_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_email_delivered_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_email_delivered_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_email_delivered_tmp"], "alias": "stg_marketo__activity_email_delivered_tmp", "checksum": {"name": "sha256", "checksum": "03d7cae101b001a26032fe121d383f8193c9afdbdc74d254ac9789866c147712"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.8267782, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered_tmp`", "raw_code": "select *\nfrom {{ var('activity_email_delivered') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_email_delivered"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_email_delivered_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_email_delivered_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_click_email_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_click_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_click_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_click_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_click_email_tmp"], "alias": "stg_marketo__activity_click_email_tmp", "checksum": {"name": "sha256", "checksum": "b67805a9d05eb09cbc1247b1ff20a6eabba87b3722faa7ae62ce01f36c8034f5"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.831601, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email_tmp`", "raw_code": "select *\nfrom {{ var('activity_click_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_click_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_click_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_click_email_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__lead_describe_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_describe_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__lead_describe_tmp.sql", "original_file_path": "models/tmp/stg_marketo__lead_describe_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__lead_describe_tmp"], "alias": "stg_marketo__lead_describe_tmp", "checksum": {"name": "sha256", "checksum": "076bb0dc6b5d12d6e0fd74312fc060487b1631f4407698e4242d162d4a06b26c"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.8391318, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe_tmp`", "raw_code": "select *\nfrom {{ var('lead_describe') }}", "language": "sql", "refs": [], "sources": [["marketo", "lead_describe"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__lead_describe_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_lead_describe_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_delete_lead_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_delete_lead_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_delete_lead_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_delete_lead_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_delete_lead_tmp"], "alias": "stg_marketo__activity_delete_lead_tmp", "checksum": {"name": "sha256", "checksum": "c117443fd98cebcfa1400ed04ad0efa75858e7bcdbe3101bed1f332214a140ae"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": true}, "created_at": 1709220403.8427231, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead_tmp`", "raw_code": "{{ config(enabled=var('marketo__activity_delete_lead_enabled', True)) }}\n\nselect *\nfrom {{ var('activity_delete_lead') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_delete_lead"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_delete_lead"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_delete_lead_tmp.sql", "compiled": true, "compiled_code": "\n\nselect *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_delete_lead_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_change_data_value_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_change_data_value_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_change_data_value_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_change_data_value_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_change_data_value_tmp"], "alias": "stg_marketo__activity_change_data_value_tmp", "checksum": {"name": "sha256", "checksum": "2515768903723472b6b2c63204e07b3be741b6a60d054ad6278eb11e45635ba4"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.847158, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value_tmp`", "raw_code": "select *\nfrom {{ var('activity_change_data_value') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_change_data_value"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_change_data_value_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_change_data_value_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_email_bounced_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_email_bounced_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_email_bounced_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_email_bounced_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_email_bounced_tmp"], "alias": "stg_marketo__activity_email_bounced_tmp", "checksum": {"name": "sha256", "checksum": "ada6078aa5f9aa9542680709f13ef4f41a939793dba1dd7e95573daf9631a123"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.850698, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced_tmp`", "raw_code": "select *\nfrom {{ var('activity_email_bounced') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_email_bounced"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_email_bounced_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_email_bounced_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_open_email_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_open_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_open_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_open_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_open_email_tmp"], "alias": "stg_marketo__activity_open_email_tmp", "checksum": {"name": "sha256", "checksum": "da68d24a0e5cd5e2ea04461ba30829224d9be0645527c7750e112770f62904b8"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.854177, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email_tmp`", "raw_code": "select *\nfrom {{ var('activity_open_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_open_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_open_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_open_email_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_merge_leads_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_merge_leads_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_merge_leads_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_merge_leads_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_merge_leads_tmp"], "alias": "stg_marketo__activity_merge_leads_tmp", "checksum": {"name": "sha256", "checksum": "05aefa5e82e1e7f9db39f760ca7e05f55f20d3ebab1a42d9f7a9ebac76575cc4"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.857693, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads_tmp`", "raw_code": "select *\nfrom {{ var('activity_merge_leads') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_merge_leads"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_merge_leads"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_merge_leads_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_merge_leads_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_send_email_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_send_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_send_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_send_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_send_email_tmp"], "alias": "stg_marketo__activity_send_email_tmp", "checksum": {"name": "sha256", "checksum": "6f71b2d1da249e72e6d0aa1fdf30561c20d2b70ff4dcee478c3c53d3151216d3"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.865721, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email_tmp`", "raw_code": "select *\nfrom {{ var('activity_send_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_send_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_send_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_send_email_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__email_template_history_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__email_template_history_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__email_template_history_tmp.sql", "original_file_path": "models/tmp/stg_marketo__email_template_history_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__email_template_history_tmp"], "alias": "stg_marketo__email_template_history_tmp", "checksum": {"name": "sha256", "checksum": "ecf5e126aa9ce3fff1c7b4228a14ebf0444ecb9e53aa8f583ce9d232f87cf36b"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.869195, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history_tmp`", "raw_code": "select *\nfrom {{ var('email_template_history') }}", "language": "sql", "refs": [], "sources": [["marketo", "email_template_history"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__email_template_history_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_email_template_history_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__activity_unsubscribe_email_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "original_file_path": "models/tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__activity_unsubscribe_email_tmp"], "alias": "stg_marketo__activity_unsubscribe_email_tmp", "checksum": {"name": "sha256", "checksum": "19738f0a7d3263170f9d960d9fc7d9dfbad9bce271459e9668836f4e47a2f01d"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.872712, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email_tmp`", "raw_code": "select *\nfrom {{ var('activity_unsubscribe_email') }}", "language": "sql", "refs": [], "sources": [["marketo", "activity_unsubscribe_email"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__activity_unsubscribe_email_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_unsubscribe_email_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "model.marketo_source.stg_marketo__lead_tmp": {"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__lead_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__lead_tmp.sql", "original_file_path": "models/tmp/stg_marketo__lead_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__lead_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__lead_tmp"], "alias": "stg_marketo__lead_tmp", "checksum": {"name": "sha256", "checksum": "cec09aa5677c43f456ec365938c4b21611d022a736b30011e46ceec99e8b44ea"}, "config": {"enabled": true, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source"}, "created_at": 1709220403.87617, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_tmp`", "raw_code": "select *\nfrom {{ var('lead') }}", "language": "sql", "refs": [], "sources": [["marketo", "lead"]], "metrics": [], "depends_on": {"macros": [], "nodes": ["source.marketo_source.marketo.lead"]}, "compiled_path": "target/compiled/marketo_source/models/tmp/stg_marketo__lead_tmp.sql", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_lead_data`", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null}, "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_change_data_value')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_change_data_value_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_change_data_value_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd", "fqn": ["marketo_source", "unique_stg_marketo__activity_change_data_value_activity_id"], "alias": "unique_stg_marketo__activity_change_data_value_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0397272, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_change_data_value_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_change_data_value", "attached_node": "model.marketo_source.stg_marketo__activity_change_data_value"}, "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_change_data_value')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_change_data_value_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_change_data_value_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108", "fqn": ["marketo_source", "not_null_stg_marketo__activity_change_data_value_activity_id"], "alias": "not_null_stg_marketo__activity_change_data_value_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0411332, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_change_data_value", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_change_data_value"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_change_data_value_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_change_data_value", "attached_node": "model.marketo_source.stg_marketo__activity_change_data_value"}, "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_click_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_click_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_click_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0", "fqn": ["marketo_source", "unique_stg_marketo__activity_click_email_activity_id"], "alias": "unique_stg_marketo__activity_click_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.042293, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_click_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_click_email", "attached_node": "model.marketo_source.stg_marketo__activity_click_email"}, "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_click_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_click_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_click_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd", "fqn": ["marketo_source", "not_null_stg_marketo__activity_click_email_activity_id"], "alias": "not_null_stg_marketo__activity_click_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.043411, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_click_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_click_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_click_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_click_email", "attached_node": "model.marketo_source.stg_marketo__activity_click_email"}, "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_bounced')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_email_bounced_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_email_bounced_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3", "fqn": ["marketo_source", "unique_stg_marketo__activity_email_bounced_activity_id"], "alias": "unique_stg_marketo__activity_email_bounced_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.044527, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_email_bounced_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_bounced", "attached_node": "model.marketo_source.stg_marketo__activity_email_bounced"}, "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_bounced')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_email_bounced_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_email_bounced_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2", "fqn": ["marketo_source", "not_null_stg_marketo__activity_email_bounced_activity_id"], "alias": "not_null_stg_marketo__activity_email_bounced_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0457978, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_bounced", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_bounced"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_email_bounced_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_bounced", "attached_node": "model.marketo_source.stg_marketo__activity_email_bounced"}, "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_delivered')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_email_delivered_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_email_delivered_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87", "fqn": ["marketo_source", "unique_stg_marketo__activity_email_delivered_activity_id"], "alias": "unique_stg_marketo__activity_email_delivered_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.046902, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_email_delivered_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_delivered", "attached_node": "model.marketo_source.stg_marketo__activity_email_delivered"}, "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_email_delivered')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_email_delivered_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_email_delivered_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885", "fqn": ["marketo_source", "not_null_stg_marketo__activity_email_delivered_activity_id"], "alias": "not_null_stg_marketo__activity_email_delivered_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0479958, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_email_delivered", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_email_delivered"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_email_delivered_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_email_delivered", "attached_node": "model.marketo_source.stg_marketo__activity_email_delivered"}, "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_open_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_open_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_open_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6", "fqn": ["marketo_source", "unique_stg_marketo__activity_open_email_activity_id"], "alias": "unique_stg_marketo__activity_open_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.049101, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_open_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_open_email", "attached_node": "model.marketo_source.stg_marketo__activity_open_email"}, "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_open_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_open_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_open_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396", "fqn": ["marketo_source", "not_null_stg_marketo__activity_open_email_activity_id"], "alias": "not_null_stg_marketo__activity_open_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.050373, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_open_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_open_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_open_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_open_email", "attached_node": "model.marketo_source.stg_marketo__activity_open_email"}, "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_send_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_send_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_send_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1", "fqn": ["marketo_source", "unique_stg_marketo__activity_send_email_activity_id"], "alias": "unique_stg_marketo__activity_send_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0514612, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_send_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_send_email", "attached_node": "model.marketo_source.stg_marketo__activity_send_email"}, "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_send_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_send_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_send_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8", "fqn": ["marketo_source", "not_null_stg_marketo__activity_send_email_activity_id"], "alias": "not_null_stg_marketo__activity_send_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.052552, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_send_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_send_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_send_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_send_email", "attached_node": "model.marketo_source.stg_marketo__activity_send_email"}, "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_unsubscribe_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__activity_unsubscribe_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__activity_unsubscribe_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06", "fqn": ["marketo_source", "unique_stg_marketo__activity_unsubscribe_email_activity_id"], "alias": "unique_stg_marketo__activity_unsubscribe_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.053643, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__activity_unsubscribe_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_unsubscribe_email", "attached_node": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "activity_id", "model": "{{ get_where_subquery(ref('stg_marketo__activity_unsubscribe_email')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__activity_unsubscribe_email_activity_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__activity_unsubscribe_email_activity_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0", "fqn": ["marketo_source", "not_null_stg_marketo__activity_unsubscribe_email_activity_id"], "alias": "not_null_stg_marketo__activity_unsubscribe_email_activity_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.054723, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__activity_unsubscribe_email", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__activity_unsubscribe_email_activity_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`\nwhere activity_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "activity_id", "file_key_name": "models.stg_marketo__activity_unsubscribe_email", "attached_node": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "campaign_id", "model": "{{ get_where_subquery(ref('stg_marketo__campaigns')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__campaigns_campaign_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__campaigns_campaign_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925", "fqn": ["marketo_source", "unique_stg_marketo__campaigns_campaign_id"], "alias": "unique_stg_marketo__campaigns_campaign_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": false, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.055976, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__campaigns", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "campaign_id", "file_key_name": "models.stg_marketo__campaigns", "attached_node": "model.marketo_source.stg_marketo__campaigns"}, "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "campaign_id", "model": "{{ get_where_subquery(ref('stg_marketo__campaigns')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__campaigns_campaign_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__campaigns_campaign_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112", "fqn": ["marketo_source", "not_null_stg_marketo__campaigns_campaign_id"], "alias": "not_null_stg_marketo__campaigns_campaign_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": false, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.057058, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__campaigns", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "campaign_id", "file_key_name": "models.stg_marketo__campaigns", "attached_node": "model.marketo_source.stg_marketo__campaigns"}, "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "email_template_history_id", "model": "{{ get_where_subquery(ref('stg_marketo__email_template_history')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__email_template_history_email_template_history_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2", "fqn": ["marketo_source", "unique_stg_marketo__email_template_history_email_template_history_id"], "alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e", "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"alias": "unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e"}, "created_at": 1709220404.058173, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}{{ config(alias=\"unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e\") }}", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__email_temp_c5e4520ae792d796c7a93ad4ff601e7e.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select email_template_history_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`\n where email_template_history_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "email_template_history_id", "file_key_name": "models.stg_marketo__email_template_history", "attached_node": "model.marketo_source.stg_marketo__email_template_history"}, "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "email_template_history_id", "model": "{{ get_where_subquery(ref('stg_marketo__email_template_history')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__email_template_history_email_template_history_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa", "fqn": ["marketo_source", "not_null_stg_marketo__email_template_history_email_template_history_id"], "alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd", "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"alias": "not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd"}, "created_at": 1709220404.0592792, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}{{ config(alias=\"not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd\") }}", "language": "sql", "refs": [{"name": "stg_marketo__email_template_history", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__email_template_history"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__email_te_80ee2025020122dcfd13af1d9e7d57cd.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect email_template_history_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`\nwhere email_template_history_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "email_template_history_id", "file_key_name": "models.stg_marketo__email_template_history", "attached_node": "model.marketo_source.stg_marketo__email_template_history"}, "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "lead_describe_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead_describe')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__lead_describe_lead_describe_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__lead_describe_lead_describe_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1", "fqn": ["marketo_source", "unique_stg_marketo__lead_describe_lead_describe_id"], "alias": "unique_stg_marketo__lead_describe_lead_describe_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.060374, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__lead_describe_lead_describe_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select lead_describe_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`\n where lead_describe_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "lead_describe_id", "file_key_name": "models.stg_marketo__lead_describe", "attached_node": "model.marketo_source.stg_marketo__lead_describe"}, "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "lead_describe_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead_describe')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__lead_describe_lead_describe_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__lead_describe_lead_describe_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879", "fqn": ["marketo_source", "not_null_stg_marketo__lead_describe_lead_describe_id"], "alias": "not_null_stg_marketo__lead_describe_lead_describe_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.061624, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead_describe", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead_describe"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__lead_describe_lead_describe_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_describe_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`\nwhere lead_describe_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "lead_describe_id", "file_key_name": "models.stg_marketo__lead_describe", "attached_node": "model.marketo_source.stg_marketo__lead_describe"}, "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "lead_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__lead_lead_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__lead_lead_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f", "fqn": ["marketo_source", "unique_stg_marketo__lead_lead_id"], "alias": "unique_stg_marketo__lead_lead_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.06272, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/unique_stg_marketo__lead_lead_id.sql", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select lead_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`\n where lead_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "lead_id", "file_key_name": "models.stg_marketo__lead", "attached_node": "model.marketo_source.stg_marketo__lead"}, "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "lead_id", "model": "{{ get_where_subquery(ref('stg_marketo__lead')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__lead_lead_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__lead_lead_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055", "fqn": ["marketo_source", "not_null_stg_marketo__lead_lead_id"], "alias": "not_null_stg_marketo__lead_lead_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": true, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.063802, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__lead", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null", "macro.dbt.get_where_subquery"], "nodes": ["model.marketo_source.stg_marketo__lead"]}, "compiled_path": "target/compiled/marketo_source/models/stg_marketo.yml/not_null_stg_marketo__lead_lead_id.sql", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`\nwhere lead_id is null\n\n\n", "extra_ctes_injected": true, "extra_ctes": [], "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "lead_id", "file_key_name": "models.stg_marketo__lead", "attached_node": "model.marketo_source.stg_marketo__lead"}, "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": {"test_metadata": {"name": "unique", "kwargs": {"column_name": "program_id", "model": "{{ get_where_subquery(ref('stg_marketo__program')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "unique_stg_marketo__program_program_id", "resource_type": "test", "package_name": "marketo_source", "path": "unique_stg_marketo__program_program_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c", "fqn": ["marketo_source", "unique_stg_marketo__program_program_id"], "alias": "unique_stg_marketo__program_program_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": false, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.064887, "relation_name": null, "raw_code": "{{ test_unique(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__program", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_unique"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "program_id", "file_key_name": "models.stg_marketo__program", "attached_node": "model.marketo_source.stg_marketo__program"}, "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": {"test_metadata": {"name": "not_null", "kwargs": {"column_name": "program_id", "model": "{{ get_where_subquery(ref('stg_marketo__program')) }}"}, "namespace": null}, "database": "dbt-package-testing", "schema": "marketo_source_dbt_test__audit", "name": "not_null_stg_marketo__program_program_id", "resource_type": "test", "package_name": "marketo_source", "path": "not_null_stg_marketo__program_program_id.sql", "original_file_path": "models/stg_marketo.yml", "unique_id": "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f", "fqn": ["marketo_source", "not_null_stg_marketo__program_program_id"], "alias": "not_null_stg_marketo__program_program_id", "checksum": {"name": "none", "checksum": ""}, "config": {"enabled": false, "alias": null, "schema": "dbt_test__audit", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "test", "severity": "ERROR", "store_failures": null, "store_failures_as": null, "where": null, "limit": null, "fail_calc": "count(*)", "warn_if": "!= 0", "error_if": "!= 0"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {}, "created_at": 1709220404.0661561, "relation_name": null, "raw_code": "{{ test_not_null(**_dbt_generic_test_kwargs) }}", "language": "sql", "refs": [{"name": "stg_marketo__program", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.dbt.test_not_null"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "column_name": "program_id", "file_key_name": "models.stg_marketo__program", "attached_node": "model.marketo_source.stg_marketo__program"}}, "sources": {"source.marketo_source.marketo.lead": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "lead", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.lead", "fqn": ["marketo_source", "marketo", "lead"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_lead_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo leads.", "columns": {"id": {"name": "id", "description": "Unique integer id of a lead record.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "The timestamp each lead object was created at.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "The timestamp each lead object was last updated at.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "first_name": {"name": "first_name", "description": "The first name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "last_name": {"name": "last_name", "description": "The last name of the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "phone": {"name": "phone", "description": "Lead\u2019s Phone Number.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "main_phone": {"name": "main_phone", "description": "Primary phone number of the lead\u2019s company", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "mobile_phone": {"name": "mobile_phone", "description": "Lead\u2019s mobile phone number", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "company": {"name": "company", "description": "Lead\u2019s company name", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_company": {"name": "inferred_company", "description": "Company name inferred by reverse IP lookup of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "address_lead": {"name": "address_lead", "description": "Second address associated with the lead.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "address": {"name": "address", "description": "Lead\u2019s address.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "city": {"name": "city", "description": "Lead\u2019s city", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "state": {"name": "state", "description": "Lead\u2019s state", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "state_code": {"name": "state_code", "description": "Alpha-2 code of the Lead\u2019s state", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "country": {"name": "country", "description": "Lead\u2019s country", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "country_code": {"name": "country_code", "description": "Alpha-2 code of the Lead\u2019s country", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "postal_code": {"name": "postal_code", "description": "Lead\u2019s postal code", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_street": {"name": "billing_street", "description": "Billing street address of the lead\u2019s company", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_city": {"name": "billing_city", "description": "City of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_state": {"name": "billing_state", "description": "State or province of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_state_code": {"name": "billing_state_code", "description": "Alpha-2 code of the state or province of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_country": {"name": "billing_country", "description": "Country of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_country_code": {"name": "billing_country_code", "description": "Alpha-2 code of the country of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "billing_postal_code": {"name": "billing_postal_code", "description": "Postal code of the lead\u2019s billing address", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_city": {"name": "inferred_city", "description": "Lead\u2019s city inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_state_region": {"name": "inferred_state_region", "description": "Lead\u2019s state region inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_country": {"name": "inferred_country", "description": "Country inferred by reverse IP lookup of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_postal_code": {"name": "inferred_postal_code", "description": "Lead\u2019s postal code inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "inferred_phone_area_code": {"name": "inferred_phone_area_code", "description": "Lead\u2019s phone area code inferred by reverse IP lookup of lead\u2019s first recorded web visit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "anonymous_ip": {"name": "anonymous_ip", "description": "IP address of the lead\u2019s first recorded web visit", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "unsubscribed": {"name": "unsubscribed", "description": "Lead\u2019s email-unsubscribed status (boolean). Partially system managed. Will prevent receipt of non-operational emails if set to true.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_invalid": {"name": "email_invalid", "description": "Email invalid status (boolean). All emails to the address will be blocked if set to true. Bounces indicating that the email is invalid will automatically set this field to true.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "do_not_call": {"name": "do_not_call", "description": "Lead\u2019s do-not-call preference (boolean)", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_lead_data`", "created_at": 1709220404.068692}, "source.marketo_source.marketo.lead_describe": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "lead_describe", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.lead_describe", "fqn": ["marketo_source", "marketo", "lead_describe"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_lead_describe_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with metadata about lead object columns", "columns": {"data_type": {"name": "data_type", "description": "Datatype of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "display_name": {"name": "display_name", "description": "UI display-name of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "Unique integer id of the field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "length": {"name": "length", "description": "Max length of the field. Only applicable to text, string, and text area.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "restname": {"name": "restname", "description": "Description of REST API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "restread_only": {"name": "restread_only", "description": "Whether the field is only available via the REST API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soapname": {"name": "soapname", "description": "Description of SOAP API usage attributes.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "soapread_only": {"name": "soapread_only", "description": "Whether the field is only available via the SOAP API.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_lead_describe_data`", "created_at": 1709220404.06883}, "source.marketo_source.marketo.activity_change_data_value": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_change_data_value", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_change_data_value", "fqn": ["marketo_source", "marketo", "activity_change_data_value"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_change_data_value_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with data value changes from the leads object.", "columns": {"api_method_name": {"name": "api_method_name", "description": "API method used for change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_date": {"name": "activity_date", "description": "Timestamp of the actvity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the related campaign, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "Id of the lead associated to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "modifying_user": {"name": "modifying_user", "description": "The user who instigated the change, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "new_value": {"name": "new_value", "description": "New value after the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "old_value": {"name": "old_value", "description": "Old value before the change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "Value of the primary attribute.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "ID of the primary attribute field.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reason": {"name": "reason", "description": "Reason for the data change.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "request_id": {"name": "request_id", "description": "ID of the request made.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_change_data_value_data`", "created_at": 1709220404.068939}, "source.marketo_source.marketo.campaign": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "campaign", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.campaign", "fqn": ["marketo_source", "marketo", "campaign"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_campaign_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo campaigns.", "columns": {"active": {"name": "active", "description": "Whether the campaign is active. Only applicable to trigger campaigns.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "Timestamp when the campaign was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the campaign", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "Unique integer ID of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "ID of the parent program, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "type": {"name": "type", "description": "Type of campaign, either 'batch' or 'trigger'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp when the campaign was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the parent workspace, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "computed_url": {"name": "computed_url", "description": "The URL of the campaign in Marketo.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "flow_id": {"name": "flow_id", "description": "The ID of the flow that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_communication_limit_enabled": {"name": "is_communication_limit_enabled", "description": "Whether or not the campaign has a communication limit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_requestable": {"name": "is_requestable", "description": "Whether or not the campaign can be requested by leads.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_system": {"name": "is_system", "description": "Whether or not the campaign is a system campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "max_members": {"name": "max_members", "description": "The maximum number of members that the campaign can have.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_type": {"name": "qualification_rule_type", "description": "The type of qualification rule that the campaign uses.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_interval": {"name": "qualification_rule_interval", "description": "The interval for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_unit": {"name": "qualification_rule_unit", "description": "The unit for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_start_at": {"name": "recurrence_start_at", "description": "The start date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_end_at": {"name": "recurrence_end_at", "description": "The end date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval_type": {"name": "recurrence_interval_type", "description": "The type of recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval": {"name": "recurrence_interval", "description": "The value of the recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_weekday_only": {"name": "recurrence_weekday_only", "description": "Whether or not the recurrence is limited to weekdays.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_month": {"name": "recurrence_day_of_month", "description": "The day of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_week": {"name": "recurrence_day_of_week", "description": "The day of the week for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_week_of_month": {"name": "recurrence_week_of_month", "description": "The week of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "smart_list_id": {"name": "smart_list_id", "description": "The ID of the smart list that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "The status of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "_fivetran_deleted": {"name": "_fivetran_deleted", "description": "Boolean created by Fivetran to indicate whether the record has been deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_campaign_data`", "created_at": 1709220404.0690691}, "source.marketo_source.marketo.program": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "program", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.program", "fqn": ["marketo_source", "marketo", "program"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_program_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with all Marketo programs.", "columns": {"channel": {"name": "channel", "description": "Channel of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_at": {"name": "created_at", "description": "Timestamp the program was created at", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "end_date": {"name": "end_date", "description": "End date of the program. Applicable to event, email, and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_id": {"name": "sfdc_id", "description": "SFDC id of the program if linked to an SFDC campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_name": {"name": "sfdc_name", "description": "Name of the linked SFDC campaign if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "start_date": {"name": "start_date", "description": "Start date of program. Applicable to event, email and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "Status of the program. Only valid for Email and engagement program types.\nAllowed values: locked, unlocked, on, off\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "type": {"name": "type", "description": "Type of the program. Allowed values: program, event, webinar, nurture\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp the program was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the program in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "_fivetran_deleted": {"name": "_fivetran_deleted", "description": "Boolean created by Fivetran to indicate whether the record has been deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_program_data`", "created_at": 1709220404.069175}, "source.marketo_source.marketo.email_template_history": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "email_template_history", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.email_template_history", "fqn": ["marketo_source", "marketo", "email_template_history"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_email_template_history_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with a history of email template versions.", "columns": {"created_at": {"name": "created_at", "description": "Timestamp the email template was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_folder_name": {"name": "folder_folder_name", "description": "The name of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_value": {"name": "folder_value", "description": "The value of the email template's folder.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_email": {"name": "from_email", "description": "The 'From' address of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "from_name": {"name": "from_name", "description": "The 'From' name of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the email template", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "name": {"name": "name", "description": "Name of the email template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "operational": {"name": "operational", "description": "Whether the email is operational. Operational emails bypass unsubscribe status. Defaults to false.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "The ID of the email template's program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "publish_to_msi": {"name": "publish_to_msi", "description": "Whether the email is published to Marketo Sales Insight.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "reply_email": {"name": "reply_email", "description": "Reply-To address of the Email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "Status filter for draft or approved versions.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "subject": {"name": "subject", "description": "Subject line of the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "template": {"name": "template", "description": "ID of the parent template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "text_only": {"name": "text_only", "description": "Setting to include text-only version of email when sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_at": {"name": "updated_at", "description": "Timestamp the email template was last updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the email template in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "version": {"name": "version", "description": "The type version of the email, either '1' or '2'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "web_view": {"name": "web_view", "description": "Whether 'View as Webpage' function is enabled for the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_email_template_history_data`", "created_at": 1709220404.069691}, "source.marketo_source.marketo.activity_click_email": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_click_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_click_email", "fqn": ["marketo_source", "marketo", "activity_click_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_click_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email click activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The date of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device type the activity occurred on.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Whether the activity occurred on a mobile device.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "link": {"name": "link", "description": "The URL of the link clicked.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The Web browser user agent information obtained when the lead clicked the email link.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_click_email_data`", "created_at": 1709220404.069804}, "source.marketo_source.marketo.activity_email_delivered": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_email_delivered", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_email_delivered", "fqn": ["marketo_source", "marketo", "activity_email_delivered"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_email_delivered_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email delivery activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was delivered.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_email_delivered_data`", "created_at": 1709220404.0699441}, "source.marketo_source.marketo.activity_email_bounced": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_email_bounced", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_email_bounced", "fqn": ["marketo_source", "marketo", "activity_email_bounced"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_email_bounced_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email bounce activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "category": {"name": "category", "description": "The category associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "details": {"name": "details", "description": "Details about why the email bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email": {"name": "email", "description": "The email address that bounced.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "subcategory": {"name": "subcategory", "description": "The subcategory associated with bounced email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_email_bounced_data`", "created_at": 1709220404.070055}, "source.marketo_source.marketo.activity_open_email": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_open_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_open_email", "fqn": ["marketo_source", "marketo", "activity_open_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_open_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email bounce activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "device": {"name": "device", "description": "The device that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_mobile_device": {"name": "is_mobile_device", "description": "Identifies whether a mobile device was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "platform": {"name": "platform", "description": "The platform that was used to open the email.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the email was opened.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_open_email_data`", "created_at": 1709220404.070202}, "source.marketo_source.marketo.activity_unsubscribe_email": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_unsubscribe_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_unsubscribe_email", "fqn": ["marketo_source", "marketo", "activity_unsubscribe_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_unsubscribe_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email unsusbscribe activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "client_ip_address": {"name": "client_ip_address", "description": "The IP address of the client that unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "form_fields": {"name": "form_fields", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "query_parameters": {"name": "query_parameters", "description": "The query parameters contained within the URL.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "referrer_url": {"name": "referrer_url", "description": "The URL of the referrer used to identify where the form visit originated from.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "user_agent": {"name": "user_agent", "description": "The web browser user agent information obtained when the lead unsubscribed.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webform_id": {"name": "webform_id", "description": "The ID of the unsubscribe web page.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "webpage_id": {"name": "webpage_id", "description": "The ID of the unsubscribe web form.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_unsubscribe_email_data`", "created_at": 1709220404.0703108}, "source.marketo_source.marketo.activity_send_email": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_send_email", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_send_email", "fqn": ["marketo_source", "marketo", "activity_send_email"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_send_email_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with email send activities.", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the email was sent.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the email's campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_run_id": {"name": "campaign_run_id", "description": "The ID of the email's campaign run.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "choice_number": {"name": "choice_number", "description": "The choice number of the current step that triggered the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "email_template_id": {"name": "email_template_id", "description": "The ID of the email's template.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "step_id": {"name": "step_id", "description": "The Id of the current step in the flow.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_send_email_data`", "created_at": 1709220404.070409}, "source.marketo_source.marketo.activity_delete_lead": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_delete_lead", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_delete_lead", "fqn": ["marketo_source", "marketo", "activity_delete_lead"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_delete_lead_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with deleted lead activities", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign": {"name": "campaign", "description": "The name of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_delete_lead_data`", "created_at": 1709220404.070504}, "source.marketo_source.marketo.activity_merge_leads": {"database": "dbt-package-testing", "schema": "marketo_source", "name": "activity_merge_leads", "resource_type": "source", "package_name": "marketo_source", "path": "models/src_marketo.yml", "original_file_path": "models/src_marketo.yml", "unique_id": "source.marketo_source.marketo.activity_merge_leads", "fqn": ["marketo_source", "marketo", "activity_merge_leads"], "source_name": "marketo", "source_description": "", "loader": "", "identifier": "marketo_activity_merge_leads_data", "quoting": {"database": null, "schema": null, "identifier": null, "column": null}, "loaded_at_field": null, "freshness": {"warn_after": {"count": null, "period": null}, "error_after": {"count": null, "period": null}, "filter": null}, "external": null, "description": "Table with merged lead activities", "columns": {"activity_date": {"name": "activity_date", "description": "The timestamp the lead was deleted.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "activity_type_id": {"name": "activity_type_id", "description": "The ID of the activity type.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_id": {"name": "campaign_id", "description": "The ID of the campaign related to the activity, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "id": {"name": "id", "description": "ID of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "lead_id": {"name": "lead_id", "description": "The ID of the lead related to the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value": {"name": "primary_attribute_value", "description": "The primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "primary_attribute_value_id": {"name": "primary_attribute_value_id", "description": "The ID of the primary attribute of the activity.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "merge_ids": {"name": "merge_ids", "description": "ID of the lead that the lead was merged into.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "source_meta": {}, "tags": [], "config": {"enabled": true}, "patch_path": null, "unrendered_config": {}, "relation_name": "`dbt-package-testing`.`marketo_source`.`marketo_activity_merge_leads_data`", "created_at": 1709220404.070602}}, "macros": {"macro.dbt_bigquery.date_sharded_table": {"name": "date_sharded_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/etc.sql", "original_file_path": "macros/etc.sql", "unique_id": "macro.dbt_bigquery.date_sharded_table", "macro_sql": "{% macro date_sharded_table(base_name) %}\n {{ return(base_name ~ \"[DBT__PARTITION_DATE]\") }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.671211, "supported_languages": null}, "macro.dbt_bigquery.grant_access_to": {"name": "grant_access_to", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/etc.sql", "original_file_path": "macros/etc.sql", "unique_id": "macro.dbt_bigquery.grant_access_to", "macro_sql": "{% macro grant_access_to(entity, entity_type, role, grant_target_dict) -%}\n {% do adapter.grant_access_to(entity, entity_type, role, grant_target_dict) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.671468, "supported_languages": null}, "macro.dbt_bigquery.get_partitions_metadata": {"name": "get_partitions_metadata", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/etc.sql", "original_file_path": "macros/etc.sql", "unique_id": "macro.dbt_bigquery.get_partitions_metadata", "macro_sql": "\n\n{%- macro get_partitions_metadata(table) -%}\n {%- if execute -%}\n {%- set res = adapter.get_partitions_metadata(table) -%}\n {{- return(res) -}}\n {%- endif -%}\n {{- return(None) -}}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.671796, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_table_as": {"name": "bigquery__create_table_as", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_table_as", "macro_sql": "{% macro bigquery__create_table_as(temporary, relation, compiled_code, language='sql') -%}\n {%- if language == 'sql' -%}\n {%- set raw_partition_by = config.get('partition_by', none) -%}\n {%- set raw_cluster_by = config.get('cluster_by', none) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {%- set partition_config = adapter.parse_partition_by(raw_partition_by) -%}\n {%- if partition_config.time_ingestion_partitioning -%}\n {%- set columns = get_columns_with_types_in_query_sql(sql) -%}\n {%- set table_dest_columns_csv = columns_without_partition_fields_csv(partition_config, columns) -%}\n {%- set columns = '(' ~ table_dest_columns_csv ~ ')' -%}\n {%- endif -%}\n\n {{ sql_header if sql_header is not none }}\n\n create or replace table {{ relation }}\n {%- set contract_config = config.get('contract') -%}\n {%- if contract_config.enforced -%}\n {{ get_assert_columns_equivalent(compiled_code) }}\n {{ get_table_columns_and_constraints() }}\n {%- set compiled_code = get_select_subquery(compiled_code) %}\n {% else %}\n {#-- cannot do contracts at the same time as time ingestion partitioning -#}\n {{ columns }}\n {% endif %}\n {{ partition_by(partition_config) }}\n {{ cluster_by(raw_cluster_by) }}\n\n {{ bigquery_table_options(config, model, temporary) }}\n\n {#-- PARTITION BY cannot be used with the AS query_statement clause.\n https://cloud.google.com/bigquery/docs/reference/standard-sql/data-definition-language#partition_expression\n -#}\n {%- if not partition_config.time_ingestion_partitioning %}\n as (\n {{ compiled_code }}\n );\n {%- endif %}\n {%- elif language == 'python' -%}\n {#--\n N.B. Python models _can_ write to temp views HOWEVER they use a different session\n and have already expired by the time they need to be used (I.E. in merges for incremental models)\n\n TODO: Deep dive into spark sessions to see if we can reuse a single session for an entire\n dbt invocation.\n --#}\n\n {#-- when a user wants to change the schema of an existing relation, they must intentionally drop the table in the dataset --#}\n {%- set old_relation = adapter.get_relation(database=relation.database, schema=relation.schema, identifier=relation.identifier) -%}\n {%- if (old_relation.is_table and (should_full_refresh())) -%}\n {% do adapter.drop_relation(relation) %}\n {%- endif -%}\n {{ py_write_table(compiled_code=compiled_code, target_relation=relation.quote(database=False, schema=False, identifier=False)) }}\n {%- else -%}\n {% do exceptions.raise_compiler_error(\"bigquery__create_table_as macro didn't get supported language, it got %s\" % language) %}\n {%- endif -%}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_bigquery.get_columns_with_types_in_query_sql", "macro.dbt_bigquery.columns_without_partition_fields_csv", "macro.dbt.get_assert_columns_equivalent", "macro.dbt.get_table_columns_and_constraints", "macro.dbt.get_select_subquery", "macro.dbt_bigquery.partition_by", "macro.dbt_bigquery.cluster_by", "macro.dbt_bigquery.bigquery_table_options", "macro.dbt.should_full_refresh", "macro.dbt_bigquery.py_write_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.676507, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_view_as": {"name": "bigquery__create_view_as", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_view_as", "macro_sql": "{% macro bigquery__create_view_as(relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n\n create or replace view {{ relation }}\n {{ bigquery_view_options(config, model) }}\n {%- set contract_config = config.get('contract') -%}\n {%- if contract_config.enforced -%}\n {{ get_assert_columns_equivalent(sql) }}\n {%- endif %}\n as {{ sql }};\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery_view_options", "macro.dbt.get_assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.677037, "supported_languages": null}, "macro.dbt_bigquery.bigquery__drop_schema": {"name": "bigquery__drop_schema", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__drop_schema", "macro_sql": "{% macro bigquery__drop_schema(relation) -%}\n {{ adapter.drop_schema(relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.677185, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_columns_in_relation": {"name": "bigquery__get_columns_in_relation", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_columns_in_relation", "macro_sql": "{% macro bigquery__get_columns_in_relation(relation) -%}\n {{ return(adapter.get_columns_in_relation(relation)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.677343, "supported_languages": null}, "macro.dbt_bigquery.bigquery__list_relations_without_caching": {"name": "bigquery__list_relations_without_caching", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__list_relations_without_caching", "macro_sql": "{% macro bigquery__list_relations_without_caching(schema_relation) -%}\n {{ return(adapter.list_relations_without_caching(schema_relation)) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.677495, "supported_languages": null}, "macro.dbt_bigquery.bigquery__list_schemas": {"name": "bigquery__list_schemas", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__list_schemas", "macro_sql": "{% macro bigquery__list_schemas(database) -%}\n {{ return(adapter.list_schemas(database)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.677651, "supported_languages": null}, "macro.dbt_bigquery.bigquery__check_schema_exists": {"name": "bigquery__check_schema_exists", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__check_schema_exists", "macro_sql": "{% macro bigquery__check_schema_exists(information_schema, schema) %}\n {{ return(adapter.check_schema_exists(information_schema.database, schema)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.67785, "supported_languages": null}, "macro.dbt_bigquery.bigquery__persist_docs": {"name": "bigquery__persist_docs", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__persist_docs", "macro_sql": "{% macro bigquery__persist_docs(relation, model, for_relation, for_columns) -%}\n {% if for_columns and config.persist_column_docs() and model.columns %}\n {% do alter_column_comment(relation, model.columns) %}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.alter_column_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.678157, "supported_languages": null}, "macro.dbt_bigquery.bigquery__alter_column_comment": {"name": "bigquery__alter_column_comment", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__alter_column_comment", "macro_sql": "{% macro bigquery__alter_column_comment(relation, column_dict) -%}\n {% do adapter.update_columns(relation, column_dict) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.678334, "supported_languages": null}, "macro.dbt_bigquery.bigquery__alter_relation_add_columns": {"name": "bigquery__alter_relation_add_columns", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__alter_relation_add_columns", "macro_sql": "{% macro bigquery__alter_relation_add_columns(relation, add_columns) %}\n\n {% set sql -%}\n\n alter {{ relation.type }} {{ relation }}\n {% for column in add_columns %}\n add column {{ column.name }} {{ column.data_type }}{{ ',' if not loop.last }}\n {% endfor %}\n\n {%- endset -%}\n\n {{ return(run_query(sql)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6787682, "supported_languages": null}, "macro.dbt_bigquery.bigquery__alter_relation_drop_columns": {"name": "bigquery__alter_relation_drop_columns", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__alter_relation_drop_columns", "macro_sql": "{% macro bigquery__alter_relation_drop_columns(relation, drop_columns) %}\n\n {% set sql -%}\n\n alter {{ relation.type }} {{ relation }}\n\n {% for column in drop_columns %}\n drop column {{ column.name }}{{ ',' if not loop.last }}\n {% endfor %}\n\n {%- endset -%}\n\n {{ return(run_query(sql)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.679163, "supported_languages": null}, "macro.dbt_bigquery.bigquery__alter_column_type": {"name": "bigquery__alter_column_type", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__alter_column_type", "macro_sql": "{% macro bigquery__alter_column_type(relation, column_name, new_column_type) -%}\n {#-- Changing a column's data type using a query requires you to scan the entire table.\n The query charges can be significant if the table is very large.\n\n https://cloud.google.com/bigquery/docs/manually-changing-schemas#changing_a_columns_data_type\n #}\n {% set relation_columns = get_columns_in_relation(relation) %}\n\n {% set sql %}\n select\n {%- for col in relation_columns -%}\n {% if col.column == column_name %}\n CAST({{ col.quoted }} AS {{ new_column_type }}) AS {{ col.quoted }}\n {%- else %}\n {{ col.quoted }}\n {%- endif %}\n {%- if not loop.last %},{% endif -%}\n {%- endfor %}\n from {{ relation }}\n {% endset %}\n\n {% call statement('alter_column_type') %}\n {{ create_table_as(False, relation, sql)}}\n {%- endcall %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_columns_in_relation", "macro.dbt.statement", "macro.dbt.create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.679938, "supported_languages": null}, "macro.dbt_bigquery.bigquery__test_unique": {"name": "bigquery__test_unique", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__test_unique", "macro_sql": "{% macro bigquery__test_unique(model, column_name) %}\n\nwith dbt_test__target as (\n\n select {{ column_name }} as unique_field\n from {{ model }}\n where {{ column_name }} is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.68012, "supported_languages": null}, "macro.dbt_bigquery.bigquery__upload_file": {"name": "bigquery__upload_file", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters.sql", "original_file_path": "macros/adapters.sql", "unique_id": "macro.dbt_bigquery.bigquery__upload_file", "macro_sql": "{% macro bigquery__upload_file(local_file_path, database, table_schema, table_name) %}\n\n {{ log(\"kwargs: \" ~ kwargs) }}\n\n {% do adapter.upload_file(local_file_path, database, table_schema, table_name, kwargs=kwargs) %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.680416, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_csv_table": {"name": "bigquery__create_csv_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/seed.sql", "original_file_path": "macros/materializations/seed.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_csv_table", "macro_sql": "{% macro bigquery__create_csv_table(model, agate_table) %}\n -- no-op\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.680801, "supported_languages": null}, "macro.dbt_bigquery.bigquery__reset_csv_table": {"name": "bigquery__reset_csv_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/seed.sql", "original_file_path": "macros/materializations/seed.sql", "unique_id": "macro.dbt_bigquery.bigquery__reset_csv_table", "macro_sql": "{% macro bigquery__reset_csv_table(model, full_refresh, old_relation, agate_table) %}\n {{ adapter.drop_relation(old_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.680971, "supported_languages": null}, "macro.dbt_bigquery.bigquery__load_csv_rows": {"name": "bigquery__load_csv_rows", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/seed.sql", "original_file_path": "macros/materializations/seed.sql", "unique_id": "macro.dbt_bigquery.bigquery__load_csv_rows", "macro_sql": "{% macro bigquery__load_csv_rows(model, agate_table) %}\n\n {%- set column_override = model['config'].get('column_types', {}) -%}\n {{ adapter.load_dataframe(model['database'], model['schema'], model['alias'],\n \t\t\t\t\t\t\tagate_table, column_override) }}\n\n {% call statement() %}\n alter table {{ this.render() }} set {{ bigquery_table_options(config, model) }}\n {% endcall %}\n\n {% if config.persist_relation_docs() and 'description' in model %}\n\n \t{{ adapter.update_table_description(model['database'], model['schema'], model['alias'], model['description']) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_bigquery.bigquery_table_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6817632, "supported_languages": null}, "macro.dbt_bigquery.bigquery__handle_existing_table": {"name": "bigquery__handle_existing_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/view.sql", "original_file_path": "macros/materializations/view.sql", "unique_id": "macro.dbt_bigquery.bigquery__handle_existing_table", "macro_sql": "{% macro bigquery__handle_existing_table(full_refresh, old_relation) %}\n {%- if full_refresh -%}\n {{ adapter.drop_relation(old_relation) }}\n {%- else -%}\n {{ exceptions.relation_wrong_type(old_relation, 'view') }}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.682362, "supported_languages": null}, "macro.dbt_bigquery.materialization_view_bigquery": {"name": "materialization_view_bigquery", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/view.sql", "original_file_path": "macros/materializations/view.sql", "unique_id": "macro.dbt_bigquery.materialization_view_bigquery", "macro_sql": "{% materialization view, adapter='bigquery' -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n\n {% set to_return = bigquery__create_or_replace_view() %}\n\n {% set target_relation = this.incorporate(type='view') %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if config.get('grant_access_to') %}\n {% for grant_target_dict in config.get('grant_access_to') %}\n {% do adapter.grant_access_to(this, 'view', None, grant_target_dict) %}\n {% endfor %}\n {% endif %}\n\n {% do return(to_return) %}\n\n{%- endmaterialization %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_or_replace_view", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.683118, "supported_languages": ["sql"]}, "macro.dbt_bigquery.materialization_table_bigquery": {"name": "materialization_table_bigquery", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/table.sql", "original_file_path": "macros/materializations/table.sql", "unique_id": "macro.dbt_bigquery.materialization_table_bigquery", "macro_sql": "{% materialization table, adapter='bigquery', supported_languages=['sql', 'python']-%}\n\n {%- set language = model['language'] -%}\n {%- set identifier = model['alias'] -%}\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n {%- set exists_not_as_table = (old_relation is not none and not old_relation.is_table) -%}\n {%- set target_relation = api.Relation.create(database=database, schema=schema, identifier=identifier, type='table') -%}\n\n -- grab current tables grants config for comparision later on\n {%- set grant_config = config.get('grants') -%}\n\n {{ run_hooks(pre_hooks) }}\n\n {#\n We only need to drop this thing if it is not a table.\n If it _is_ already a table, then we can overwrite it without downtime\n Unlike table -> view, no need for `--full-refresh`: dropping a view is no big deal\n #}\n {%- if exists_not_as_table -%}\n {{ adapter.drop_relation(old_relation) }}\n {%- endif -%}\n\n -- build model\n {%- set raw_partition_by = config.get('partition_by', none) -%}\n {%- set partition_by = adapter.parse_partition_by(raw_partition_by) -%}\n {%- set cluster_by = config.get('cluster_by', none) -%}\n {% if not adapter.is_replaceable(old_relation, partition_by, cluster_by) %}\n {% do log(\"Hard refreshing \" ~ old_relation ~ \" because it is not replaceable\") %}\n {% do adapter.drop_relation(old_relation) %}\n {% endif %}\n\n -- build model\n {%- call statement('main', language=language) -%}\n {{ create_table_as(False, target_relation, compiled_code, language) }}\n {%- endcall -%}\n\n {{ run_hooks(post_hooks) }}\n\n {% set should_revoke = should_revoke(old_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt.statement", "macro.dbt.create_table_as", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6870341, "supported_languages": ["sql", "python"]}, "macro.dbt_bigquery.py_write_table": {"name": "py_write_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/table.sql", "original_file_path": "macros/materializations/table.sql", "unique_id": "macro.dbt_bigquery.py_write_table", "macro_sql": "{% macro py_write_table(compiled_code, target_relation) %}\nfrom pyspark.sql import SparkSession\n{%- set raw_partition_by = config.get('partition_by', none) -%}\n{%- set raw_cluster_by = config.get('cluster_by', none) -%}\n{%- set partition_config = adapter.parse_partition_by(raw_partition_by) %}\n\nspark = SparkSession.builder.appName('smallTest').getOrCreate()\n\nspark.conf.set(\"viewsEnabled\",\"true\")\nspark.conf.set(\"temporaryGcsBucket\",\"{{target.gcs_bucket}}\")\n\n{{ compiled_code }}\ndbt = dbtObj(spark.read.format(\"bigquery\").load)\ndf = model(dbt, spark)\n\n# COMMAND ----------\n# this is materialization code dbt generated, please do not modify\n\nimport pyspark\n# make sure pandas exists before using it\ntry:\n import pandas\n pandas_available = True\nexcept ImportError:\n pandas_available = False\n\n# make sure pyspark.pandas exists before using it\ntry:\n import pyspark.pandas\n pyspark_pandas_api_available = True\nexcept ImportError:\n pyspark_pandas_api_available = False\n\n# make sure databricks.koalas exists before using it\ntry:\n import databricks.koalas\n koalas_available = True\nexcept ImportError:\n koalas_available = False\n\n# preferentially convert pandas DataFrames to pandas-on-Spark or Koalas DataFrames first\n# since they know how to convert pandas DataFrames better than `spark.createDataFrame(df)`\n# and converting from pandas-on-Spark to Spark DataFrame has no overhead\nif pyspark_pandas_api_available and pandas_available and isinstance(df, pandas.core.frame.DataFrame):\n df = pyspark.pandas.frame.DataFrame(df)\nelif koalas_available and pandas_available and isinstance(df, pandas.core.frame.DataFrame):\n df = databricks.koalas.frame.DataFrame(df)\n\n# convert to pyspark.sql.dataframe.DataFrame\nif isinstance(df, pyspark.sql.dataframe.DataFrame):\n pass # since it is already a Spark DataFrame\nelif pyspark_pandas_api_available and isinstance(df, pyspark.pandas.frame.DataFrame):\n df = df.to_spark()\nelif koalas_available and isinstance(df, databricks.koalas.frame.DataFrame):\n df = df.to_spark()\nelif pandas_available and isinstance(df, pandas.core.frame.DataFrame):\n df = spark.createDataFrame(df)\nelse:\n msg = f\"{type(df)} is not a supported type for dbt Python materialization\"\n raise Exception(msg)\n\ndf.write \\\n .mode(\"overwrite\") \\\n .format(\"bigquery\") \\\n .option(\"writeMethod\", \"indirect\").option(\"writeDisposition\", 'WRITE_TRUNCATE') \\\n {%- if partition_config is not none %}\n {%- if partition_config.data_type | lower in ('date','timestamp','datetime') %}\n .option(\"partitionField\", \"{{- partition_config.field -}}\") \\\n {%- if partition_config.granularity is not none %}\n .option(\"partitionType\", \"{{- partition_config.granularity| upper -}}\") \\\n {%- endif %}\n {%- endif %}\n {%- endif %}\n {%- if raw_cluster_by is not none %}\n .option(\"clusteredFields\", \"{{- raw_cluster_by | join(',') -}}\") \\\n {%- endif %}\n .save(\"{{target_relation}}\")\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6881049, "supported_languages": null}, "macro.dbt_bigquery.materialization_copy_bigquery": {"name": "materialization_copy_bigquery", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/copy.sql", "original_file_path": "macros/materializations/copy.sql", "unique_id": "macro.dbt_bigquery.materialization_copy_bigquery", "macro_sql": "{% materialization copy, adapter='bigquery' -%}\n\n {# Setup #}\n {{ run_hooks(pre_hooks) }}\n\n {% set destination = this.incorporate(type='table') %}\n\n {# there can be several ref() or source() according to BQ copy API docs #}\n {# cycle over ref() and source() to create source tables array #}\n {% set source_array = [] %}\n {% for ref_table in model.refs %}\n {{ source_array.append(ref(ref_table.get('package'), ref_table.name, version=ref_table.get('version'))) }}\n {% endfor %}\n\n {% for src_table in model.sources %}\n {{ source_array.append(source(*src_table)) }}\n {% endfor %}\n\n {# Call adapter copy_table function #}\n {%- set result_str = adapter.copy_table(\n source_array,\n destination,\n config.get('copy_materialization', default = 'table')) -%}\n\n {{ store_result('main', response=result_str) }}\n\n {# Clean up #}\n {{ run_hooks(post_hooks) }}\n {%- do apply_grants(target_relation, grant_config) -%}\n {{ adapter.commit() }}\n\n {{ return({'relations': [destination]}) }}\n{%- endmaterialization %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt.apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.689458, "supported_languages": ["sql"]}, "macro.dbt_bigquery.dbt_bigquery_validate_get_incremental_strategy": {"name": "dbt_bigquery_validate_get_incremental_strategy", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental.sql", "original_file_path": "macros/materializations/incremental.sql", "unique_id": "macro.dbt_bigquery.dbt_bigquery_validate_get_incremental_strategy", "macro_sql": "{% macro dbt_bigquery_validate_get_incremental_strategy(config) %}\n {#-- Find and validate the incremental strategy #}\n {%- set strategy = config.get(\"incremental_strategy\") or 'merge' -%}\n\n {% set invalid_strategy_msg -%}\n Invalid incremental strategy provided: {{ strategy }}\n Expected one of: 'merge', 'insert_overwrite'\n {%- endset %}\n {% if strategy not in ['merge', 'insert_overwrite'] %}\n {% do exceptions.raise_compiler_error(invalid_strategy_msg) %}\n {% endif %}\n\n {% do return(strategy) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6916292, "supported_languages": null}, "macro.dbt_bigquery.source_sql_with_partition": {"name": "source_sql_with_partition", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental.sql", "original_file_path": "macros/materializations/incremental.sql", "unique_id": "macro.dbt_bigquery.source_sql_with_partition", "macro_sql": "{% macro source_sql_with_partition(partition_by, source_sql) %}\n\n {%- if partition_by.time_ingestion_partitioning %}\n {{ return(wrap_with_time_ingestion_partitioning_sql(partition_by, source_sql, False)) }}\n {% else %}\n {{ return(source_sql) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.691923, "supported_languages": null}, "macro.dbt_bigquery.bq_create_table_as": {"name": "bq_create_table_as", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental.sql", "original_file_path": "macros/materializations/incremental.sql", "unique_id": "macro.dbt_bigquery.bq_create_table_as", "macro_sql": "{% macro bq_create_table_as(partition_by, temporary, relation, compiled_code, language='sql') %}\n {%- set _dbt_max_partition = declare_dbt_max_partition(this, partition_by, compiled_code, language) -%}\n {% if partition_by.time_ingestion_partitioning and language == 'python' %}\n {% do exceptions.raise_compiler_error(\n \"Python models do not support ingestion time partitioning\"\n ) %}\n {% elif partition_by.time_ingestion_partitioning and language == 'sql' %}\n {#-- Create the table before inserting data as ingestion time partitioned tables can't be created with the transformed data --#}\n {% do run_query(create_table_as(temporary, relation, compiled_code)) %}\n {{ return(_dbt_max_partition + bq_insert_into_ingestion_time_partitioned_table_sql(relation, compiled_code)) }}\n {% else %}\n {{ return(_dbt_max_partition + create_table_as(temporary, relation, compiled_code, language)) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.declare_dbt_max_partition", "macro.dbt.run_query", "macro.dbt.create_table_as", "macro.dbt_bigquery.bq_insert_into_ingestion_time_partitioned_table_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.692704, "supported_languages": null}, "macro.dbt_bigquery.bq_generate_incremental_build_sql": {"name": "bq_generate_incremental_build_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental.sql", "original_file_path": "macros/materializations/incremental.sql", "unique_id": "macro.dbt_bigquery.bq_generate_incremental_build_sql", "macro_sql": "{% macro bq_generate_incremental_build_sql(\n strategy, tmp_relation, target_relation, sql, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions, incremental_predicates\n) %}\n {#-- if partitioned, use BQ scripting to get the range of partition values to be updated --#}\n {% if strategy == 'insert_overwrite' %}\n\n {% set build_sql = bq_generate_incremental_insert_overwrite_build_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions\n ) %}\n\n {% else %} {# strategy == 'merge' #}\n\n {% set build_sql = bq_generate_incremental_merge_build_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, incremental_predicates\n ) %}\n\n {% endif %}\n\n {{ return(build_sql) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bq_generate_incremental_insert_overwrite_build_sql", "macro.dbt_bigquery.bq_generate_incremental_merge_build_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.693372, "supported_languages": null}, "macro.dbt_bigquery.materialization_incremental_bigquery": {"name": "materialization_incremental_bigquery", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental.sql", "original_file_path": "macros/materializations/incremental.sql", "unique_id": "macro.dbt_bigquery.materialization_incremental_bigquery", "macro_sql": "{% materialization incremental, adapter='bigquery', supported_languages=['sql', 'python'] -%}\n\n {%- set unique_key = config.get('unique_key') -%}\n {%- set full_refresh_mode = (should_full_refresh()) -%}\n {%- set language = model['language'] %}\n\n {%- set target_relation = this %}\n {%- set existing_relation = load_relation(this) %}\n {%- set tmp_relation = make_temp_relation(this) %}\n\n {#-- Validate early so we don't run SQL if the strategy is invalid --#}\n {% set strategy = dbt_bigquery_validate_get_incremental_strategy(config) -%}\n\n {%- set raw_partition_by = config.get('partition_by', none) -%}\n {%- set partition_by = adapter.parse_partition_by(raw_partition_by) -%}\n {%- set partitions = config.get('partitions', none) -%}\n {%- set cluster_by = config.get('cluster_by', none) -%}\n\n {% set on_schema_change = incremental_validate_on_schema_change(config.get('on_schema_change'), default='ignore') %}\n {% set incremental_predicates = config.get('predicates', default=none) or config.get('incremental_predicates', default=none) %}\n\n -- grab current tables grants config for comparison later on\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks) }}\n\n {% if partition_by.copy_partitions is true and strategy != 'insert_overwrite' %} {#-- We can't copy partitions with merge strategy --#}\n {% set wrong_strategy_msg -%}\n The 'copy_partitions' option requires the 'incremental_strategy' option to be set to 'insert_overwrite'.\n {%- endset %}\n {% do exceptions.raise_compiler_error(wrong_strategy_msg) %}\n\n {% elif existing_relation is none %}\n {%- call statement('main', language=language) -%}\n {{ bq_create_table_as(partition_by, False, target_relation, compiled_code, language) }}\n {%- endcall -%}\n\n {% elif existing_relation.is_view %}\n {#-- There's no way to atomically replace a view with a table on BQ --#}\n {{ adapter.drop_relation(existing_relation) }}\n {%- call statement('main', language=language) -%}\n {{ bq_create_table_as(partition_by, False, target_relation, compiled_code, language) }}\n {%- endcall -%}\n\n {% elif full_refresh_mode %}\n {#-- If the partition/cluster config has changed, then we must drop and recreate --#}\n {% if not adapter.is_replaceable(existing_relation, partition_by, cluster_by) %}\n {% do log(\"Hard refreshing \" ~ existing_relation ~ \" because it is not replaceable\") %}\n {{ adapter.drop_relation(existing_relation) }}\n {% endif %}\n {%- call statement('main', language=language) -%}\n {{ bq_create_table_as(partition_by, False, target_relation, compiled_code, language) }}\n {%- endcall -%}\n\n {% else %}\n {%- if language == 'python' and strategy == 'insert_overwrite' -%}\n {#-- This lets us move forward assuming no python will be directly templated into a query --#}\n {%- set python_unsupported_msg -%}\n The 'insert_overwrite' strategy is not yet supported for python models.\n {%- endset %}\n {% do exceptions.raise_compiler_error(python_unsupported_msg) %}\n {%- endif -%}\n\n {% set tmp_relation_exists = false %}\n {% if on_schema_change != 'ignore' or language == 'python' %}\n {#-- Check first, since otherwise we may not build a temp table --#}\n {#-- Python always needs to create a temp table --#}\n {%- call statement('create_tmp_relation', language=language) -%}\n {{ bq_create_table_as(partition_by, True, tmp_relation, compiled_code, language) }}\n {%- endcall -%}\n {% set tmp_relation_exists = true %}\n {#-- Process schema changes. Returns dict of changes if successful. Use source columns for upserting/merging --#}\n {% set dest_columns = process_schema_changes(on_schema_change, tmp_relation, existing_relation) %}\n {% endif %}\n\n {% if not dest_columns %}\n {% set dest_columns = adapter.get_columns_in_relation(existing_relation) %}\n {% endif %}\n {#-- Add time ingestion pseudo column to destination column as not part of the 'schema' but still need it for actual data insertion --#}\n {% if partition_by.time_ingestion_partitioning %}\n {% set dest_columns = adapter.add_time_ingestion_partition_column(partition_by, dest_columns) %}\n {% endif %}\n\n {% set build_sql = bq_generate_incremental_build_sql(\n strategy, tmp_relation, target_relation, compiled_code, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, partition_by.copy_partitions, incremental_predicates\n ) %}\n\n {%- call statement('main') -%}\n {{ build_sql }}\n {% endcall %}\n\n {%- if language == 'python' and tmp_relation -%}\n {{ adapter.drop_relation(tmp_relation) }}\n {%- endif -%}\n\n {% endif %}\n\n {{ run_hooks(post_hooks) }}\n\n {% set target_relation = this.incorporate(type='table') %}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode) %}\n {% do apply_grants(target_relation, grant_config, should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {{ return({'relations': [target_relation]}) }}\n\n{%- endmaterialization %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh", "macro.dbt.load_relation", "macro.dbt.make_temp_relation", "macro.dbt_bigquery.dbt_bigquery_validate_get_incremental_strategy", "macro.dbt.incremental_validate_on_schema_change", "macro.dbt.run_hooks", "macro.dbt.statement", "macro.dbt_bigquery.bq_create_table_as", "macro.dbt.process_schema_changes", "macro.dbt_bigquery.bq_generate_incremental_build_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.69751, "supported_languages": ["sql", "python"]}, "macro.dbt_bigquery.bigquery__snapshot_hash_arguments": {"name": "bigquery__snapshot_hash_arguments", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/snapshot.sql", "original_file_path": "macros/materializations/snapshot.sql", "unique_id": "macro.dbt_bigquery.bigquery__snapshot_hash_arguments", "macro_sql": "{% macro bigquery__snapshot_hash_arguments(args) -%}\n to_hex(md5(concat({%- for arg in args -%}\n coalesce(cast({{ arg }} as string), ''){% if not loop.last %}, '|',{% endif -%}\n {%- endfor -%}\n )))\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6979342, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_columns": {"name": "bigquery__create_columns", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/snapshot.sql", "original_file_path": "macros/materializations/snapshot.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_columns", "macro_sql": "{% macro bigquery__create_columns(relation, columns) %}\n {{ adapter.alter_table_add_columns(relation, columns) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.698096, "supported_languages": null}, "macro.dbt_bigquery.bigquery__post_snapshot": {"name": "bigquery__post_snapshot", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/snapshot.sql", "original_file_path": "macros/materializations/snapshot.sql", "unique_id": "macro.dbt_bigquery.bigquery__post_snapshot", "macro_sql": "{% macro bigquery__post_snapshot(staging_relation) %}\n -- Clean up the snapshot temp table\n {% do drop_relation(staging_relation) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.drop_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.698236, "supported_languages": null}, "macro.dbt_bigquery.bigquery__can_clone_table": {"name": "bigquery__can_clone_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/clone.sql", "original_file_path": "macros/materializations/clone.sql", "unique_id": "macro.dbt_bigquery.bigquery__can_clone_table", "macro_sql": "{% macro bigquery__can_clone_table() %}\n {{ return(True) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.698433, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_or_replace_clone": {"name": "bigquery__create_or_replace_clone", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/clone.sql", "original_file_path": "macros/materializations/clone.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_or_replace_clone", "macro_sql": "{% macro bigquery__create_or_replace_clone(this_relation, defer_relation) %}\n create or replace\n table {{ this_relation }}\n clone {{ defer_relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.69857, "supported_languages": null}, "macro.dbt_bigquery.bq_generate_incremental_merge_build_sql": {"name": "bq_generate_incremental_merge_build_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/merge.sql", "original_file_path": "macros/materializations/incremental_strategy/merge.sql", "unique_id": "macro.dbt_bigquery.bq_generate_incremental_merge_build_sql", "macro_sql": "{% macro bq_generate_incremental_merge_build_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, incremental_predicates\n) %}\n {%- set source_sql -%}\n {%- if tmp_relation_exists -%}\n (\n select\n {% if partition_by.time_ingestion_partitioning -%}\n {{ partition_by.insertable_time_partitioning_field() }},\n {%- endif -%}\n * from {{ tmp_relation }}\n )\n {%- else -%} {#-- wrap sql in parens to make it a subquery --#}\n (\n {%- if partition_by.time_ingestion_partitioning -%}\n {{ wrap_with_time_ingestion_partitioning_sql(partition_by, sql, True) }}\n {%- else -%}\n {{sql}}\n {%- endif %}\n )\n {%- endif -%}\n {%- endset -%}\n\n {% set build_sql = get_merge_sql(target_relation, source_sql, unique_key, dest_columns, incremental_predicates) %}\n\n {{ return(build_sql) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql", "macro.dbt.get_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.6995041, "supported_languages": null}, "macro.dbt_bigquery.declare_dbt_max_partition": {"name": "declare_dbt_max_partition", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/common.sql", "original_file_path": "macros/materializations/incremental_strategy/common.sql", "unique_id": "macro.dbt_bigquery.declare_dbt_max_partition", "macro_sql": "{% macro declare_dbt_max_partition(relation, partition_by, compiled_code, language='sql') %}\n\n {#-- TODO: revisit partitioning with python models --#}\n {%- if '_dbt_max_partition' in compiled_code and language == 'sql' -%}\n\n declare _dbt_max_partition {{ partition_by.data_type_for_partition() }} default (\n select max({{ partition_by.field }}) from {{ this }}\n where {{ partition_by.field }} is not null\n );\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.699958, "supported_languages": null}, "macro.dbt_bigquery.bq_generate_incremental_insert_overwrite_build_sql": {"name": "bq_generate_incremental_insert_overwrite_build_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_generate_incremental_insert_overwrite_build_sql", "macro_sql": "{% macro bq_generate_incremental_insert_overwrite_build_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions\n) %}\n {% if partition_by is none %}\n {% set missing_partition_msg -%}\n The 'insert_overwrite' strategy requires the `partition_by` config.\n {%- endset %}\n {% do exceptions.raise_compiler_error(missing_partition_msg) %}\n {% endif %}\n\n {% set build_sql = bq_insert_overwrite_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions\n ) %}\n\n {{ return(build_sql) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bq_insert_overwrite_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.702878, "supported_languages": null}, "macro.dbt_bigquery.bq_copy_partitions": {"name": "bq_copy_partitions", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_copy_partitions", "macro_sql": "{% macro bq_copy_partitions(tmp_relation, target_relation, partitions, partition_by) %}\n\n {% for partition in partitions %}\n {% if partition_by.data_type == 'int64' %}\n {% set partition = partition | as_text %}\n {% elif partition_by.granularity == 'hour' %}\n {% set partition = partition.strftime(\"%Y%m%d%H\") %}\n {% elif partition_by.granularity == 'day' %}\n {% set partition = partition.strftime(\"%Y%m%d\") %}\n {% elif partition_by.granularity == 'month' %}\n {% set partition = partition.strftime(\"%Y%m\") %}\n {% elif partition_by.granularity == 'year' %}\n {% set partition = partition.strftime(\"%Y\") %}\n {% endif %}\n {% set tmp_relation_partitioned = api.Relation.create(database=tmp_relation.database, schema=tmp_relation.schema, identifier=tmp_relation.table ~ '$' ~ partition, type=tmp_relation.type) %}\n {% set target_relation_partitioned = api.Relation.create(database=target_relation.database, schema=target_relation.schema, identifier=target_relation.table ~ '$' ~ partition, type=target_relation.type) %}\n {% do adapter.copy_table(tmp_relation_partitioned, target_relation_partitioned, \"table\") %}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7042508, "supported_languages": null}, "macro.dbt_bigquery.bq_insert_overwrite_sql": {"name": "bq_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_insert_overwrite_sql", "macro_sql": "{% macro bq_insert_overwrite_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions\n) %}\n {% if partitions is not none and partitions != [] %} {# static #}\n {{ bq_static_insert_overwrite_sql(tmp_relation, target_relation, sql, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions) }}\n {% else %} {# dynamic #}\n {{ bq_dynamic_insert_overwrite_sql(tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, copy_partitions) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bq_static_insert_overwrite_sql", "macro.dbt_bigquery.bq_dynamic_insert_overwrite_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7048378, "supported_languages": null}, "macro.dbt_bigquery.bq_static_insert_overwrite_sql": {"name": "bq_static_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_static_insert_overwrite_sql", "macro_sql": "{% macro bq_static_insert_overwrite_sql(\n tmp_relation, target_relation, sql, partition_by, partitions, dest_columns, tmp_relation_exists, copy_partitions\n) %}\n\n {% set predicate -%}\n {{ partition_by.render_wrapped(alias='DBT_INTERNAL_DEST') }} in (\n {{ partitions | join (', ') }}\n )\n {%- endset %}\n\n {%- set source_sql -%}\n (\n {% if partition_by.time_ingestion_partitioning and tmp_relation_exists -%}\n select\n {{ partition_by.insertable_time_partitioning_field() }},\n * from {{ tmp_relation }}\n {% elif tmp_relation_exists -%}\n select\n * from {{ tmp_relation }}\n {%- elif partition_by.time_ingestion_partitioning -%}\n {{ wrap_with_time_ingestion_partitioning_sql(partition_by, sql, True) }}\n {%- else -%}\n {{sql}}\n {%- endif -%}\n\n )\n {%- endset -%}\n\n {% if copy_partitions %}\n {% do bq_copy_partitions(tmp_relation, target_relation, partitions, partition_by) %}\n {% else %}\n\n {#-- In case we're putting the model SQL _directly_ into the MERGE statement,\n we need to prepend the MERGE statement with the user-configured sql_header,\n which may be needed to resolve that model SQL (e.g. referencing a variable or UDF in the header)\n in the \"temporary table exists\" case, we save the model SQL result as a temp table first, wherein the\n sql_header is included by the create_table_as macro.\n #}\n -- 1. run the merge statement\n {{ get_insert_overwrite_merge_sql(target_relation, source_sql, dest_columns, [predicate], include_sql_header = not tmp_relation_exists) }};\n\n {%- if tmp_relation_exists -%}\n -- 2. clean up the temp table\n drop table if exists {{ tmp_relation }};\n {%- endif -%}\n\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql", "macro.dbt_bigquery.bq_copy_partitions", "macro.dbt.get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.705873, "supported_languages": null}, "macro.dbt_bigquery.bq_dynamic_copy_partitions_insert_overwrite_sql": {"name": "bq_dynamic_copy_partitions_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_dynamic_copy_partitions_insert_overwrite_sql", "macro_sql": "{% macro bq_dynamic_copy_partitions_insert_overwrite_sql(\n tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, copy_partitions\n ) %}\n {%- if tmp_relation_exists is false -%}\n {# We run temp table creation in a separated script to move to partitions copy if it doesn't already exist #}\n {%- call statement('create_tmp_relation_for_copy', language='sql') -%}\n {{ bq_create_table_as(partition_by, True, tmp_relation, sql, 'sql')\n }}\n {%- endcall %}\n {%- endif -%}\n {%- set partitions_sql -%}\n select distinct {{ partition_by.render_wrapped() }}\n from {{ tmp_relation }}\n {%- endset -%}\n {%- set partitions = run_query(partitions_sql).columns[0].values() -%}\n {# We copy the partitions #}\n {%- do bq_copy_partitions(tmp_relation, target_relation, partitions, partition_by) -%}\n -- Clean up the temp table\n drop table if exists {{ tmp_relation }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_bigquery.bq_create_table_as", "macro.dbt.run_query", "macro.dbt_bigquery.bq_copy_partitions"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7065961, "supported_languages": null}, "macro.dbt_bigquery.bq_dynamic_insert_overwrite_sql": {"name": "bq_dynamic_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "original_file_path": "macros/materializations/incremental_strategy/insert_overwrite.sql", "unique_id": "macro.dbt_bigquery.bq_dynamic_insert_overwrite_sql", "macro_sql": "{% macro bq_dynamic_insert_overwrite_sql(tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, copy_partitions) %}\n {%- if copy_partitions is true %}\n {{ bq_dynamic_copy_partitions_insert_overwrite_sql(tmp_relation, target_relation, sql, unique_key, partition_by, dest_columns, tmp_relation_exists, copy_partitions) }}\n {% else -%}\n {% set predicate -%}\n {{ partition_by.render_wrapped(alias='DBT_INTERNAL_DEST') }} in unnest(dbt_partitions_for_replacement)\n {%- endset %}\n\n {%- set source_sql -%}\n (\n select\n {% if partition_by.time_ingestion_partitioning -%}\n {{ partition_by.insertable_time_partitioning_field() }},\n {%- endif -%}\n * from {{ tmp_relation }}\n )\n {%- endset -%}\n\n -- generated script to merge partitions into {{ target_relation }}\n declare dbt_partitions_for_replacement array<{{ partition_by.data_type_for_partition() }}>;\n\n {# have we already created the temp table to check for schema changes? #}\n {% if not tmp_relation_exists %}\n -- 1. create a temp table with model data\n {{ bq_create_table_as(partition_by, True, tmp_relation, sql, 'sql') }}\n {% else %}\n -- 1. temp table already exists, we used it to check for schema changes\n {% endif %}\n {%- set partition_field = partition_by.time_partitioning_field() if partition_by.time_ingestion_partitioning else partition_by.render_wrapped() -%}\n\n -- 2. define partitions to update\n set (dbt_partitions_for_replacement) = (\n select as struct\n -- IGNORE NULLS: this needs to be aligned to _dbt_max_partition, which ignores null\n array_agg(distinct {{ partition_field }} IGNORE NULLS)\n from {{ tmp_relation }}\n );\n\n -- 3. run the merge statement\n {{ get_insert_overwrite_merge_sql(target_relation, source_sql, dest_columns, [predicate]) }};\n\n -- 4. clean up the temp table\n drop table if exists {{ tmp_relation }}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bq_dynamic_copy_partitions_insert_overwrite_sql", "macro.dbt_bigquery.bq_create_table_as", "macro.dbt.get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7077708, "supported_languages": null}, "macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql": {"name": "wrap_with_time_ingestion_partitioning_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "original_file_path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "unique_id": "macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql", "macro_sql": "{% macro wrap_with_time_ingestion_partitioning_sql(partition_by, sql, is_nested) %}\n\n select TIMESTAMP({{ partition_by.field }}) as {{ partition_by.insertable_time_partitioning_field() }}, * EXCEPT({{ partition_by.field }}) from (\n {{ sql }}\n ){%- if not is_nested -%};{%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.709187, "supported_languages": null}, "macro.dbt_bigquery.get_quoted_with_types_csv": {"name": "get_quoted_with_types_csv", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "original_file_path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "unique_id": "macro.dbt_bigquery.get_quoted_with_types_csv", "macro_sql": "{% macro get_quoted_with_types_csv(columns) %}\n {% set quoted = [] %}\n {% for col in columns -%}\n {%- do quoted.append(adapter.quote(col.name) ~ \" \" ~ col.data_type) -%}\n {%- endfor %}\n {%- set dest_cols_csv = quoted | join(', ') -%}\n {{ return(dest_cols_csv) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.709625, "supported_languages": null}, "macro.dbt_bigquery.columns_without_partition_fields_csv": {"name": "columns_without_partition_fields_csv", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "original_file_path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "unique_id": "macro.dbt_bigquery.columns_without_partition_fields_csv", "macro_sql": "{% macro columns_without_partition_fields_csv(partition_config, columns) -%}\n {%- set columns_no_partition = partition_config.reject_partition_field_column(columns) -%}\n {% set columns_names = get_quoted_with_types_csv(columns_no_partition) %}\n {{ return(columns_names) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_bigquery.get_quoted_with_types_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7098932, "supported_languages": null}, "macro.dbt_bigquery.bq_insert_into_ingestion_time_partitioned_table_sql": {"name": "bq_insert_into_ingestion_time_partitioned_table_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "original_file_path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "unique_id": "macro.dbt_bigquery.bq_insert_into_ingestion_time_partitioned_table_sql", "macro_sql": "{% macro bq_insert_into_ingestion_time_partitioned_table_sql(target_relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n {{ sql_header if sql_header is not none }}\n {%- set raw_partition_by = config.get('partition_by', none) -%}\n {%- set partition_by = adapter.parse_partition_by(raw_partition_by) -%}\n {% set dest_columns = adapter.get_columns_in_relation(target_relation) %}\n {%- set dest_columns_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n\n insert into {{ target_relation }} ({{ partition_by.insertable_time_partitioning_field() }}, {{ dest_columns_csv }})\n {{ wrap_with_time_ingestion_partitioning_sql(partition_by, sql, False) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.get_quoted_csv", "macro.dbt_bigquery.wrap_with_time_ingestion_partitioning_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.710578, "supported_languages": null}, "macro.dbt_bigquery.get_columns_with_types_in_query_sql": {"name": "get_columns_with_types_in_query_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "original_file_path": "macros/materializations/incremental_strategy/time_ingestion_tables.sql", "unique_id": "macro.dbt_bigquery.get_columns_with_types_in_query_sql", "macro_sql": "{% macro get_columns_with_types_in_query_sql(select_sql) %}\n {% set sql %}\n {%- set sql_header = config.get('sql_header', none) -%}\n {{ sql_header if sql_header is not none }}\n select * from (\n {{ select_sql }}\n ) as __dbt_sbq\n where false\n limit 0\n {% endset %}\n {{ return(adapter.get_columns_in_select_sql(sql)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7109492, "supported_languages": null}, "macro.dbt_bigquery.bigquery__drop_relation": {"name": "bigquery__drop_relation", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt_bigquery.bigquery__drop_relation", "macro_sql": "{% macro bigquery__drop_relation(relation) -%}\n {% do adapter.drop_relation(relation) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.711137, "supported_languages": null}, "macro.dbt_bigquery.bigquery_options": {"name": "bigquery_options", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/options.sql", "original_file_path": "macros/relations/options.sql", "unique_id": "macro.dbt_bigquery.bigquery_options", "macro_sql": "{% macro bigquery_options(opts) %}\n {% set options -%}\n OPTIONS({% for opt_key, opt_val in opts.items() %}\n {{ opt_key }}={{ opt_val }}{{ \",\" if not loop.last }}\n {% endfor %})\n {%- endset %}\n {%- do return(options) -%}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7116249, "supported_languages": null}, "macro.dbt_bigquery.cluster_by": {"name": "cluster_by", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/cluster.sql", "original_file_path": "macros/relations/cluster.sql", "unique_id": "macro.dbt_bigquery.cluster_by", "macro_sql": "{% macro cluster_by(raw_cluster_by) %}\n {%- if raw_cluster_by is not none -%}\n cluster by {% if raw_cluster_by is string -%}\n {% set raw_cluster_by = [raw_cluster_by] %}\n {%- endif -%}\n {%- for cluster in raw_cluster_by -%}\n {{ cluster }}\n {%- if not loop.last -%}, {% endif -%}\n {%- endfor -%}\n\n {% endif %}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.71212, "supported_languages": null}, "macro.dbt_bigquery.bigquery__rename_relation": {"name": "bigquery__rename_relation", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/rename.sql", "original_file_path": "macros/relations/rename.sql", "unique_id": "macro.dbt_bigquery.bigquery__rename_relation", "macro_sql": "{% macro bigquery__rename_relation(from_relation, to_relation) -%}\n {% do adapter.rename_relation(from_relation, to_relation) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.712335, "supported_languages": null}, "macro.dbt_bigquery.partition_by": {"name": "partition_by", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/partition.sql", "original_file_path": "macros/relations/partition.sql", "unique_id": "macro.dbt_bigquery.partition_by", "macro_sql": "{% macro partition_by(partition_config) -%}\n {%- if partition_config is none -%}\n {% do return('') %}\n {%- elif partition_config.time_ingestion_partitioning -%}\n partition by {{ partition_config.render_wrapped() }}\n {%- elif partition_config.data_type | lower in ('date','timestamp','datetime') -%}\n partition by {{ partition_config.render() }}\n {%- elif partition_config.data_type | lower in ('int64') -%}\n {%- set range = partition_config.range -%}\n partition by range_bucket(\n {{ partition_config.field }},\n generate_array({{ range.start}}, {{ range.end }}, {{ range.interval }})\n )\n {%- endif -%}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.713216, "supported_languages": null}, "macro.dbt_bigquery.bigquery__drop_materialized_view": {"name": "bigquery__drop_materialized_view", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/drop.sql", "original_file_path": "macros/relations/materialized_view/drop.sql", "unique_id": "macro.dbt_bigquery.bigquery__drop_materialized_view", "macro_sql": "{% macro bigquery__drop_materialized_view(relation) %}\n drop materialized view if exists {{ relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.713366, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_replace_materialized_view_as_sql": {"name": "bigquery__get_replace_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/replace.sql", "original_file_path": "macros/relations/materialized_view/replace.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_replace_materialized_view_as_sql", "macro_sql": "{% macro bigquery__get_replace_materialized_view_as_sql(relation, sql) %}\n\n {%- set materialized_view = adapter.Relation.materialized_view_from_model_node(config.model) -%}\n\n create or replace materialized view if not exists {{ relation }}\n {% if materialized_view.partition %}{{ partition_by(materialized_view.partition) }}{% endif %}\n {% if materialized_view.cluster %}{{ cluster_by(materialized_view.cluster.fields) }}{% endif %}\n {{ bigquery_options(materialized_view.options.as_ddl_dict()) }}\n as {{ sql }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.partition_by", "macro.dbt_bigquery.cluster_by", "macro.dbt_bigquery.bigquery_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.714004, "supported_languages": null}, "macro.dbt_bigquery.bigquery__refresh_materialized_view": {"name": "bigquery__refresh_materialized_view", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/refresh.sql", "original_file_path": "macros/relations/materialized_view/refresh.sql", "unique_id": "macro.dbt_bigquery.bigquery__refresh_materialized_view", "macro_sql": "{% macro bigquery__refresh_materialized_view(relation) %}\n call bq.refresh_materialized_view('{{ relation.database }}.{{ relation.schema }}.{{ relation.identifier }}')\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.714229, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_alter_materialized_view_as_sql": {"name": "bigquery__get_alter_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_alter_materialized_view_as_sql", "macro_sql": "{% macro bigquery__get_alter_materialized_view_as_sql(\n relation,\n configuration_changes,\n sql,\n existing_relation,\n backup_relation,\n intermediate_relation\n) %}\n\n {% if configuration_changes.requires_full_refresh %}\n {{ get_replace_sql(existing_relation, relation, sql) }}\n {% else %}\n\n alter materialized view {{ relation }}\n set {{ bigquery_options(configuration_changes.options.context.as_ddl_dict()) }}\n\n {%- endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_replace_sql", "macro.dbt_bigquery.bigquery_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.714824, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_materialized_view_configuration_changes": {"name": "bigquery__get_materialized_view_configuration_changes", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_materialized_view_configuration_changes", "macro_sql": "{% macro bigquery__get_materialized_view_configuration_changes(existing_relation, new_config) %}\n {% set _existing_materialized_view = adapter.describe_relation(existing_relation) %}\n {% set _configuration_changes = existing_relation.materialized_view_config_changeset(_existing_materialized_view, new_config) %}\n {% do return(_configuration_changes) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.715134, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_create_materialized_view_as_sql": {"name": "bigquery__get_create_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/materialized_view/create.sql", "original_file_path": "macros/relations/materialized_view/create.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_create_materialized_view_as_sql", "macro_sql": "{% macro bigquery__get_create_materialized_view_as_sql(relation, sql) %}\n\n {%- set materialized_view = adapter.Relation.materialized_view_from_model_node(config.model) -%}\n\n create materialized view if not exists {{ relation }}\n {% if materialized_view.partition %}{{ partition_by(materialized_view.partition) }}{% endif %}\n {% if materialized_view.cluster %}{{ cluster_by(materialized_view.cluster.fields) }}{% endif %}\n {{ bigquery_options(materialized_view.options.as_ddl_dict()) }}\n as {{ sql }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.partition_by", "macro.dbt_bigquery.cluster_by", "macro.dbt_bigquery.bigquery_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.715769, "supported_languages": null}, "macro.dbt_bigquery.bigquery__drop_table": {"name": "bigquery__drop_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/table/drop.sql", "original_file_path": "macros/relations/table/drop.sql", "unique_id": "macro.dbt_bigquery.bigquery__drop_table", "macro_sql": "{% macro bigquery__drop_table(relation) %}\n drop table if exists {{ relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7159119, "supported_languages": null}, "macro.dbt_bigquery.bigquery_table_options": {"name": "bigquery_table_options", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/table/options.sql", "original_file_path": "macros/relations/table/options.sql", "unique_id": "macro.dbt_bigquery.bigquery_table_options", "macro_sql": "{% macro bigquery_table_options(config, node, temporary) %}\n {% set opts = adapter.get_table_options(config, node, temporary) %}\n {%- do return(bigquery_options(opts)) -%}\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.716219, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_rename_table_sql": {"name": "bigquery__get_rename_table_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/table/rename.sql", "original_file_path": "macros/relations/table/rename.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_rename_table_sql", "macro_sql": "{%- macro bigquery__get_rename_table_sql(relation, new_name) -%}\n alter table {{ relation }} rename to {{ new_name }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7164009, "supported_languages": null}, "macro.dbt_bigquery.bigquery__drop_view": {"name": "bigquery__drop_view", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/drop.sql", "original_file_path": "macros/relations/view/drop.sql", "unique_id": "macro.dbt_bigquery.bigquery__drop_view", "macro_sql": "{% macro bigquery__drop_view(relation) %}\n drop view if exists {{ relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.716543, "supported_languages": null}, "macro.dbt_bigquery.bigquery__create_or_replace_view": {"name": "bigquery__create_or_replace_view", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt_bigquery.bigquery__create_or_replace_view", "macro_sql": "{% macro bigquery__create_or_replace_view() %}\n {%- set identifier = model['alias'] -%}\n\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n {%- set exists_as_view = (old_relation is not none and old_relation.is_view) -%}\n\n {%- set target_relation = api.Relation.create(\n identifier=identifier, schema=schema, database=database,\n type='view') -%}\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks) }}\n\n -- If there's a table with the same name and we weren't told to full refresh,\n -- that's an error. If we were told to full refresh, drop it. This behavior differs\n -- for Snowflake and BigQuery, so multiple dispatch is used.\n {%- if old_relation is not none and not old_relation.is_view -%}\n {{ handle_existing_table(should_full_refresh(), old_relation) }}\n {%- endif -%}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_view_as_sql(target_relation, sql) }}\n {%- endcall %}\n\n {% set should_revoke = should_revoke(exists_as_view, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {{ run_hooks(post_hooks) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt_bigquery.handle_existing_table", "macro.dbt.should_full_refresh", "macro.dbt.statement", "macro.dbt.get_create_view_as_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.718415, "supported_languages": null}, "macro.dbt_bigquery.handle_existing_table": {"name": "handle_existing_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt_bigquery.handle_existing_table", "macro_sql": "{% macro handle_existing_table(full_refresh, old_relation) %}\n {{ adapter.dispatch('handle_existing_table', 'dbt')(full_refresh, old_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__handle_existing_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.718622, "supported_languages": null}, "macro.dbt_bigquery.default__handle_existing_table": {"name": "default__handle_existing_table", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt_bigquery.default__handle_existing_table", "macro_sql": "{% macro default__handle_existing_table(full_refresh, old_relation) %}\n {{ log(\"Dropping relation \" ~ old_relation ~ \" because it is of type \" ~ old_relation.type) }}\n {{ adapter.drop_relation(old_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.718855, "supported_languages": null}, "macro.dbt_bigquery.bigquery_view_options": {"name": "bigquery_view_options", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/options.sql", "original_file_path": "macros/relations/view/options.sql", "unique_id": "macro.dbt_bigquery.bigquery_view_options", "macro_sql": "{% macro bigquery_view_options(config, node) %}\n {% set opts = adapter.get_view_options(config, node) %}\n {%- do return(bigquery_options(opts)) -%}\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery_options"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.719141, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_rename_view_sql": {"name": "bigquery__get_rename_view_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/relations/view/rename.sql", "original_file_path": "macros/relations/view/rename.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_rename_view_sql", "macro_sql": "{%- macro bigquery__get_rename_view_sql(relation, new_name) -%}\n alter view {{ relation }} rename to {{ new_name }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.719318, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_catalog_relations": {"name": "bigquery__get_catalog_relations", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/by_relation.sql", "original_file_path": "macros/catalog/by_relation.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_catalog_relations", "macro_sql": "{% macro bigquery__get_catalog_relations(information_schema, relations) -%}\n\n {%- if (relations | length) == 0 -%}\n {# Hopefully nothing cares about the columns we return when there are no rows #}\n {%- set query = \"select 1 as id limit 0\" -%}\n\n {%- else -%}\n {%- set query -%}\n with\n table_shards_stage as ({{ _bigquery__get_table_shards_sql(information_schema) }}),\n table_shards as (\n select * from table_shards_stage\n where (\n {%- for relation in relations -%}\n (\n upper(table_schema) = upper('{{ relation.schema }}')\n and upper(table_name) = upper('{{ relation.identifier }}')\n )\n {%- if not loop.last %} or {% endif -%}\n {%- endfor -%}\n )\n ),\n tables as ({{ _bigquery__get_tables_sql() }}),\n table_stats as ({{ _bigquery__get_table_stats_sql() }}),\n\n columns as ({{ _bigquery__get_columns_sql(information_schema) }}),\n column_stats as ({{ _bigquery__get_column_stats_sql() }})\n\n {{ _bigquery__get_extended_catalog_sql() }}\n {%- endset -%}\n\n {%- endif -%}\n\n {{ return(run_query(query)) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery._bigquery__get_table_shards_sql", "macro.dbt_bigquery._bigquery__get_tables_sql", "macro.dbt_bigquery._bigquery__get_table_stats_sql", "macro.dbt_bigquery._bigquery__get_columns_sql", "macro.dbt_bigquery._bigquery__get_column_stats_sql", "macro.dbt_bigquery._bigquery__get_extended_catalog_sql", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.720747, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_table_shards_sql": {"name": "_bigquery__get_table_shards_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_table_shards_sql", "macro_sql": "{% macro _bigquery__get_table_shards_sql(information_schema) %}\n select\n tables.project_id as table_catalog,\n tables.dataset_id as table_schema,\n coalesce(REGEXP_EXTRACT(tables.table_id, '^(.+)[0-9]{8}$'), tables.table_id) as table_name,\n tables.table_id as shard_name,\n REGEXP_EXTRACT(tables.table_id, '^.+([0-9]{8})$') as shard_index,\n REGEXP_CONTAINS(tables.table_id, '^.+[0-9]{8}$') and tables.type = 1 as is_date_shard,\n case\n when materialized_views.table_name is not null then 'materialized view'\n when tables.type = 1 then 'table'\n when tables.type = 2 then 'view'\n else 'external'\n end as table_type,\n tables.type = 1 as is_table,\n JSON_VALUE(table_description.option_value) as table_comment,\n tables.size_bytes,\n tables.row_count\n from {{ information_schema.replace(information_schema_view='__TABLES__') }} tables\n left join {{ information_schema.replace(information_schema_view='MATERIALIZED_VIEWS') }} materialized_views\n on materialized_views.table_catalog = tables.project_id\n and materialized_views.table_schema = tables.dataset_id\n and materialized_views.table_name = tables.table_id\n left join {{ information_schema.replace(information_schema_view='TABLE_OPTIONS') }} table_description\n on table_description.table_catalog = tables.project_id\n and table_description.table_schema = tables.dataset_id\n and table_description.table_name = tables.table_id\n and table_description.option_name = 'description'\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.replace"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.72354, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_tables_sql": {"name": "_bigquery__get_tables_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_tables_sql", "macro_sql": "{% macro _bigquery__get_tables_sql() %}\n select distinct\n table_catalog,\n table_schema,\n table_name,\n is_date_shard,\n table_type,\n is_table,\n table_comment\n from table_shards\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7236311, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_table_stats_sql": {"name": "_bigquery__get_table_stats_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_table_stats_sql", "macro_sql": "{% macro _bigquery__get_table_stats_sql() %}\n select\n table_catalog,\n table_schema,\n table_name,\n max(shard_name) as latest_shard_name,\n min(shard_index) as shard_min,\n max(shard_index) as shard_max,\n count(shard_index) as shard_count,\n sum(size_bytes) as size_bytes,\n sum(row_count) as row_count\n from table_shards\n group by 1, 2, 3\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.723727, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_columns_sql": {"name": "_bigquery__get_columns_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_columns_sql", "macro_sql": "{% macro _bigquery__get_columns_sql(information_schema) %}\n select\n columns.table_catalog,\n columns.table_schema,\n columns.table_name as shard_name,\n coalesce(paths.field_path, '') as column_name,\n -- invent a row number to account for nested fields\n -- BQ does not treat these nested properties as independent fields\n row_number() over (\n partition by\n columns.table_catalog,\n columns.table_schema,\n columns.table_name\n order by\n columns.ordinal_position,\n paths.field_path\n ) as column_index,\n coalesce(paths.data_type, '') as column_type,\n paths.description as column_comment,\n case when columns.is_partitioning_column = 'YES' then 1 else 0 end as is_partitioning_column,\n case when columns.is_partitioning_column = 'YES' then paths.field_path end as partition_column,\n case when columns.clustering_ordinal_position is not null then 1 else 0 end as is_clustering_column,\n case when columns.clustering_ordinal_position is not null then paths.field_path end as cluster_column,\n columns.clustering_ordinal_position\n from {{ information_schema.replace(information_schema_view='COLUMNS') }} columns\n join {{ information_schema.replace(information_schema_view='COLUMN_FIELD_PATHS') }} paths\n on paths.table_catalog = columns.table_catalog\n and paths.table_schema = columns.table_schema\n and paths.table_name = columns.table_name\n and paths.column_name = columns.column_name\n where columns.ordinal_position is not null\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.replace"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7240162, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_column_stats_sql": {"name": "_bigquery__get_column_stats_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_column_stats_sql", "macro_sql": "{% macro _bigquery__get_column_stats_sql() %}\n select\n table_catalog,\n table_schema,\n shard_name,\n max(is_partitioning_column) = 1 as is_partitioned,\n max(partition_column) as partition_column,\n max(is_clustering_column) = 1 as is_clustered,\n array_to_string(\n array_agg(\n cluster_column ignore nulls\n order by clustering_ordinal_position\n ), ', '\n ) as clustering_columns\n from columns\n group by 1, 2, 3\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7241228, "supported_languages": null}, "macro.dbt_bigquery._bigquery__get_extended_catalog_sql": {"name": "_bigquery__get_extended_catalog_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/catalog.sql", "original_file_path": "macros/catalog/catalog.sql", "unique_id": "macro.dbt_bigquery._bigquery__get_extended_catalog_sql", "macro_sql": "{% macro _bigquery__get_extended_catalog_sql() %}\n select\n tables.table_catalog as table_database,\n tables.table_schema,\n case\n when tables.is_date_shard then concat(tables.table_name, '*')\n else tables.table_name\n end as table_name,\n tables.table_type,\n tables.table_comment,\n -- coalesce column metadata fields to ensure they are non-null for catalog generation\n -- external table columns are not present in COLUMN_FIELD_PATHS\n coalesce(columns.column_name, '') as column_name,\n coalesce(columns.column_index, 1) as column_index,\n coalesce(columns.column_type, '') as column_type,\n coalesce(columns.column_comment, '') as column_comment,\n\n 'Shard count' as `stats__date_shards__label`,\n table_stats.shard_count as `stats__date_shards__value`,\n 'The number of date shards in this table' as `stats__date_shards__description`,\n tables.is_date_shard as `stats__date_shards__include`,\n\n 'Shard (min)' as `stats__date_shard_min__label`,\n table_stats.shard_min as `stats__date_shard_min__value`,\n 'The first date shard in this table' as `stats__date_shard_min__description`,\n tables.is_date_shard as `stats__date_shard_min__include`,\n\n 'Shard (max)' as `stats__date_shard_max__label`,\n table_stats.shard_max as `stats__date_shard_max__value`,\n 'The last date shard in this table' as `stats__date_shard_max__description`,\n tables.is_date_shard as `stats__date_shard_max__include`,\n\n '# Rows' as `stats__num_rows__label`,\n table_stats.row_count as `stats__num_rows__value`,\n 'Approximate count of rows in this table' as `stats__num_rows__description`,\n tables.is_table as `stats__num_rows__include`,\n\n 'Approximate Size' as `stats__num_bytes__label`,\n table_stats.size_bytes as `stats__num_bytes__value`,\n 'Approximate size of table as reported by BigQuery' as `stats__num_bytes__description`,\n tables.is_table as `stats__num_bytes__include`,\n\n 'Partitioned By' as `stats__partitioning_type__label`,\n column_stats.partition_column as `stats__partitioning_type__value`,\n 'The partitioning column for this table' as `stats__partitioning_type__description`,\n column_stats.is_partitioned as `stats__partitioning_type__include`,\n\n 'Clustered By' as `stats__clustering_fields__label`,\n column_stats.clustering_columns as `stats__clustering_fields__value`,\n 'The clustering columns for this table' as `stats__clustering_fields__description`,\n column_stats.is_clustered as `stats__clustering_fields__include`\n\n from tables\n join table_stats\n on table_stats.table_catalog = tables.table_catalog\n and table_stats.table_schema = tables.table_schema\n and table_stats.table_name = tables.table_name\n left join column_stats\n on column_stats.table_catalog = tables.table_catalog\n and column_stats.table_schema = tables.table_schema\n and column_stats.shard_name = table_stats.latest_shard_name\n left join columns\n on columns.table_catalog = tables.table_catalog\n and columns.table_schema = tables.table_schema\n and columns.shard_name = table_stats.latest_shard_name\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.724389, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_catalog": {"name": "bigquery__get_catalog", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/catalog/by_schema.sql", "original_file_path": "macros/catalog/by_schema.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_catalog", "macro_sql": "{% macro bigquery__get_catalog(information_schema, schemas) -%}\n\n {%- if (schemas | length) == 0 -%}\n {# Hopefully nothing cares about the columns we return when there are no rows #}\n {%- set query = \"select 1 as id limit 0\" -%}\n\n {%- else -%}\n {%- set query -%}\n with\n table_shards as (\n {{ _bigquery__get_table_shards_sql(information_schema) }}\n where (\n {%- for schema in schemas -%}\n upper(tables.dataset_id) = upper('{{ schema }}')\n {%- if not loop.last %} or {% endif -%}\n {%- endfor -%}\n )\n ),\n tables as ({{ _bigquery__get_tables_sql() }}),\n table_stats as ({{ _bigquery__get_table_stats_sql() }}),\n\n columns as ({{ _bigquery__get_columns_sql(information_schema) }}),\n column_stats as ({{ _bigquery__get_column_stats_sql() }})\n\n {{ _bigquery__get_extended_catalog_sql() }}\n {%- endset -%}\n\n {%- endif -%}\n\n {{ return(run_query(query)) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery._bigquery__get_table_shards_sql", "macro.dbt_bigquery._bigquery__get_tables_sql", "macro.dbt_bigquery._bigquery__get_table_stats_sql", "macro.dbt_bigquery._bigquery__get_columns_sql", "macro.dbt_bigquery._bigquery__get_column_stats_sql", "macro.dbt_bigquery._bigquery__get_extended_catalog_sql", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7256792, "supported_languages": null}, "macro.dbt_bigquery.bigquery__except": {"name": "bigquery__except", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/except.sql", "original_file_path": "macros/utils/except.sql", "unique_id": "macro.dbt_bigquery.bigquery__except", "macro_sql": "{% macro bigquery__except() %}\n\n except distinct\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.725816, "supported_languages": null}, "macro.dbt_bigquery.bigquery__dateadd": {"name": "bigquery__dateadd", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt_bigquery.bigquery__dateadd", "macro_sql": "{% macro bigquery__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n datetime_add(\n cast( {{ from_date_or_timestamp }} as datetime),\n interval {{ interval }} {{ datepart }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.726061, "supported_languages": null}, "macro.dbt_bigquery.bigquery__current_timestamp": {"name": "bigquery__current_timestamp", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/timestamps.sql", "original_file_path": "macros/utils/timestamps.sql", "unique_id": "macro.dbt_bigquery.bigquery__current_timestamp", "macro_sql": "{% macro bigquery__current_timestamp() -%}\n current_timestamp()\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7262368, "supported_languages": null}, "macro.dbt_bigquery.bigquery__snapshot_string_as_time": {"name": "bigquery__snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/timestamps.sql", "original_file_path": "macros/utils/timestamps.sql", "unique_id": "macro.dbt_bigquery.bigquery__snapshot_string_as_time", "macro_sql": "{% macro bigquery__snapshot_string_as_time(timestamp) -%}\n {%- set result = 'TIMESTAMP(\"' ~ timestamp ~ '\")' -%}\n {{ return(result) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.726432, "supported_languages": null}, "macro.dbt_bigquery.bigquery__current_timestamp_backcompat": {"name": "bigquery__current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/timestamps.sql", "original_file_path": "macros/utils/timestamps.sql", "unique_id": "macro.dbt_bigquery.bigquery__current_timestamp_backcompat", "macro_sql": "{% macro bigquery__current_timestamp_backcompat() -%}\n current_timestamp\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.726515, "supported_languages": null}, "macro.dbt_bigquery.bigquery__intersect": {"name": "bigquery__intersect", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/intersect.sql", "original_file_path": "macros/utils/intersect.sql", "unique_id": "macro.dbt_bigquery.bigquery__intersect", "macro_sql": "{% macro bigquery__intersect() %}\n\n intersect distinct\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7266219, "supported_languages": null}, "macro.dbt_bigquery.bigquery__escape_single_quotes": {"name": "bigquery__escape_single_quotes", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/escape_single_quotes.sql", "original_file_path": "macros/utils/escape_single_quotes.sql", "unique_id": "macro.dbt_bigquery.bigquery__escape_single_quotes", "macro_sql": "{% macro bigquery__escape_single_quotes(expression) -%}\n{{ expression | replace(\"'\", \"\\\\'\") }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7268229, "supported_languages": null}, "macro.dbt_bigquery.bigquery__format_column": {"name": "bigquery__format_column", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/get_columns_spec_ddl.sql", "original_file_path": "macros/utils/get_columns_spec_ddl.sql", "unique_id": "macro.dbt_bigquery.bigquery__format_column", "macro_sql": "{% macro bigquery__format_column(column) -%}\n {% set data_type = column.data_type %}\n {% set formatted = column.column.lower() ~ \" \" ~ data_type %}\n {{ return({'name': column.name, 'data_type': data_type, 'formatted': formatted}) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.727794, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_empty_schema_sql": {"name": "bigquery__get_empty_schema_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/get_columns_spec_ddl.sql", "original_file_path": "macros/utils/get_columns_spec_ddl.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_empty_schema_sql", "macro_sql": "{% macro bigquery__get_empty_schema_sql(columns) %}\n {%- set col_err = [] -%}\n {% for col in columns.values() %}\n {%- if col['data_type'] is not defined -%}\n {{ col_err.append(col['name']) }}\n {%- endif -%}\n {%- endfor -%}\n {%- if (col_err | length) > 0 -%}\n {{ exceptions.column_type_missing(column_names=col_err) }}\n {%- endif -%}\n\n {%- set columns = adapter.nest_column_data_types(columns) -%}\n {{ return(dbt.default__get_empty_schema_sql(columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_empty_schema_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.728416, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_select_subquery": {"name": "bigquery__get_select_subquery", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/get_columns_spec_ddl.sql", "original_file_path": "macros/utils/get_columns_spec_ddl.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_select_subquery", "macro_sql": "{% macro bigquery__get_select_subquery(sql) %}\n select {{ adapter.dispatch('get_column_names')() }}\n from (\n {{ sql }}\n ) as model_subq\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_column_names"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7285938, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_column_names": {"name": "bigquery__get_column_names", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/get_columns_spec_ddl.sql", "original_file_path": "macros/utils/get_columns_spec_ddl.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_column_names", "macro_sql": "{% macro bigquery__get_column_names() %}\n {#- loop through nested user_provided_columns to get column names -#}\n {%- set user_provided_columns = adapter.nest_column_data_types(model['columns']) -%}\n {%- for i in user_provided_columns %}\n {%- set col = user_provided_columns[i] -%}\n {%- set col_name = adapter.quote(col['name']) if col.get('quote') else col['name'] -%}\n {{ col_name }}{{ \", \" if not loop.last }}\n {%- endfor -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.729106, "supported_languages": null}, "macro.dbt_bigquery.bigquery__right": {"name": "bigquery__right", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/right.sql", "original_file_path": "macros/utils/right.sql", "unique_id": "macro.dbt_bigquery.bigquery__right", "macro_sql": "{% macro bigquery__right(string_text, length_expression) %}\n\n case when {{ length_expression }} = 0\n then ''\n else\n substr(\n {{ string_text }},\n -1 * ({{ length_expression }})\n )\n end\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.729357, "supported_languages": null}, "macro.dbt_bigquery.bigquery__listagg": {"name": "bigquery__listagg", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt_bigquery.bigquery__listagg", "macro_sql": "{% macro bigquery__listagg(measure, delimiter_text, order_by_clause, limit_num) -%}\n\n string_agg(\n {{ measure }},\n {{ delimiter_text }}\n {% if order_by_clause -%}\n {{ order_by_clause }}\n {%- endif %}\n {% if limit_num -%}\n limit {{ limit_num }}\n {%- endif %}\n )\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.729773, "supported_languages": null}, "macro.dbt_bigquery.bigquery__datediff": {"name": "bigquery__datediff", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt_bigquery.bigquery__datediff", "macro_sql": "{% macro bigquery__datediff(first_date, second_date, datepart) -%}\n\n {% if dbt_version[0] == 1 and dbt_version[2] >= 2 %}\n {{ return(dbt.datediff(first_date, second_date, datepart)) }}\n {% else %}\n\n datetime_diff(\n cast({{second_date}} as datetime),\n cast({{first_date}} as datetime),\n {{datepart}}\n )\n\n {% endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.73029, "supported_languages": null}, "macro.dbt_bigquery.bigquery__safe_cast": {"name": "bigquery__safe_cast", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/safe_cast.sql", "original_file_path": "macros/utils/safe_cast.sql", "unique_id": "macro.dbt_bigquery.bigquery__safe_cast", "macro_sql": "{% macro bigquery__safe_cast(field, type) %}\n safe_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.730464, "supported_languages": null}, "macro.dbt_bigquery.bigquery__hash": {"name": "bigquery__hash", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/hash.sql", "original_file_path": "macros/utils/hash.sql", "unique_id": "macro.dbt_bigquery.bigquery__hash", "macro_sql": "{% macro bigquery__hash(field) -%}\n to_hex({{dbt.default__hash(field)}})\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__hash"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7306309, "supported_languages": null}, "macro.dbt_bigquery.bigquery__position": {"name": "bigquery__position", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/position.sql", "original_file_path": "macros/utils/position.sql", "unique_id": "macro.dbt_bigquery.bigquery__position", "macro_sql": "{% macro bigquery__position(substring_text, string_text) %}\n\n strpos(\n {{ string_text }},\n {{ substring_text }}\n\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7308218, "supported_languages": null}, "macro.dbt_bigquery.bigquery__array_concat": {"name": "bigquery__array_concat", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/array_concat.sql", "original_file_path": "macros/utils/array_concat.sql", "unique_id": "macro.dbt_bigquery.bigquery__array_concat", "macro_sql": "{% macro bigquery__array_concat(array_1, array_2) -%}\n array_concat({{ array_1 }}, {{ array_2 }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.730994, "supported_languages": null}, "macro.dbt_bigquery.bigquery__bool_or": {"name": "bigquery__bool_or", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/bool_or.sql", "original_file_path": "macros/utils/bool_or.sql", "unique_id": "macro.dbt_bigquery.bigquery__bool_or", "macro_sql": "{% macro bigquery__bool_or(expression) -%}\n\n logical_or({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7311308, "supported_languages": null}, "macro.dbt_bigquery.bigquery__split_part": {"name": "bigquery__split_part", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt_bigquery.bigquery__split_part", "macro_sql": "{% macro bigquery__split_part(string_text, delimiter_text, part_number) %}\n\n {% if part_number >= 0 %}\n split(\n {{ string_text }},\n {{ delimiter_text }}\n )[safe_offset({{ part_number - 1 }})]\n {% else %}\n split(\n {{ string_text }},\n {{ delimiter_text }}\n )[safe_offset(\n length({{ string_text }})\n - length(\n replace({{ string_text }}, {{ delimiter_text }}, '')\n ) + 1 + {{ part_number }}\n )]\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.731761, "supported_languages": null}, "macro.dbt_bigquery.bigquery__date_trunc": {"name": "bigquery__date_trunc", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/date_trunc.sql", "original_file_path": "macros/utils/date_trunc.sql", "unique_id": "macro.dbt_bigquery.bigquery__date_trunc", "macro_sql": "{% macro bigquery__date_trunc(datepart, date) -%}\n timestamp_trunc(\n cast({{date}} as timestamp),\n {{datepart}}\n )\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.731946, "supported_languages": null}, "macro.dbt_bigquery.bigquery__array_construct": {"name": "bigquery__array_construct", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/array_construct.sql", "original_file_path": "macros/utils/array_construct.sql", "unique_id": "macro.dbt_bigquery.bigquery__array_construct", "macro_sql": "{% macro bigquery__array_construct(inputs, data_type) -%}\n {% if inputs|length > 0 %}\n [ {{ inputs|join(' , ') }} ]\n {% else %}\n ARRAY<{{data_type}}>[]\n {% endif %}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7322612, "supported_languages": null}, "macro.dbt_bigquery.bigquery__array_append": {"name": "bigquery__array_append", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/utils/array_append.sql", "original_file_path": "macros/utils/array_append.sql", "unique_id": "macro.dbt_bigquery.bigquery__array_append", "macro_sql": "{% macro bigquery__array_append(array, new_element) -%}\n {{ array_concat(array, array_construct([new_element])) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.array_concat", "macro.dbt.array_construct"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.732477, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_show_grant_sql": {"name": "bigquery__get_show_grant_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_show_grant_sql", "macro_sql": "{% macro bigquery__get_show_grant_sql(relation) %}\n {% set location = adapter.get_dataset_location(relation) %}\n {% set relation = relation.incorporate(location=location) %}\n\n select privilege_type, grantee\n from {{ relation.information_schema(\"OBJECT_PRIVILEGES\") }}\n where object_schema = \"{{ relation.dataset }}\"\n and object_name = \"{{ relation.identifier }}\"\n -- filter out current user\n and split(grantee, ':')[offset(1)] != session_user()\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.733139, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_grant_sql": {"name": "bigquery__get_grant_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_grant_sql", "macro_sql": "\n\n\n{%- macro bigquery__get_grant_sql(relation, privilege, grantee) -%}\n grant `{{ privilege }}` on {{ relation.type }} {{ relation }} to {{ '\\\"' + grantee|join('\\\", \\\"') + '\\\"' }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.733394, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_revoke_sql": {"name": "bigquery__get_revoke_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_revoke_sql", "macro_sql": "{%- macro bigquery__get_revoke_sql(relation, privilege, grantee) -%}\n revoke `{{ privilege }}` on {{ relation.type }} {{ relation }} from {{ '\\\"' + grantee|join('\\\", \\\"') + '\\\"' }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.733643, "supported_languages": null}, "macro.dbt_bigquery.bigquery__get_empty_subquery_sql": {"name": "bigquery__get_empty_subquery_sql", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt_bigquery.bigquery__get_empty_subquery_sql", "macro_sql": "{% macro bigquery__get_empty_subquery_sql(select_sql, select_sql_header=none) %}\n {%- if select_sql_header is not none -%}\n {{ select_sql_header }}\n {%- endif -%}\n select * from (\n {{ select_sql }}\n ) as __dbt_sbq\n where false and current_timestamp() = current_timestamp()\n limit 0\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.733935, "supported_languages": null}, "macro.dbt_bigquery.bigquery__resolve_model_name": {"name": "bigquery__resolve_model_name", "resource_type": "macro", "package_name": "dbt_bigquery", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt_bigquery.bigquery__resolve_model_name", "macro_sql": "{% macro bigquery__resolve_model_name(input_model_name) -%}\n {{ input_model_name | string | replace('`', '') | replace('\"', '\\\"') }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7341938, "supported_languages": null}, "macro.dbt.run_hooks": {"name": "run_hooks", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.run_hooks", "macro_sql": "{% macro run_hooks(hooks, inside_transaction=True) %}\n {% for hook in hooks | selectattr('transaction', 'equalto', inside_transaction) %}\n {% if not inside_transaction and loop.first %}\n {% call statement(auto_begin=inside_transaction) %}\n commit;\n {% endcall %}\n {% endif %}\n {% set rendered = render(hook.get('sql')) | trim %}\n {% if (rendered | length) > 0 %}\n {% call statement(auto_begin=inside_transaction) %}\n {{ rendered }}\n {% endcall %}\n {% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.735397, "supported_languages": null}, "macro.dbt.make_hook_config": {"name": "make_hook_config", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.make_hook_config", "macro_sql": "{% macro make_hook_config(sql, inside_transaction) %}\n {{ tojson({\"sql\": sql, \"transaction\": inside_transaction}) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.735617, "supported_languages": null}, "macro.dbt.before_begin": {"name": "before_begin", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.before_begin", "macro_sql": "{% macro before_begin(sql) %}\n {{ make_hook_config(sql, inside_transaction=False) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.735776, "supported_languages": null}, "macro.dbt.in_transaction": {"name": "in_transaction", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.in_transaction", "macro_sql": "{% macro in_transaction(sql) %}\n {{ make_hook_config(sql, inside_transaction=True) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.735923, "supported_languages": null}, "macro.dbt.after_commit": {"name": "after_commit", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/hooks.sql", "original_file_path": "macros/materializations/hooks.sql", "unique_id": "macro.dbt.after_commit", "macro_sql": "{% macro after_commit(sql) %}\n {{ make_hook_config(sql, inside_transaction=False) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_hook_config"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7360709, "supported_languages": null}, "macro.dbt.set_sql_header": {"name": "set_sql_header", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.set_sql_header", "macro_sql": "{% macro set_sql_header(config) -%}\n {{ config.set('sql_header', caller()) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.736455, "supported_languages": null}, "macro.dbt.should_full_refresh": {"name": "should_full_refresh", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.should_full_refresh", "macro_sql": "{% macro should_full_refresh() %}\n {% set config_full_refresh = config.get('full_refresh') %}\n {% if config_full_refresh is none %}\n {% set config_full_refresh = flags.FULL_REFRESH %}\n {% endif %}\n {% do return(config_full_refresh) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.736772, "supported_languages": null}, "macro.dbt.should_store_failures": {"name": "should_store_failures", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/configs.sql", "original_file_path": "macros/materializations/configs.sql", "unique_id": "macro.dbt.should_store_failures", "macro_sql": "{% macro should_store_failures() %}\n {% set config_store_failures = config.get('store_failures') %}\n {% if config_store_failures is none %}\n {% set config_store_failures = flags.STORE_FAILURES %}\n {% endif %}\n {% do return(config_store_failures) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.737091, "supported_languages": null}, "macro.dbt.snapshot_merge_sql": {"name": "snapshot_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot_merge.sql", "original_file_path": "macros/materializations/snapshots/snapshot_merge.sql", "unique_id": "macro.dbt.snapshot_merge_sql", "macro_sql": "{% macro snapshot_merge_sql(target, source, insert_cols) -%}\n {{ adapter.dispatch('snapshot_merge_sql', 'dbt')(target, source, insert_cols) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__snapshot_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.737534, "supported_languages": null}, "macro.dbt.default__snapshot_merge_sql": {"name": "default__snapshot_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot_merge.sql", "original_file_path": "macros/materializations/snapshots/snapshot_merge.sql", "unique_id": "macro.dbt.default__snapshot_merge_sql", "macro_sql": "{% macro default__snapshot_merge_sql(target, source, insert_cols) -%}\n {%- set insert_cols_csv = insert_cols | join(', ') -%}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on DBT_INTERNAL_SOURCE.dbt_scd_id = DBT_INTERNAL_DEST.dbt_scd_id\n\n when matched\n and DBT_INTERNAL_DEST.dbt_valid_to is null\n and DBT_INTERNAL_SOURCE.dbt_change_type in ('update', 'delete')\n then update\n set dbt_valid_to = DBT_INTERNAL_SOURCE.dbt_valid_to\n\n when not matched\n and DBT_INTERNAL_SOURCE.dbt_change_type = 'insert'\n then insert ({{ insert_cols_csv }})\n values ({{ insert_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7378151, "supported_languages": null}, "macro.dbt.strategy_dispatch": {"name": "strategy_dispatch", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.strategy_dispatch", "macro_sql": "{% macro strategy_dispatch(name) -%}\n{% set original_name = name %}\n {% if '.' in name %}\n {% set package_name, name = name.split(\".\", 1) %}\n {% else %}\n {% set package_name = none %}\n {% endif %}\n\n {% if package_name is none %}\n {% set package_context = context %}\n {% elif package_name in context %}\n {% set package_context = context[package_name] %}\n {% else %}\n {% set error_msg %}\n Could not find package '{{package_name}}', called with '{{original_name}}'\n {% endset %}\n {{ exceptions.raise_compiler_error(error_msg | trim) }}\n {% endif %}\n\n {%- set search_name = 'snapshot_' ~ name ~ '_strategy' -%}\n\n {% if search_name not in package_context %}\n {% set error_msg %}\n The specified strategy macro '{{name}}' was not found in package '{{ package_name }}'\n {% endset %}\n {{ exceptions.raise_compiler_error(error_msg | trim) }}\n {% endif %}\n {{ return(package_context[search_name]) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.741451, "supported_languages": null}, "macro.dbt.snapshot_hash_arguments": {"name": "snapshot_hash_arguments", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_hash_arguments", "macro_sql": "{% macro snapshot_hash_arguments(args) -%}\n {{ adapter.dispatch('snapshot_hash_arguments', 'dbt')(args) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.741629, "supported_languages": null}, "macro.dbt.default__snapshot_hash_arguments": {"name": "default__snapshot_hash_arguments", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.default__snapshot_hash_arguments", "macro_sql": "{% macro default__snapshot_hash_arguments(args) -%}\n md5({%- for arg in args -%}\n coalesce(cast({{ arg }} as varchar ), '')\n {% if not loop.last %} || '|' || {% endif %}\n {%- endfor -%})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.741858, "supported_languages": null}, "macro.dbt.snapshot_timestamp_strategy": {"name": "snapshot_timestamp_strategy", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_timestamp_strategy", "macro_sql": "{% macro snapshot_timestamp_strategy(node, snapshotted_rel, current_rel, config, target_exists) %}\n {% set primary_key = config['unique_key'] %}\n {% set updated_at = config['updated_at'] %}\n {% set invalidate_hard_deletes = config.get('invalidate_hard_deletes', false) %}\n\n {#/*\n The snapshot relation might not have an {{ updated_at }} value if the\n snapshot strategy is changed from `check` to `timestamp`. We\n should use a dbt-created column for the comparison in the snapshot\n table instead of assuming that the user-supplied {{ updated_at }}\n will be present in the historical data.\n\n See https://github.com/dbt-labs/dbt-core/issues/2350\n */ #}\n {% set row_changed_expr -%}\n ({{ snapshotted_rel }}.dbt_valid_from < {{ current_rel }}.{{ updated_at }})\n {%- endset %}\n\n {% set scd_id_expr = snapshot_hash_arguments([primary_key, updated_at]) %}\n\n {% do return({\n \"unique_key\": primary_key,\n \"updated_at\": updated_at,\n \"row_changed\": row_changed_expr,\n \"scd_id\": scd_id_expr,\n \"invalidate_hard_deletes\": invalidate_hard_deletes\n }) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.74261, "supported_languages": null}, "macro.dbt.snapshot_string_as_time": {"name": "snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_string_as_time", "macro_sql": "{% macro snapshot_string_as_time(timestamp) -%}\n {{ adapter.dispatch('snapshot_string_as_time', 'dbt')(timestamp) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__snapshot_string_as_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7427819, "supported_languages": null}, "macro.dbt.default__snapshot_string_as_time": {"name": "default__snapshot_string_as_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.default__snapshot_string_as_time", "macro_sql": "{% macro default__snapshot_string_as_time(timestamp) %}\n {% do exceptions.raise_not_implemented(\n 'snapshot_string_as_time macro not implemented for adapter '+adapter.type()\n ) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.742962, "supported_languages": null}, "macro.dbt.snapshot_check_all_get_existing_columns": {"name": "snapshot_check_all_get_existing_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_check_all_get_existing_columns", "macro_sql": "{% macro snapshot_check_all_get_existing_columns(node, target_exists, check_cols_config) -%}\n {%- if not target_exists -%}\n {#-- no table yet -> return whatever the query does --#}\n {{ return((false, query_columns)) }}\n {%- endif -%}\n\n {#-- handle any schema changes --#}\n {%- set target_relation = adapter.get_relation(database=node.database, schema=node.schema, identifier=node.alias) -%}\n\n {% if check_cols_config == 'all' %}\n {%- set query_columns = get_columns_in_query(node['compiled_code']) -%}\n\n {% elif check_cols_config is iterable and (check_cols_config | length) > 0 %}\n {#-- query for proper casing/quoting, to support comparison below --#}\n {%- set select_check_cols_from_target -%}\n {#-- N.B. The whitespace below is necessary to avoid edge case issue with comments --#}\n {#-- See: https://github.com/dbt-labs/dbt-core/issues/6781 --#}\n select {{ check_cols_config | join(', ') }} from (\n {{ node['compiled_code'] }}\n ) subq\n {%- endset -%}\n {% set query_columns = get_columns_in_query(select_check_cols_from_target) %}\n\n {% else %}\n {% do exceptions.raise_compiler_error(\"Invalid value for 'check_cols': \" ~ check_cols_config) %}\n {% endif %}\n\n {%- set existing_cols = adapter.get_columns_in_relation(target_relation) | map(attribute = 'name') | list -%}\n {%- set ns = namespace() -%} {#-- handle for-loop scoping with a namespace --#}\n {%- set ns.column_added = false -%}\n\n {%- set intersection = [] -%}\n {%- for col in query_columns -%}\n {%- if col in existing_cols -%}\n {%- do intersection.append(adapter.quote(col)) -%}\n {%- else -%}\n {% set ns.column_added = true %}\n {%- endif -%}\n {%- endfor -%}\n {{ return((ns.column_added, intersection)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_columns_in_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.744496, "supported_languages": null}, "macro.dbt.snapshot_check_strategy": {"name": "snapshot_check_strategy", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/strategies.sql", "original_file_path": "macros/materializations/snapshots/strategies.sql", "unique_id": "macro.dbt.snapshot_check_strategy", "macro_sql": "{% macro snapshot_check_strategy(node, snapshotted_rel, current_rel, config, target_exists) %}\n {% set check_cols_config = config['check_cols'] %}\n {% set primary_key = config['unique_key'] %}\n {% set invalidate_hard_deletes = config.get('invalidate_hard_deletes', false) %}\n {% set updated_at = config.get('updated_at', snapshot_get_time()) %}\n\n {% set column_added = false %}\n\n {% set column_added, check_cols = snapshot_check_all_get_existing_columns(node, target_exists, check_cols_config) %}\n\n {%- set row_changed_expr -%}\n (\n {%- if column_added -%}\n {{ get_true_sql() }}\n {%- else -%}\n {%- for col in check_cols -%}\n {{ snapshotted_rel }}.{{ col }} != {{ current_rel }}.{{ col }}\n or\n (\n (({{ snapshotted_rel }}.{{ col }} is null) and not ({{ current_rel }}.{{ col }} is null))\n or\n ((not {{ snapshotted_rel }}.{{ col }} is null) and ({{ current_rel }}.{{ col }} is null))\n )\n {%- if not loop.last %} or {% endif -%}\n {%- endfor -%}\n {%- endif -%}\n )\n {%- endset %}\n\n {% set scd_id_expr = snapshot_hash_arguments([primary_key, updated_at]) %}\n\n {% do return({\n \"unique_key\": primary_key,\n \"updated_at\": updated_at,\n \"row_changed\": row_changed_expr,\n \"scd_id\": scd_id_expr,\n \"invalidate_hard_deletes\": invalidate_hard_deletes\n }) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_get_time", "macro.dbt.snapshot_check_all_get_existing_columns", "macro.dbt.get_true_sql", "macro.dbt.snapshot_hash_arguments"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7458591, "supported_languages": null}, "macro.dbt.create_columns": {"name": "create_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.create_columns", "macro_sql": "{% macro create_columns(relation, columns) %}\n {{ adapter.dispatch('create_columns', 'dbt')(relation, columns) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.75011, "supported_languages": null}, "macro.dbt.default__create_columns": {"name": "default__create_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__create_columns", "macro_sql": "{% macro default__create_columns(relation, columns) %}\n {% for column in columns %}\n {% call statement() %}\n alter table {{ relation }} add column \"{{ column.name }}\" {{ column.data_type }};\n {% endcall %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7504041, "supported_languages": null}, "macro.dbt.post_snapshot": {"name": "post_snapshot", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.post_snapshot", "macro_sql": "{% macro post_snapshot(staging_relation) %}\n {{ adapter.dispatch('post_snapshot', 'dbt')(staging_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__post_snapshot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.75058, "supported_languages": null}, "macro.dbt.default__post_snapshot": {"name": "default__post_snapshot", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__post_snapshot", "macro_sql": "{% macro default__post_snapshot(staging_relation) %}\n {# no-op #}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7506728, "supported_languages": null}, "macro.dbt.get_true_sql": {"name": "get_true_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.get_true_sql", "macro_sql": "{% macro get_true_sql() %}\n {{ adapter.dispatch('get_true_sql', 'dbt')() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_true_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.750829, "supported_languages": null}, "macro.dbt.default__get_true_sql": {"name": "default__get_true_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__get_true_sql", "macro_sql": "{% macro default__get_true_sql() %}\n {{ return('TRUE') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.750957, "supported_languages": null}, "macro.dbt.snapshot_staging_table": {"name": "snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.snapshot_staging_table", "macro_sql": "{% macro snapshot_staging_table(strategy, source_sql, target_relation) -%}\n {{ adapter.dispatch('snapshot_staging_table', 'dbt')(strategy, source_sql, target_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__snapshot_staging_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.751177, "supported_languages": null}, "macro.dbt.default__snapshot_staging_table": {"name": "default__snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__snapshot_staging_table", "macro_sql": "{% macro default__snapshot_staging_table(strategy, source_sql, target_relation) -%}\n\n with snapshot_query as (\n\n {{ source_sql }}\n\n ),\n\n snapshotted_data as (\n\n select *,\n {{ strategy.unique_key }} as dbt_unique_key\n\n from {{ target_relation }}\n where dbt_valid_to is null\n\n ),\n\n insertions_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n nullif({{ strategy.updated_at }}, {{ strategy.updated_at }}) as dbt_valid_to,\n {{ strategy.scd_id }} as dbt_scd_id\n\n from snapshot_query\n ),\n\n updates_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n {{ strategy.updated_at }} as dbt_valid_to\n\n from snapshot_query\n ),\n\n {%- if strategy.invalidate_hard_deletes %}\n\n deletes_source_data as (\n\n select\n *,\n {{ strategy.unique_key }} as dbt_unique_key\n from snapshot_query\n ),\n {% endif %}\n\n insertions as (\n\n select\n 'insert' as dbt_change_type,\n source_data.*\n\n from insertions_source_data as source_data\n left outer join snapshotted_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where snapshotted_data.dbt_unique_key is null\n or (\n snapshotted_data.dbt_unique_key is not null\n and (\n {{ strategy.row_changed }}\n )\n )\n\n ),\n\n updates as (\n\n select\n 'update' as dbt_change_type,\n source_data.*,\n snapshotted_data.dbt_scd_id\n\n from updates_source_data as source_data\n join snapshotted_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where (\n {{ strategy.row_changed }}\n )\n )\n\n {%- if strategy.invalidate_hard_deletes -%}\n ,\n\n deletes as (\n\n select\n 'delete' as dbt_change_type,\n source_data.*,\n {{ snapshot_get_time() }} as dbt_valid_from,\n {{ snapshot_get_time() }} as dbt_updated_at,\n {{ snapshot_get_time() }} as dbt_valid_to,\n snapshotted_data.dbt_scd_id\n\n from snapshotted_data\n left join deletes_source_data as source_data on snapshotted_data.dbt_unique_key = source_data.dbt_unique_key\n where source_data.dbt_unique_key is null\n )\n {%- endif %}\n\n select * from insertions\n union all\n select * from updates\n {%- if strategy.invalidate_hard_deletes %}\n union all\n select * from deletes\n {%- endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.snapshot_get_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7521012, "supported_languages": null}, "macro.dbt.build_snapshot_table": {"name": "build_snapshot_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.build_snapshot_table", "macro_sql": "{% macro build_snapshot_table(strategy, sql) -%}\n {{ adapter.dispatch('build_snapshot_table', 'dbt')(strategy, sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__build_snapshot_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7522979, "supported_languages": null}, "macro.dbt.default__build_snapshot_table": {"name": "default__build_snapshot_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.default__build_snapshot_table", "macro_sql": "{% macro default__build_snapshot_table(strategy, sql) %}\n\n select *,\n {{ strategy.scd_id }} as dbt_scd_id,\n {{ strategy.updated_at }} as dbt_updated_at,\n {{ strategy.updated_at }} as dbt_valid_from,\n nullif({{ strategy.updated_at }}, {{ strategy.updated_at }}) as dbt_valid_to\n from (\n {{ sql }}\n ) sbq\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7525609, "supported_languages": null}, "macro.dbt.build_snapshot_staging_table": {"name": "build_snapshot_staging_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/helpers.sql", "original_file_path": "macros/materializations/snapshots/helpers.sql", "unique_id": "macro.dbt.build_snapshot_staging_table", "macro_sql": "{% macro build_snapshot_staging_table(strategy, sql, target_relation) %}\n {% set temp_relation = make_temp_relation(target_relation) %}\n\n {% set select = snapshot_staging_table(strategy, sql, target_relation) %}\n\n {% call statement('build_snapshot_staging_relation') %}\n {{ create_table_as(True, temp_relation, select) }}\n {% endcall %}\n\n {% do return(temp_relation) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.make_temp_relation", "macro.dbt.snapshot_staging_table", "macro.dbt.statement", "macro.dbt.create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.753012, "supported_languages": null}, "macro.dbt.materialization_snapshot_default": {"name": "materialization_snapshot_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/snapshots/snapshot.sql", "original_file_path": "macros/materializations/snapshots/snapshot.sql", "unique_id": "macro.dbt.materialization_snapshot_default", "macro_sql": "{% materialization snapshot, default %}\n {%- set config = model['config'] -%}\n\n {%- set target_table = model.get('alias', model.get('name')) -%}\n\n {%- set strategy_name = config.get('strategy') -%}\n {%- set unique_key = config.get('unique_key') %}\n -- grab current tables grants config for comparision later on\n {%- set grant_config = config.get('grants') -%}\n\n {% set target_relation_exists, target_relation = get_or_create_relation(\n database=model.database,\n schema=model.schema,\n identifier=target_table,\n type='table') -%}\n\n {%- if not target_relation.is_table -%}\n {% do exceptions.relation_wrong_type(target_relation, 'table') %}\n {%- endif -%}\n\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n {% set strategy_macro = strategy_dispatch(strategy_name) %}\n {% set strategy = strategy_macro(model, \"snapshotted_data\", \"source_data\", config, target_relation_exists) %}\n\n {% if not target_relation_exists %}\n\n {% set build_sql = build_snapshot_table(strategy, model['compiled_code']) %}\n {% set final_sql = create_table_as(False, target_relation, build_sql) %}\n\n {% else %}\n\n {{ adapter.valid_snapshot_target(target_relation) }}\n\n {% set staging_table = build_snapshot_staging_table(strategy, sql, target_relation) %}\n\n -- this may no-op if the database does not require column expansion\n {% do adapter.expand_target_column_types(from_relation=staging_table,\n to_relation=target_relation) %}\n\n {% set missing_columns = adapter.get_missing_columns(staging_table, target_relation)\n | rejectattr('name', 'equalto', 'dbt_change_type')\n | rejectattr('name', 'equalto', 'DBT_CHANGE_TYPE')\n | rejectattr('name', 'equalto', 'dbt_unique_key')\n | rejectattr('name', 'equalto', 'DBT_UNIQUE_KEY')\n | list %}\n\n {% do create_columns(target_relation, missing_columns) %}\n\n {% set source_columns = adapter.get_columns_in_relation(staging_table)\n | rejectattr('name', 'equalto', 'dbt_change_type')\n | rejectattr('name', 'equalto', 'DBT_CHANGE_TYPE')\n | rejectattr('name', 'equalto', 'dbt_unique_key')\n | rejectattr('name', 'equalto', 'DBT_UNIQUE_KEY')\n | list %}\n\n {% set quoted_source_columns = [] %}\n {% for column in source_columns %}\n {% do quoted_source_columns.append(adapter.quote(column.name)) %}\n {% endfor %}\n\n {% set final_sql = snapshot_merge_sql(\n target = target_relation,\n source = staging_table,\n insert_cols = quoted_source_columns\n )\n %}\n\n {% endif %}\n\n {% call statement('main') %}\n {{ final_sql }}\n {% endcall %}\n\n {% set should_revoke = should_revoke(target_relation_exists, full_refresh_mode=False) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if not target_relation_exists %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {{ adapter.commit() }}\n\n {% if staging_table is defined %}\n {% do post_snapshot(staging_table) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.get_or_create_relation", "macro.dbt.run_hooks", "macro.dbt.strategy_dispatch", "macro.dbt.build_snapshot_table", "macro.dbt.create_table_as", "macro.dbt.build_snapshot_staging_table", "macro.dbt.create_columns", "macro.dbt.snapshot_merge_sql", "macro.dbt.statement", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes", "macro.dbt.post_snapshot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.759604, "supported_languages": ["sql"]}, "macro.dbt.materialization_test_default": {"name": "materialization_test_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/test.sql", "original_file_path": "macros/materializations/tests/test.sql", "unique_id": "macro.dbt.materialization_test_default", "macro_sql": "{%- materialization test, default -%}\n\n {% set relations = [] %}\n\n {% if should_store_failures() %}\n\n {% set identifier = model['alias'] %}\n {% set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) %}\n\n {% set store_failures_as = config.get('store_failures_as') %}\n -- if `--store-failures` is invoked via command line and `store_failures_as` is not set,\n -- config.get('store_failures_as', 'table') returns None, not 'table'\n {% if store_failures_as == none %}{% set store_failures_as = 'table' %}{% endif %}\n {% if store_failures_as not in ['table', 'view'] %}\n {{ exceptions.raise_compiler_error(\n \"'\" ~ store_failures_as ~ \"' is not a valid value for `store_failures_as`. \"\n \"Accepted values are: ['ephemeral', 'table', 'view']\"\n ) }}\n {% endif %}\n\n {% set target_relation = api.Relation.create(\n identifier=identifier, schema=schema, database=database, type=store_failures_as) -%} %}\n\n {% if old_relation %}\n {% do adapter.drop_relation(old_relation) %}\n {% endif %}\n\n {% call statement(auto_begin=True) %}\n {{ get_create_sql(target_relation, sql) }}\n {% endcall %}\n\n {% do relations.append(target_relation) %}\n\n {% set main_sql %}\n select *\n from {{ target_relation }}\n {% endset %}\n\n {{ adapter.commit() }}\n\n {% else %}\n\n {% set main_sql = sql %}\n\n {% endif %}\n\n {% set limit = config.get('limit') %}\n {% set fail_calc = config.get('fail_calc') %}\n {% set warn_if = config.get('warn_if') %}\n {% set error_if = config.get('error_if') %}\n\n {% call statement('main', fetch_result=True) -%}\n\n {{ get_test_sql(main_sql, fail_calc, warn_if, error_if, limit)}}\n\n {%- endcall %}\n\n {{ return({'relations': relations}) }}\n\n{%- endmaterialization -%}", "depends_on": {"macros": ["macro.dbt.should_store_failures", "macro.dbt.statement", "macro.dbt.get_create_sql", "macro.dbt.get_test_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.762452, "supported_languages": ["sql"]}, "macro.dbt.get_test_sql": {"name": "get_test_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/helpers.sql", "original_file_path": "macros/materializations/tests/helpers.sql", "unique_id": "macro.dbt.get_test_sql", "macro_sql": "{% macro get_test_sql(main_sql, fail_calc, warn_if, error_if, limit) -%}\n {{ adapter.dispatch('get_test_sql', 'dbt')(main_sql, fail_calc, warn_if, error_if, limit) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_test_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.762922, "supported_languages": null}, "macro.dbt.default__get_test_sql": {"name": "default__get_test_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/helpers.sql", "original_file_path": "macros/materializations/tests/helpers.sql", "unique_id": "macro.dbt.default__get_test_sql", "macro_sql": "{% macro default__get_test_sql(main_sql, fail_calc, warn_if, error_if, limit) -%}\n select\n {{ fail_calc }} as failures,\n {{ fail_calc }} {{ warn_if }} as should_warn,\n {{ fail_calc }} {{ error_if }} as should_error\n from (\n {{ main_sql }}\n {{ \"limit \" ~ limit if limit != none }}\n ) dbt_internal_test\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.763244, "supported_languages": null}, "macro.dbt.get_where_subquery": {"name": "get_where_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/where_subquery.sql", "original_file_path": "macros/materializations/tests/where_subquery.sql", "unique_id": "macro.dbt.get_where_subquery", "macro_sql": "{% macro get_where_subquery(relation) -%}\n {% do return(adapter.dispatch('get_where_subquery', 'dbt')(relation)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_where_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.763632, "supported_languages": null}, "macro.dbt.default__get_where_subquery": {"name": "default__get_where_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/tests/where_subquery.sql", "original_file_path": "macros/materializations/tests/where_subquery.sql", "unique_id": "macro.dbt.default__get_where_subquery", "macro_sql": "{% macro default__get_where_subquery(relation) -%}\n {% set where = config.get('where', '') %}\n {% if where %}\n {%- set filtered -%}\n (select * from {{ relation }} where {{ where }}) dbt_subquery\n {%- endset -%}\n {% do return(filtered) %}\n {%- else -%}\n {% do return(relation) %}\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.764025, "supported_languages": null}, "macro.dbt.materialization_materialized_view_default": {"name": "materialization_materialized_view_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialization_materialized_view_default", "macro_sql": "{% materialization materialized_view, default %}\n {% set existing_relation = load_cached_relation(this) %}\n {% set target_relation = this.incorporate(type=this.MaterializedView) %}\n {% set intermediate_relation = make_intermediate_relation(target_relation) %}\n {% set backup_relation_type = target_relation.MaterializedView if existing_relation is none else existing_relation.type %}\n {% set backup_relation = make_backup_relation(target_relation, backup_relation_type) %}\n\n {{ materialized_view_setup(backup_relation, intermediate_relation, pre_hooks) }}\n\n {% set build_sql = materialized_view_get_build_sql(existing_relation, target_relation, backup_relation, intermediate_relation) %}\n\n {% if build_sql == '' %}\n {{ materialized_view_execute_no_op(target_relation) }}\n {% else %}\n {{ materialized_view_execute_build_sql(build_sql, existing_relation, target_relation, post_hooks) }}\n {% endif %}\n\n {{ materialized_view_teardown(backup_relation, intermediate_relation, post_hooks) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.materialized_view_setup", "macro.dbt.materialized_view_get_build_sql", "macro.dbt.materialized_view_execute_no_op", "macro.dbt.materialized_view_execute_build_sql", "macro.dbt.materialized_view_teardown"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.769093, "supported_languages": ["sql"]}, "macro.dbt.materialized_view_setup": {"name": "materialized_view_setup", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialized_view_setup", "macro_sql": "{% macro materialized_view_setup(backup_relation, intermediate_relation, pre_hooks) %}\n\n -- backup_relation and intermediate_relation should not already exist in the database\n -- it's possible these exist because of a previous run that exited unexpectedly\n {% set preexisting_backup_relation = load_cached_relation(backup_relation) %}\n {% set preexisting_intermediate_relation = load_cached_relation(intermediate_relation) %}\n\n -- drop the temp relations if they exist already in the database\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.769495, "supported_languages": null}, "macro.dbt.materialized_view_teardown": {"name": "materialized_view_teardown", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialized_view_teardown", "macro_sql": "{% macro materialized_view_teardown(backup_relation, intermediate_relation, post_hooks) %}\n\n -- drop the temp relations if they exist to leave the database clean for the next run\n {{ drop_relation_if_exists(backup_relation) }}\n {{ drop_relation_if_exists(intermediate_relation) }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.769753, "supported_languages": null}, "macro.dbt.materialized_view_get_build_sql": {"name": "materialized_view_get_build_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialized_view_get_build_sql", "macro_sql": "{% macro materialized_view_get_build_sql(existing_relation, target_relation, backup_relation, intermediate_relation) %}\n\n {% set full_refresh_mode = should_full_refresh() %}\n\n -- determine the scenario we're in: create, full_refresh, alter, refresh data\n {% if existing_relation is none %}\n {% set build_sql = get_create_materialized_view_as_sql(target_relation, sql) %}\n {% elif full_refresh_mode or not existing_relation.is_materialized_view %}\n {% set build_sql = get_replace_sql(existing_relation, target_relation, sql) %}\n {% else %}\n\n -- get config options\n {% set on_configuration_change = config.get('on_configuration_change') %}\n {% set configuration_changes = get_materialized_view_configuration_changes(existing_relation, config) %}\n\n {% if configuration_changes is none %}\n {% set build_sql = refresh_materialized_view(target_relation) %}\n\n {% elif on_configuration_change == 'apply' %}\n {% set build_sql = get_alter_materialized_view_as_sql(target_relation, configuration_changes, sql, existing_relation, backup_relation, intermediate_relation) %}\n {% elif on_configuration_change == 'continue' %}\n {% set build_sql = '' %}\n {{ exceptions.warn(\"Configuration changes were identified and `on_configuration_change` was set to `continue` for `\" ~ target_relation ~ \"`\") }}\n {% elif on_configuration_change == 'fail' %}\n {{ exceptions.raise_fail_fast_error(\"Configuration changes were identified and `on_configuration_change` was set to `fail` for `\" ~ target_relation ~ \"`\") }}\n\n {% else %}\n -- this only happens if the user provides a value other than `apply`, 'skip', 'fail'\n {{ exceptions.raise_compiler_error(\"Unexpected configuration scenario\") }}\n\n {% endif %}\n\n {% endif %}\n\n {% do return(build_sql) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh", "macro.dbt.get_create_materialized_view_as_sql", "macro.dbt.get_replace_sql", "macro.dbt.get_materialized_view_configuration_changes", "macro.dbt.refresh_materialized_view", "macro.dbt.get_alter_materialized_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.771105, "supported_languages": null}, "macro.dbt.materialized_view_execute_no_op": {"name": "materialized_view_execute_no_op", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialized_view_execute_no_op", "macro_sql": "{% macro materialized_view_execute_no_op(target_relation) %}\n {% do store_raw_result(\n name=\"main\",\n message=\"skip \" ~ target_relation,\n code=\"skip\",\n rows_affected=\"-1\"\n ) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.771345, "supported_languages": null}, "macro.dbt.materialized_view_execute_build_sql": {"name": "materialized_view_execute_build_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/materialized_view.sql", "original_file_path": "macros/materializations/models/materialized_view.sql", "unique_id": "macro.dbt.materialized_view_execute_build_sql", "macro_sql": "{% macro materialized_view_execute_build_sql(build_sql, existing_relation, target_relation, post_hooks) %}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n {% set grant_config = config.get('grants') %}\n\n {% call statement(name=\"main\") %}\n {{ build_sql }}\n {% endcall %}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {{ adapter.commit() }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt.statement", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7720242, "supported_languages": null}, "macro.dbt.materialization_view_default": {"name": "materialization_view_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/view.sql", "original_file_path": "macros/materializations/models/view.sql", "unique_id": "macro.dbt.materialization_view_default", "macro_sql": "{%- materialization view, default -%}\n\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='view') -%}\n {%- set intermediate_relation = make_intermediate_relation(target_relation) -%}\n\n -- the intermediate_relation should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation) -%}\n /*\n This relation (probably) doesn't exist yet. If it does exist, it's a leftover from\n a previous run, and we're going to try to drop it immediately. At the end of this\n materialization, we're going to rename the \"existing_relation\" to this identifier,\n and then we're going to drop it. In order to make sure we run the correct one of:\n - drop view ...\n - drop table ...\n\n We need to set the type of this relation to be the type of the existing_relation, if it exists,\n or else \"view\" as a sane default if it does not. Note that if the existing_relation does not\n exist, then there is nothing to move out of the way and subsequentally drop. In that case,\n this relation will be effectively unused.\n */\n {%- set backup_relation_type = 'view' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n -- as above, the backup_relation should not already exist\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- drop the temp relations if they exist already in the database\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_view_as_sql(intermediate_relation, sql) }}\n {%- endcall %}\n\n -- cleanup\n -- move the existing view out of the way\n {% if existing_relation is not none %}\n /* Do the equivalent of rename_if_exists. 'existing_relation' could have been dropped\n since the variable was first set. */\n {% set existing_relation = load_cached_relation(existing_relation) %}\n {% if existing_relation is not none %}\n {{ adapter.rename_relation(existing_relation, backup_relation) }}\n {% endif %}\n {% endif %}\n {{ adapter.rename_relation(intermediate_relation, target_relation) }}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {{ adapter.commit() }}\n\n {{ drop_relation_if_exists(backup_relation) }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{%- endmaterialization -%}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.run_hooks", "macro.dbt.drop_relation_if_exists", "macro.dbt.statement", "macro.dbt.get_create_view_as_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7750242, "supported_languages": ["sql"]}, "macro.dbt.materialization_table_default": {"name": "materialization_table_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/table.sql", "original_file_path": "macros/materializations/models/table.sql", "unique_id": "macro.dbt.materialization_table_default", "macro_sql": "{% materialization table, default %}\n\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='table') %}\n {%- set intermediate_relation = make_intermediate_relation(target_relation) -%}\n -- the intermediate_relation should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation) -%}\n /*\n See ../view/view.sql for more information about this relation.\n */\n {%- set backup_relation_type = 'table' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n -- as above, the backup_relation should not already exist\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n\n -- drop the temp relations if they exist already in the database\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_table_as_sql(False, intermediate_relation, sql) }}\n {%- endcall %}\n\n -- cleanup\n {% if existing_relation is not none %}\n /* Do the equivalent of rename_if_exists. 'existing_relation' could have been dropped\n since the variable was first set. */\n {% set existing_relation = load_cached_relation(existing_relation) %}\n {% if existing_relation is not none %}\n {{ adapter.rename_relation(existing_relation, backup_relation) }}\n {% endif %}\n {% endif %}\n\n {{ adapter.rename_relation(intermediate_relation, target_relation) }}\n\n {% do create_indexes(target_relation) %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n -- `COMMIT` happens here\n {{ adapter.commit() }}\n\n -- finally, drop the existing/backup relation after the commit\n {{ drop_relation_if_exists(backup_relation) }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks", "macro.dbt.statement", "macro.dbt.get_create_table_as_sql", "macro.dbt.create_indexes", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.777998, "supported_languages": ["sql"]}, "macro.dbt.get_quoted_csv": {"name": "get_quoted_csv", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.get_quoted_csv", "macro_sql": "{% macro get_quoted_csv(column_names) %}\n\n {% set quoted = [] %}\n {% for col in column_names -%}\n {%- do quoted.append(adapter.quote(col)) -%}\n {%- endfor %}\n\n {%- set dest_cols_csv = quoted | join(', ') -%}\n {{ return(dest_cols_csv) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.779649, "supported_languages": null}, "macro.dbt.diff_columns": {"name": "diff_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.diff_columns", "macro_sql": "{% macro diff_columns(source_columns, target_columns) %}\n\n {% set result = [] %}\n {% set source_names = source_columns | map(attribute = 'column') | list %}\n {% set target_names = target_columns | map(attribute = 'column') | list %}\n\n {# --check whether the name attribute exists in the target - this does not perform a data type check #}\n {% for sc in source_columns %}\n {% if sc.name not in target_names %}\n {{ result.append(sc) }}\n {% endif %}\n {% endfor %}\n\n {{ return(result) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7802198, "supported_languages": null}, "macro.dbt.diff_column_data_types": {"name": "diff_column_data_types", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.diff_column_data_types", "macro_sql": "{% macro diff_column_data_types(source_columns, target_columns) %}\n\n {% set result = [] %}\n {% for sc in source_columns %}\n {% set tc = target_columns | selectattr(\"name\", \"equalto\", sc.name) | list | first %}\n {% if tc %}\n {% if sc.data_type != tc.data_type and not sc.can_expand_to(other_column=tc) %}\n {{ result.append( { 'column_name': tc.name, 'new_type': sc.data_type } ) }}\n {% endif %}\n {% endif %}\n {% endfor %}\n\n {{ return(result) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.780923, "supported_languages": null}, "macro.dbt.get_merge_update_columns": {"name": "get_merge_update_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.get_merge_update_columns", "macro_sql": "{% macro get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) %}\n {{ return(adapter.dispatch('get_merge_update_columns', 'dbt')(merge_update_columns, merge_exclude_columns, dest_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_merge_update_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.781173, "supported_languages": null}, "macro.dbt.default__get_merge_update_columns": {"name": "default__get_merge_update_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/column_helpers.sql", "original_file_path": "macros/materializations/models/incremental/column_helpers.sql", "unique_id": "macro.dbt.default__get_merge_update_columns", "macro_sql": "{% macro default__get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) %}\n {%- set default_cols = dest_columns | map(attribute=\"quoted\") | list -%}\n\n {%- if merge_update_columns and merge_exclude_columns -%}\n {{ exceptions.raise_compiler_error(\n 'Model cannot specify merge_update_columns and merge_exclude_columns. Please update model to use only one config'\n )}}\n {%- elif merge_update_columns -%}\n {%- set update_columns = merge_update_columns -%}\n {%- elif merge_exclude_columns -%}\n {%- set update_columns = [] -%}\n {%- for column in dest_columns -%}\n {% if column.column | lower not in merge_exclude_columns | map(\"lower\") | list %}\n {%- do update_columns.append(column.quoted) -%}\n {% endif %}\n {%- endfor -%}\n {%- else -%}\n {%- set update_columns = default_cols -%}\n {%- endif -%}\n\n {{ return(update_columns) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7819269, "supported_languages": null}, "macro.dbt.get_merge_sql": {"name": "get_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_merge_sql", "macro_sql": "{% macro get_merge_sql(target, source, unique_key, dest_columns, incremental_predicates=none) -%}\n -- back compat for old kwarg name\n {% set incremental_predicates = kwargs.get('predicates', incremental_predicates) %}\n {{ adapter.dispatch('get_merge_sql', 'dbt')(target, source, unique_key, dest_columns, incremental_predicates) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.788788, "supported_languages": null}, "macro.dbt.default__get_merge_sql": {"name": "default__get_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_merge_sql", "macro_sql": "{% macro default__get_merge_sql(target, source, unique_key, dest_columns, incremental_predicates=none) -%}\n {%- set predicates = [] if incremental_predicates is none else [] + incremental_predicates -%}\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n {%- set merge_update_columns = config.get('merge_update_columns') -%}\n {%- set merge_exclude_columns = config.get('merge_exclude_columns') -%}\n {%- set update_columns = get_merge_update_columns(merge_update_columns, merge_exclude_columns, dest_columns) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {% if unique_key %}\n {% if unique_key is sequence and unique_key is not mapping and unique_key is not string %}\n {% for key in unique_key %}\n {% set this_key_match %}\n DBT_INTERNAL_SOURCE.{{ key }} = DBT_INTERNAL_DEST.{{ key }}\n {% endset %}\n {% do predicates.append(this_key_match) %}\n {% endfor %}\n {% else %}\n {% set unique_key_match %}\n DBT_INTERNAL_SOURCE.{{ unique_key }} = DBT_INTERNAL_DEST.{{ unique_key }}\n {% endset %}\n {% do predicates.append(unique_key_match) %}\n {% endif %}\n {% else %}\n {% do predicates.append('FALSE') %}\n {% endif %}\n\n {{ sql_header if sql_header is not none }}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on {{\"(\" ~ predicates | join(\") and (\") ~ \")\"}}\n\n {% if unique_key %}\n when matched then update set\n {% for column_name in update_columns -%}\n {{ column_name }} = DBT_INTERNAL_SOURCE.{{ column_name }}\n {%- if not loop.last %}, {%- endif %}\n {%- endfor %}\n {% endif %}\n\n when not matched then insert\n ({{ dest_cols_csv }})\n values\n ({{ dest_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv", "macro.dbt.get_merge_update_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.790453, "supported_languages": null}, "macro.dbt.get_delete_insert_merge_sql": {"name": "get_delete_insert_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_delete_insert_merge_sql", "macro_sql": "{% macro get_delete_insert_merge_sql(target, source, unique_key, dest_columns, incremental_predicates) -%}\n {{ adapter.dispatch('get_delete_insert_merge_sql', 'dbt')(target, source, unique_key, dest_columns, incremental_predicates) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_delete_insert_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.790727, "supported_languages": null}, "macro.dbt.default__get_delete_insert_merge_sql": {"name": "default__get_delete_insert_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_delete_insert_merge_sql", "macro_sql": "{% macro default__get_delete_insert_merge_sql(target, source, unique_key, dest_columns, incremental_predicates) -%}\n\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n\n {% if unique_key %}\n {% if unique_key is sequence and unique_key is not string %}\n delete from {{target }}\n using {{ source }}\n where (\n {% for key in unique_key %}\n {{ source }}.{{ key }} = {{ target }}.{{ key }}\n {{ \"and \" if not loop.last}}\n {% endfor %}\n {% if incremental_predicates %}\n {% for predicate in incremental_predicates %}\n and {{ predicate }}\n {% endfor %}\n {% endif %}\n );\n {% else %}\n delete from {{ target }}\n where (\n {{ unique_key }}) in (\n select ({{ unique_key }})\n from {{ source }}\n )\n {%- if incremental_predicates %}\n {% for predicate in incremental_predicates %}\n and {{ predicate }}\n {% endfor %}\n {%- endif -%};\n\n {% endif %}\n {% endif %}\n\n insert into {{ target }} ({{ dest_cols_csv }})\n (\n select {{ dest_cols_csv }}\n from {{ source }}\n )\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.791806, "supported_languages": null}, "macro.dbt.get_insert_overwrite_merge_sql": {"name": "get_insert_overwrite_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.get_insert_overwrite_merge_sql", "macro_sql": "{% macro get_insert_overwrite_merge_sql(target, source, dest_columns, predicates, include_sql_header=false) -%}\n {{ adapter.dispatch('get_insert_overwrite_merge_sql', 'dbt')(target, source, dest_columns, predicates, include_sql_header) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.792087, "supported_languages": null}, "macro.dbt.default__get_insert_overwrite_merge_sql": {"name": "default__get_insert_overwrite_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/merge.sql", "original_file_path": "macros/materializations/models/incremental/merge.sql", "unique_id": "macro.dbt.default__get_insert_overwrite_merge_sql", "macro_sql": "{% macro default__get_insert_overwrite_merge_sql(target, source, dest_columns, predicates, include_sql_header) -%}\n {#-- The only time include_sql_header is True: --#}\n {#-- BigQuery + insert_overwrite strategy + \"static\" partitions config --#}\n {#-- We should consider including the sql header at the materialization level instead --#}\n\n {%- set predicates = [] if predicates is none else [] + predicates -%}\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none and include_sql_header }}\n\n merge into {{ target }} as DBT_INTERNAL_DEST\n using {{ source }} as DBT_INTERNAL_SOURCE\n on FALSE\n\n when not matched by source\n {% if predicates %} and {{ predicates | join(' and ') }} {% endif %}\n then delete\n\n when not matched then insert\n ({{ dest_cols_csv }})\n values\n ({{ dest_cols_csv }})\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.792774, "supported_languages": null}, "macro.dbt.is_incremental": {"name": "is_incremental", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/is_incremental.sql", "original_file_path": "macros/materializations/models/incremental/is_incremental.sql", "unique_id": "macro.dbt.is_incremental", "macro_sql": "{% macro is_incremental() %}\n {#-- do not run introspective queries in parsing #}\n {% if not execute %}\n {{ return(False) }}\n {% else %}\n {% set relation = adapter.get_relation(this.database, this.schema, this.table) %}\n {{ return(relation is not none\n and relation.type == 'table'\n and model.config.materialized == 'incremental'\n and not should_full_refresh()) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7934341, "supported_languages": null}, "macro.dbt.get_incremental_append_sql": {"name": "get_incremental_append_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_append_sql", "macro_sql": "{% macro get_incremental_append_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_append_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_append_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.794334, "supported_languages": null}, "macro.dbt.default__get_incremental_append_sql": {"name": "default__get_incremental_append_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_append_sql", "macro_sql": "{% macro default__get_incremental_append_sql(arg_dict) %}\n\n {% do return(get_insert_into_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"dest_columns\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_insert_into_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.79458, "supported_languages": null}, "macro.dbt.get_incremental_delete_insert_sql": {"name": "get_incremental_delete_insert_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_delete_insert_sql", "macro_sql": "{% macro get_incremental_delete_insert_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_delete_insert_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_delete_insert_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.794773, "supported_languages": null}, "macro.dbt.default__get_incremental_delete_insert_sql": {"name": "default__get_incremental_delete_insert_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_delete_insert_sql", "macro_sql": "{% macro default__get_incremental_delete_insert_sql(arg_dict) %}\n\n {% do return(get_delete_insert_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"unique_key\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_delete_insert_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.795087, "supported_languages": null}, "macro.dbt.get_incremental_merge_sql": {"name": "get_incremental_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_merge_sql", "macro_sql": "{% macro get_incremental_merge_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_merge_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.795347, "supported_languages": null}, "macro.dbt.default__get_incremental_merge_sql": {"name": "default__get_incremental_merge_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_merge_sql", "macro_sql": "{% macro default__get_incremental_merge_sql(arg_dict) %}\n\n {% do return(get_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"unique_key\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.795659, "supported_languages": null}, "macro.dbt.get_incremental_insert_overwrite_sql": {"name": "get_incremental_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_insert_overwrite_sql", "macro_sql": "{% macro get_incremental_insert_overwrite_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_insert_overwrite_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_insert_overwrite_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.795852, "supported_languages": null}, "macro.dbt.default__get_incremental_insert_overwrite_sql": {"name": "default__get_incremental_insert_overwrite_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_insert_overwrite_sql", "macro_sql": "{% macro default__get_incremental_insert_overwrite_sql(arg_dict) %}\n\n {% do return(get_insert_overwrite_merge_sql(arg_dict[\"target_relation\"], arg_dict[\"temp_relation\"], arg_dict[\"dest_columns\"], arg_dict[\"incremental_predicates\"])) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_insert_overwrite_merge_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.796133, "supported_languages": null}, "macro.dbt.get_incremental_default_sql": {"name": "get_incremental_default_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_incremental_default_sql", "macro_sql": "{% macro get_incremental_default_sql(arg_dict) %}\n\n {{ return(adapter.dispatch('get_incremental_default_sql', 'dbt')(arg_dict)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_incremental_default_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.7963269, "supported_languages": null}, "macro.dbt.default__get_incremental_default_sql": {"name": "default__get_incremental_default_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.default__get_incremental_default_sql", "macro_sql": "{% macro default__get_incremental_default_sql(arg_dict) %}\n\n {% do return(get_incremental_append_sql(arg_dict)) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_incremental_append_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.796482, "supported_languages": null}, "macro.dbt.get_insert_into_sql": {"name": "get_insert_into_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/strategies.sql", "original_file_path": "macros/materializations/models/incremental/strategies.sql", "unique_id": "macro.dbt.get_insert_into_sql", "macro_sql": "{% macro get_insert_into_sql(target_relation, temp_relation, dest_columns) %}\n\n {%- set dest_cols_csv = get_quoted_csv(dest_columns | map(attribute=\"name\")) -%}\n\n insert into {{ target_relation }} ({{ dest_cols_csv }})\n (\n select {{ dest_cols_csv }}\n from {{ temp_relation }}\n )\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_quoted_csv"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.79677, "supported_languages": null}, "macro.dbt.materialization_incremental_default": {"name": "materialization_incremental_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/incremental.sql", "original_file_path": "macros/materializations/models/incremental/incremental.sql", "unique_id": "macro.dbt.materialization_incremental_default", "macro_sql": "{% materialization incremental, default -%}\n\n -- relations\n {%- set existing_relation = load_cached_relation(this) -%}\n {%- set target_relation = this.incorporate(type='table') -%}\n {%- set temp_relation = make_temp_relation(target_relation)-%}\n {%- set intermediate_relation = make_intermediate_relation(target_relation)-%}\n {%- set backup_relation_type = 'table' if existing_relation is none else existing_relation.type -%}\n {%- set backup_relation = make_backup_relation(target_relation, backup_relation_type) -%}\n\n -- configs\n {%- set unique_key = config.get('unique_key') -%}\n {%- set full_refresh_mode = (should_full_refresh() or existing_relation.is_view) -%}\n {%- set on_schema_change = incremental_validate_on_schema_change(config.get('on_schema_change'), default='ignore') -%}\n\n -- the temp_ and backup_ relations should not already exist in the database; get_relation\n -- will return None in that case. Otherwise, we get a relation that we can drop\n -- later, before we try to use this name for the current operation. This has to happen before\n -- BEGIN, in a separate transaction\n {%- set preexisting_intermediate_relation = load_cached_relation(intermediate_relation)-%}\n {%- set preexisting_backup_relation = load_cached_relation(backup_relation) -%}\n -- grab current tables grants config for comparision later on\n {% set grant_config = config.get('grants') %}\n {{ drop_relation_if_exists(preexisting_intermediate_relation) }}\n {{ drop_relation_if_exists(preexisting_backup_relation) }}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n {% set to_drop = [] %}\n\n {% if existing_relation is none %}\n {% set build_sql = get_create_table_as_sql(False, target_relation, sql) %}\n {% elif full_refresh_mode %}\n {% set build_sql = get_create_table_as_sql(False, intermediate_relation, sql) %}\n {% set need_swap = true %}\n {% else %}\n {% do run_query(get_create_table_as_sql(True, temp_relation, sql)) %}\n {% do adapter.expand_target_column_types(\n from_relation=temp_relation,\n to_relation=target_relation) %}\n {#-- Process schema changes. Returns dict of changes if successful. Use source columns for upserting/merging --#}\n {% set dest_columns = process_schema_changes(on_schema_change, temp_relation, existing_relation) %}\n {% if not dest_columns %}\n {% set dest_columns = adapter.get_columns_in_relation(existing_relation) %}\n {% endif %}\n\n {#-- Get the incremental_strategy, the macro to use for the strategy, and build the sql --#}\n {% set incremental_strategy = config.get('incremental_strategy') or 'default' %}\n {% set incremental_predicates = config.get('predicates', none) or config.get('incremental_predicates', none) %}\n {% set strategy_sql_macro_func = adapter.get_incremental_strategy_macro(context, incremental_strategy) %}\n {% set strategy_arg_dict = ({'target_relation': target_relation, 'temp_relation': temp_relation, 'unique_key': unique_key, 'dest_columns': dest_columns, 'incremental_predicates': incremental_predicates }) %}\n {% set build_sql = strategy_sql_macro_func(strategy_arg_dict) %}\n\n {% endif %}\n\n {% call statement(\"main\") %}\n {{ build_sql }}\n {% endcall %}\n\n {% if need_swap %}\n {% do adapter.rename_relation(target_relation, backup_relation) %}\n {% do adapter.rename_relation(intermediate_relation, target_relation) %}\n {% do to_drop.append(backup_relation) %}\n {% endif %}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if existing_relation is none or existing_relation.is_view or should_full_refresh() %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n -- `COMMIT` happens here\n {% do adapter.commit() %}\n\n {% for rel in to_drop %}\n {% do adapter.drop_relation(rel) %}\n {% endfor %}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{%- endmaterialization %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.make_temp_relation", "macro.dbt.make_intermediate_relation", "macro.dbt.make_backup_relation", "macro.dbt.should_full_refresh", "macro.dbt.incremental_validate_on_schema_change", "macro.dbt.drop_relation_if_exists", "macro.dbt.run_hooks", "macro.dbt.get_create_table_as_sql", "macro.dbt.run_query", "macro.dbt.process_schema_changes", "macro.dbt.statement", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.801945, "supported_languages": ["sql"]}, "macro.dbt.incremental_validate_on_schema_change": {"name": "incremental_validate_on_schema_change", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.incremental_validate_on_schema_change", "macro_sql": "{% macro incremental_validate_on_schema_change(on_schema_change, default='ignore') %}\n\n {% if on_schema_change not in ['sync_all_columns', 'append_new_columns', 'fail', 'ignore'] %}\n\n {% set log_message = 'Invalid value for on_schema_change (%s) specified. Setting default value of %s.' % (on_schema_change, default) %}\n {% do log(log_message) %}\n\n {{ return(default) }}\n\n {% else %}\n\n {{ return(on_schema_change) }}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.807791, "supported_languages": null}, "macro.dbt.check_for_schema_changes": {"name": "check_for_schema_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.check_for_schema_changes", "macro_sql": "{% macro check_for_schema_changes(source_relation, target_relation) %}\n\n {% set schema_changed = False %}\n\n {%- set source_columns = adapter.get_columns_in_relation(source_relation) -%}\n {%- set target_columns = adapter.get_columns_in_relation(target_relation) -%}\n {%- set source_not_in_target = diff_columns(source_columns, target_columns) -%}\n {%- set target_not_in_source = diff_columns(target_columns, source_columns) -%}\n\n {% set new_target_types = diff_column_data_types(source_columns, target_columns) %}\n\n {% if source_not_in_target != [] %}\n {% set schema_changed = True %}\n {% elif target_not_in_source != [] or new_target_types != [] %}\n {% set schema_changed = True %}\n {% elif new_target_types != [] %}\n {% set schema_changed = True %}\n {% endif %}\n\n {% set changes_dict = {\n 'schema_changed': schema_changed,\n 'source_not_in_target': source_not_in_target,\n 'target_not_in_source': target_not_in_source,\n 'source_columns': source_columns,\n 'target_columns': target_columns,\n 'new_target_types': new_target_types\n } %}\n\n {% set msg %}\n In {{ target_relation }}:\n Schema changed: {{ schema_changed }}\n Source columns not in target: {{ source_not_in_target }}\n Target columns not in source: {{ target_not_in_source }}\n New column types: {{ new_target_types }}\n {% endset %}\n\n {% do log(msg) %}\n\n {{ return(changes_dict) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.diff_columns", "macro.dbt.diff_column_data_types"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.809071, "supported_languages": null}, "macro.dbt.sync_column_schemas": {"name": "sync_column_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.sync_column_schemas", "macro_sql": "{% macro sync_column_schemas(on_schema_change, target_relation, schema_changes_dict) %}\n\n {%- set add_to_target_arr = schema_changes_dict['source_not_in_target'] -%}\n\n {%- if on_schema_change == 'append_new_columns'-%}\n {%- if add_to_target_arr | length > 0 -%}\n {%- do alter_relation_add_remove_columns(target_relation, add_to_target_arr, none) -%}\n {%- endif -%}\n\n {% elif on_schema_change == 'sync_all_columns' %}\n {%- set remove_from_target_arr = schema_changes_dict['target_not_in_source'] -%}\n {%- set new_target_types = schema_changes_dict['new_target_types'] -%}\n\n {% if add_to_target_arr | length > 0 or remove_from_target_arr | length > 0 %}\n {%- do alter_relation_add_remove_columns(target_relation, add_to_target_arr, remove_from_target_arr) -%}\n {% endif %}\n\n {% if new_target_types != [] %}\n {% for ntt in new_target_types %}\n {% set column_name = ntt['column_name'] %}\n {% set new_type = ntt['new_type'] %}\n {% do alter_column_type(target_relation, column_name, new_type) %}\n {% endfor %}\n {% endif %}\n\n {% endif %}\n\n {% set schema_change_message %}\n In {{ target_relation }}:\n Schema change approach: {{ on_schema_change }}\n Columns added: {{ add_to_target_arr }}\n Columns removed: {{ remove_from_target_arr }}\n Data types changed: {{ new_target_types }}\n {% endset %}\n\n {% do log(schema_change_message) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.alter_relation_add_remove_columns", "macro.dbt.alter_column_type"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8103218, "supported_languages": null}, "macro.dbt.process_schema_changes": {"name": "process_schema_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/incremental/on_schema_change.sql", "original_file_path": "macros/materializations/models/incremental/on_schema_change.sql", "unique_id": "macro.dbt.process_schema_changes", "macro_sql": "{% macro process_schema_changes(on_schema_change, source_relation, target_relation) %}\n\n {% if on_schema_change == 'ignore' %}\n\n {{ return({}) }}\n\n {% else %}\n\n {% set schema_changes_dict = check_for_schema_changes(source_relation, target_relation) %}\n\n {% if schema_changes_dict['schema_changed'] %}\n\n {% if on_schema_change == 'fail' %}\n\n {% set fail_msg %}\n The source and target schemas on this incremental model are out of sync!\n They can be reconciled in several ways:\n - set the `on_schema_change` config to either append_new_columns or sync_all_columns, depending on your situation.\n - Re-run the incremental model with `full_refresh: True` to update the target schema.\n - update the schema manually and re-run the process.\n\n Additional troubleshooting context:\n Source columns not in target: {{ schema_changes_dict['source_not_in_target'] }}\n Target columns not in source: {{ schema_changes_dict['target_not_in_source'] }}\n New column types: {{ schema_changes_dict['new_target_types'] }}\n {% endset %}\n\n {% do exceptions.raise_compiler_error(fail_msg) %}\n\n {# -- unless we ignore, run the sync operation per the config #}\n {% else %}\n\n {% do sync_column_schemas(on_schema_change, target_relation, schema_changes_dict) %}\n\n {% endif %}\n\n {% endif %}\n\n {{ return(schema_changes_dict['source_columns']) }}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.check_for_schema_changes", "macro.dbt.sync_column_schemas"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8112051, "supported_languages": null}, "macro.dbt.can_clone_table": {"name": "can_clone_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/clone/can_clone_table.sql", "original_file_path": "macros/materializations/models/clone/can_clone_table.sql", "unique_id": "macro.dbt.can_clone_table", "macro_sql": "{% macro can_clone_table() %}\n {{ return(adapter.dispatch('can_clone_table', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__can_clone_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.811454, "supported_languages": null}, "macro.dbt.default__can_clone_table": {"name": "default__can_clone_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/clone/can_clone_table.sql", "original_file_path": "macros/materializations/models/clone/can_clone_table.sql", "unique_id": "macro.dbt.default__can_clone_table", "macro_sql": "{% macro default__can_clone_table() %}\n {{ return(False) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.811574, "supported_languages": null}, "macro.dbt.create_or_replace_clone": {"name": "create_or_replace_clone", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/clone/create_or_replace_clone.sql", "original_file_path": "macros/materializations/models/clone/create_or_replace_clone.sql", "unique_id": "macro.dbt.create_or_replace_clone", "macro_sql": "{% macro create_or_replace_clone(this_relation, defer_relation) %}\n {{ return(adapter.dispatch('create_or_replace_clone', 'dbt')(this_relation, defer_relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_or_replace_clone"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.811873, "supported_languages": null}, "macro.dbt.default__create_or_replace_clone": {"name": "default__create_or_replace_clone", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/clone/create_or_replace_clone.sql", "original_file_path": "macros/materializations/models/clone/create_or_replace_clone.sql", "unique_id": "macro.dbt.default__create_or_replace_clone", "macro_sql": "{% macro default__create_or_replace_clone(this_relation, defer_relation) %}\n create or replace table {{ this_relation }} clone {{ defer_relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.81201, "supported_languages": null}, "macro.dbt.materialization_clone_default": {"name": "materialization_clone_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/models/clone/clone.sql", "original_file_path": "macros/materializations/models/clone/clone.sql", "unique_id": "macro.dbt.materialization_clone_default", "macro_sql": "{%- materialization clone, default -%}\n\n {%- set relations = {'relations': []} -%}\n\n {%- if not defer_relation -%}\n -- nothing to do\n {{ log(\"No relation found in state manifest for \" ~ model.unique_id, info=True) }}\n {{ return(relations) }}\n {%- endif -%}\n\n {%- set existing_relation = load_cached_relation(this) -%}\n\n {%- if existing_relation and not flags.FULL_REFRESH -%}\n -- noop!\n {{ log(\"Relation \" ~ existing_relation ~ \" already exists\", info=True) }}\n {{ return(relations) }}\n {%- endif -%}\n\n {%- set other_existing_relation = load_cached_relation(defer_relation) -%}\n\n -- If this is a database that can do zero-copy cloning of tables, and the other relation is a table, then this will be a table\n -- Otherwise, this will be a view\n\n {% set can_clone_table = can_clone_table() %}\n\n {%- if other_existing_relation and other_existing_relation.type == 'table' and can_clone_table -%}\n\n {%- set target_relation = this.incorporate(type='table') -%}\n {% if existing_relation is not none and not existing_relation.is_table %}\n {{ log(\"Dropping relation \" ~ existing_relation ~ \" because it is of type \" ~ existing_relation.type) }}\n {{ drop_relation_if_exists(existing_relation) }}\n {% endif %}\n\n -- as a general rule, data platforms that can clone tables can also do atomic 'create or replace'\n {% call statement('main') %}\n {% if target_relation and defer_relation and target_relation == defer_relation %}\n {{ log(\"Target relation and defer relation are the same, skipping clone for relation: \" ~ target_relation) }}\n {% else %}\n {{ create_or_replace_clone(target_relation, defer_relation) }}\n {% endif %}\n\n {% endcall %}\n\n {% set should_revoke = should_revoke(existing_relation, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n {% do persist_docs(target_relation, model) %}\n\n {{ return({'relations': [target_relation]}) }}\n\n {%- else -%}\n\n {%- set target_relation = this.incorporate(type='view') -%}\n\n -- reuse the view materialization\n -- TODO: support actual dispatch for materialization macros\n -- Tracking ticket: https://github.com/dbt-labs/dbt-core/issues/7799\n {% set search_name = \"materialization_view_\" ~ adapter.type() %}\n {% if not search_name in context %}\n {% set search_name = \"materialization_view_default\" %}\n {% endif %}\n {% set materialization_macro = context[search_name] %}\n {% set relations = materialization_macro() %}\n {{ return(relations) }}\n\n {%- endif -%}\n\n{%- endmaterialization -%}", "depends_on": {"macros": ["macro.dbt.load_cached_relation", "macro.dbt.can_clone_table", "macro.dbt.drop_relation_if_exists", "macro.dbt.statement", "macro.dbt.create_or_replace_clone", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.815788, "supported_languages": ["sql"]}, "macro.dbt.materialization_seed_default": {"name": "materialization_seed_default", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/seed.sql", "original_file_path": "macros/materializations/seeds/seed.sql", "unique_id": "macro.dbt.materialization_seed_default", "macro_sql": "{% materialization seed, default %}\n\n {%- set identifier = model['alias'] -%}\n {%- set full_refresh_mode = (should_full_refresh()) -%}\n\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n\n {%- set exists_as_table = (old_relation is not none and old_relation.is_table) -%}\n {%- set exists_as_view = (old_relation is not none and old_relation.is_view) -%}\n\n {%- set grant_config = config.get('grants') -%}\n {%- set agate_table = load_agate_table() -%}\n -- grab current tables grants config for comparison later on\n\n {%- do store_result('agate_table', response='OK', agate_table=agate_table) -%}\n\n {{ run_hooks(pre_hooks, inside_transaction=False) }}\n\n -- `BEGIN` happens here:\n {{ run_hooks(pre_hooks, inside_transaction=True) }}\n\n -- build model\n {% set create_table_sql = \"\" %}\n {% if exists_as_view %}\n {{ exceptions.raise_compiler_error(\"Cannot seed to '{}', it is a view\".format(old_relation)) }}\n {% elif exists_as_table %}\n {% set create_table_sql = reset_csv_table(model, full_refresh_mode, old_relation, agate_table) %}\n {% else %}\n {% set create_table_sql = create_csv_table(model, agate_table) %}\n {% endif %}\n\n {% set code = 'CREATE' if full_refresh_mode else 'INSERT' %}\n {% set rows_affected = (agate_table.rows | length) %}\n {% set sql = load_csv_rows(model, agate_table) %}\n\n {% call noop_statement('main', code ~ ' ' ~ rows_affected, code, rows_affected) %}\n {{ get_csv_sql(create_table_sql, sql) }};\n {% endcall %}\n\n {% set target_relation = this.incorporate(type='table') %}\n\n {% set should_revoke = should_revoke(old_relation, full_refresh_mode) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {% do persist_docs(target_relation, model) %}\n\n {% if full_refresh_mode or not exists_as_table %}\n {% do create_indexes(target_relation) %}\n {% endif %}\n\n {{ run_hooks(post_hooks, inside_transaction=True) }}\n\n -- `COMMIT` happens here\n {{ adapter.commit() }}\n\n {{ run_hooks(post_hooks, inside_transaction=False) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmaterialization %}", "depends_on": {"macros": ["macro.dbt.should_full_refresh", "macro.dbt.run_hooks", "macro.dbt.reset_csv_table", "macro.dbt.create_csv_table", "macro.dbt.load_csv_rows", "macro.dbt.noop_statement", "macro.dbt.get_csv_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants", "macro.dbt.persist_docs", "macro.dbt.create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.819123, "supported_languages": ["sql"]}, "macro.dbt.create_csv_table": {"name": "create_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.create_csv_table", "macro_sql": "{% macro create_csv_table(model, agate_table) -%}\n {{ adapter.dispatch('create_csv_table', 'dbt')(model, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8244748, "supported_languages": null}, "macro.dbt.default__create_csv_table": {"name": "default__create_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__create_csv_table", "macro_sql": "{% macro default__create_csv_table(model, agate_table) %}\n {%- set column_override = model['config'].get('column_types', {}) -%}\n {%- set quote_seed_column = model['config'].get('quote_columns', None) -%}\n\n {% set sql %}\n create table {{ this.render() }} (\n {%- for col_name in agate_table.column_names -%}\n {%- set inferred_type = adapter.convert_type(agate_table, loop.index0) -%}\n {%- set type = column_override.get(col_name, inferred_type) -%}\n {%- set column_name = (col_name | string) -%}\n {{ adapter.quote_seed_column(column_name, quote_seed_column) }} {{ type }} {%- if not loop.last -%}, {%- endif -%}\n {%- endfor -%}\n )\n {% endset %}\n\n {% call statement('_') -%}\n {{ sql }}\n {%- endcall %}\n\n {{ return(sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.825414, "supported_languages": null}, "macro.dbt.reset_csv_table": {"name": "reset_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.reset_csv_table", "macro_sql": "{% macro reset_csv_table(model, full_refresh, old_relation, agate_table) -%}\n {{ adapter.dispatch('reset_csv_table', 'dbt')(model, full_refresh, old_relation, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__reset_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.825661, "supported_languages": null}, "macro.dbt.default__reset_csv_table": {"name": "default__reset_csv_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__reset_csv_table", "macro_sql": "{% macro default__reset_csv_table(model, full_refresh, old_relation, agate_table) %}\n {% set sql = \"\" %}\n {% if full_refresh %}\n {{ adapter.drop_relation(old_relation) }}\n {% set sql = create_csv_table(model, agate_table) %}\n {% else %}\n {{ adapter.truncate_relation(old_relation) }}\n {% set sql = \"truncate table \" ~ old_relation %}\n {% endif %}\n\n {{ return(sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_csv_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.826164, "supported_languages": null}, "macro.dbt.get_csv_sql": {"name": "get_csv_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_csv_sql", "macro_sql": "{% macro get_csv_sql(create_or_truncate_sql, insert_sql) %}\n {{ adapter.dispatch('get_csv_sql', 'dbt')(create_or_truncate_sql, insert_sql) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_csv_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8263628, "supported_languages": null}, "macro.dbt.default__get_csv_sql": {"name": "default__get_csv_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_csv_sql", "macro_sql": "{% macro default__get_csv_sql(create_or_truncate_sql, insert_sql) %}\n {{ create_or_truncate_sql }};\n -- dbt seed --\n {{ insert_sql }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8265018, "supported_languages": null}, "macro.dbt.get_binding_char": {"name": "get_binding_char", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_binding_char", "macro_sql": "{% macro get_binding_char() -%}\n {{ adapter.dispatch('get_binding_char', 'dbt')() }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_binding_char"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.826646, "supported_languages": null}, "macro.dbt.default__get_binding_char": {"name": "default__get_binding_char", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_binding_char", "macro_sql": "{% macro default__get_binding_char() %}\n {{ return('%s') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.826764, "supported_languages": null}, "macro.dbt.get_batch_size": {"name": "get_batch_size", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_batch_size", "macro_sql": "{% macro get_batch_size() -%}\n {{ return(adapter.dispatch('get_batch_size', 'dbt')()) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_batch_size"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8269289, "supported_languages": null}, "macro.dbt.default__get_batch_size": {"name": "default__get_batch_size", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__get_batch_size", "macro_sql": "{% macro default__get_batch_size() %}\n {{ return(10000) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.827049, "supported_languages": null}, "macro.dbt.get_seed_column_quoted_csv": {"name": "get_seed_column_quoted_csv", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.get_seed_column_quoted_csv", "macro_sql": "{% macro get_seed_column_quoted_csv(model, column_names) %}\n {%- set quote_seed_column = model['config'].get('quote_columns', None) -%}\n {% set quoted = [] %}\n {% for col in column_names -%}\n {%- do quoted.append(adapter.quote_seed_column(col, quote_seed_column)) -%}\n {%- endfor %}\n\n {%- set dest_cols_csv = quoted | join(', ') -%}\n {{ return(dest_cols_csv) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8275461, "supported_languages": null}, "macro.dbt.load_csv_rows": {"name": "load_csv_rows", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.load_csv_rows", "macro_sql": "{% macro load_csv_rows(model, agate_table) -%}\n {{ adapter.dispatch('load_csv_rows', 'dbt')(model, agate_table) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__load_csv_rows"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.827748, "supported_languages": null}, "macro.dbt.default__load_csv_rows": {"name": "default__load_csv_rows", "resource_type": "macro", "package_name": "dbt", "path": "macros/materializations/seeds/helpers.sql", "original_file_path": "macros/materializations/seeds/helpers.sql", "unique_id": "macro.dbt.default__load_csv_rows", "macro_sql": "{% macro default__load_csv_rows(model, agate_table) %}\n\n {% set batch_size = get_batch_size() %}\n\n {% set cols_sql = get_seed_column_quoted_csv(model, agate_table.column_names) %}\n {% set bindings = [] %}\n\n {% set statements = [] %}\n\n {% for chunk in agate_table.rows | batch(batch_size) %}\n {% set bindings = [] %}\n\n {% for row in chunk %}\n {% do bindings.extend(row) %}\n {% endfor %}\n\n {% set sql %}\n insert into {{ this.render() }} ({{ cols_sql }}) values\n {% for row in chunk -%}\n ({%- for column in agate_table.column_names -%}\n {{ get_binding_char() }}\n {%- if not loop.last%},{%- endif %}\n {%- endfor -%})\n {%- if not loop.last%},{%- endif %}\n {%- endfor %}\n {% endset %}\n\n {% do adapter.add_query(sql, bindings=bindings, abridge_sql_log=True) %}\n\n {% if loop.index0 == 0 %}\n {% do statements.append(sql) %}\n {% endif %}\n {% endfor %}\n\n {# Return SQL so we can render it out into the compiled files #}\n {{ return(statements[0]) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_batch_size", "macro.dbt.get_seed_column_quoted_csv", "macro.dbt.get_binding_char"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.829176, "supported_languages": null}, "macro.dbt.generate_alias_name": {"name": "generate_alias_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_alias.sql", "original_file_path": "macros/get_custom_name/get_custom_alias.sql", "unique_id": "macro.dbt.generate_alias_name", "macro_sql": "{% macro generate_alias_name(custom_alias_name=none, node=none) -%}\n {% do return(adapter.dispatch('generate_alias_name', 'dbt')(custom_alias_name, node)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_alias_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.829616, "supported_languages": null}, "macro.dbt.default__generate_alias_name": {"name": "default__generate_alias_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_alias.sql", "original_file_path": "macros/get_custom_name/get_custom_alias.sql", "unique_id": "macro.dbt.default__generate_alias_name", "macro_sql": "{% macro default__generate_alias_name(custom_alias_name=none, node=none) -%}\n\n {%- if custom_alias_name -%}\n\n {{ custom_alias_name | trim }}\n\n {%- elif node.version -%}\n\n {{ return(node.name ~ \"_v\" ~ (node.version | replace(\".\", \"_\"))) }}\n\n {%- else -%}\n\n {{ node.name }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.830008, "supported_languages": null}, "macro.dbt.generate_schema_name": {"name": "generate_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.generate_schema_name", "macro_sql": "{% macro generate_schema_name(custom_schema_name=none, node=none) -%}\n {{ return(adapter.dispatch('generate_schema_name', 'dbt')(custom_schema_name, node)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_schema_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.830538, "supported_languages": null}, "macro.dbt.default__generate_schema_name": {"name": "default__generate_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.default__generate_schema_name", "macro_sql": "{% macro default__generate_schema_name(custom_schema_name, node) -%}\n\n {%- set default_schema = target.schema -%}\n {%- if custom_schema_name is none -%}\n\n {{ default_schema }}\n\n {%- else -%}\n\n {{ default_schema }}_{{ custom_schema_name | trim }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.830805, "supported_languages": null}, "macro.dbt.generate_schema_name_for_env": {"name": "generate_schema_name_for_env", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_schema.sql", "original_file_path": "macros/get_custom_name/get_custom_schema.sql", "unique_id": "macro.dbt.generate_schema_name_for_env", "macro_sql": "{% macro generate_schema_name_for_env(custom_schema_name, node) -%}\n\n {%- set default_schema = target.schema -%}\n {%- if target.name == 'prod' and custom_schema_name is not none -%}\n\n {{ custom_schema_name | trim }}\n\n {%- else -%}\n\n {{ default_schema }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8311, "supported_languages": null}, "macro.dbt.generate_database_name": {"name": "generate_database_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_database.sql", "original_file_path": "macros/get_custom_name/get_custom_database.sql", "unique_id": "macro.dbt.generate_database_name", "macro_sql": "{% macro generate_database_name(custom_database_name=none, node=none) -%}\n {% do return(adapter.dispatch('generate_database_name', 'dbt')(custom_database_name, node)) %}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_database_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.831501, "supported_languages": null}, "macro.dbt.default__generate_database_name": {"name": "default__generate_database_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/get_custom_name/get_custom_database.sql", "original_file_path": "macros/get_custom_name/get_custom_database.sql", "unique_id": "macro.dbt.default__generate_database_name", "macro_sql": "{% macro default__generate_database_name(custom_database_name=none, node=none) -%}\n {%- set default_database = target.database -%}\n {%- if custom_database_name is none -%}\n\n {{ default_database }}\n\n {%- else -%}\n\n {{ custom_database_name }}\n\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.831761, "supported_languages": null}, "macro.dbt.get_drop_sql": {"name": "get_drop_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt.get_drop_sql", "macro_sql": "{%- macro get_drop_sql(relation) -%}\n {{- log('Applying DROP to: ' ~ relation) -}}\n {{- adapter.dispatch('get_drop_sql', 'dbt')(relation) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_drop_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.832494, "supported_languages": null}, "macro.dbt.default__get_drop_sql": {"name": "default__get_drop_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt.default__get_drop_sql", "macro_sql": "{%- macro default__get_drop_sql(relation) -%}\n\n {%- if relation.is_view -%}\n {{ drop_view(relation) }}\n\n {%- elif relation.is_table -%}\n {{ drop_table(relation) }}\n\n {%- elif relation.is_materialized_view -%}\n {{ drop_materialized_view(relation) }}\n\n {%- else -%}\n drop {{ relation.type }} if exists {{ relation }} cascade\n\n {%- endif -%}\n\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.drop_view", "macro.dbt.drop_table", "macro.dbt.drop_materialized_view"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.832879, "supported_languages": null}, "macro.dbt.drop_relation": {"name": "drop_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt.drop_relation", "macro_sql": "{% macro drop_relation(relation) -%}\n {{ return(adapter.dispatch('drop_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__drop_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8330722, "supported_languages": null}, "macro.dbt.default__drop_relation": {"name": "default__drop_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt.default__drop_relation", "macro_sql": "{% macro default__drop_relation(relation) -%}\n {% call statement('drop_relation', auto_begin=False) -%}\n {{ get_drop_sql(relation) }}\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.get_drop_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.833279, "supported_languages": null}, "macro.dbt.drop_relation_if_exists": {"name": "drop_relation_if_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop.sql", "original_file_path": "macros/relations/drop.sql", "unique_id": "macro.dbt.drop_relation_if_exists", "macro_sql": "{% macro drop_relation_if_exists(relation) %}\n {% if relation is not none %}\n {{ adapter.drop_relation(relation) }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.833481, "supported_languages": null}, "macro.dbt.get_replace_sql": {"name": "get_replace_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/replace.sql", "original_file_path": "macros/relations/replace.sql", "unique_id": "macro.dbt.get_replace_sql", "macro_sql": "{% macro get_replace_sql(existing_relation, target_relation, sql) %}\n {{- log('Applying REPLACE to: ' ~ existing_relation) -}}\n {{- adapter.dispatch('get_replace_sql', 'dbt')(existing_relation, target_relation, sql) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_replace_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.834264, "supported_languages": null}, "macro.dbt.default__get_replace_sql": {"name": "default__get_replace_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/replace.sql", "original_file_path": "macros/relations/replace.sql", "unique_id": "macro.dbt.default__get_replace_sql", "macro_sql": "{% macro default__get_replace_sql(existing_relation, target_relation, sql) %}\n\n {# /* use a create or replace statement if possible */ #}\n\n {% set is_replaceable = existing_relation.type == target_relation_type and existing_relation.can_be_replaced %}\n\n {% if is_replaceable and existing_relation.is_view %}\n {{ get_replace_view_sql(target_relation, sql) }}\n\n {% elif is_replaceable and existing_relation.is_table %}\n {{ get_replace_table_sql(target_relation, sql) }}\n\n {% elif is_replaceable and existing_relation.is_materialized_view %}\n {{ get_replace_materialized_view_sql(target_relation, sql) }}\n\n {# /* a create or replace statement is not possible, so try to stage and/or backup to be safe */ #}\n\n {# /* create target_relation as an intermediate relation, then swap it out with the existing one using a backup */ #}\n {%- elif target_relation.can_be_renamed and existing_relation.can_be_renamed -%}\n {{ get_create_intermediate_sql(target_relation, sql) }};\n {{ get_create_backup_sql(existing_relation) }};\n {{ get_rename_intermediate_sql(target_relation) }};\n {{ get_drop_backup_sql(existing_relation) }}\n\n {# /* create target_relation as an intermediate relation, then swap it out with the existing one without using a backup */ #}\n {%- elif target_relation.can_be_renamed -%}\n {{ get_create_intermediate_sql(target_relation, sql) }};\n {{ get_drop_sql(existing_relation) }};\n {{ get_rename_intermediate_sql(target_relation) }}\n\n {# /* create target_relation in place by first backing up the existing relation */ #}\n {%- elif existing_relation.can_be_renamed -%}\n {{ get_create_backup_sql(existing_relation) }};\n {{ get_create_sql(target_relation, sql) }};\n {{ get_drop_backup_sql(existing_relation) }}\n\n {# /* no renaming is allowed, so just drop and create */ #}\n {%- else -%}\n {{ get_drop_sql(existing_relation) }};\n {{ get_create_sql(target_relation, sql) }}\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_replace_view_sql", "macro.dbt.get_replace_table_sql", "macro.dbt.get_replace_materialized_view_sql", "macro.dbt.get_create_intermediate_sql", "macro.dbt.get_create_backup_sql", "macro.dbt.get_rename_intermediate_sql", "macro.dbt.get_drop_backup_sql", "macro.dbt.get_drop_sql", "macro.dbt.get_create_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.835598, "supported_languages": null}, "macro.dbt.get_create_intermediate_sql": {"name": "get_create_intermediate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create_intermediate.sql", "original_file_path": "macros/relations/create_intermediate.sql", "unique_id": "macro.dbt.get_create_intermediate_sql", "macro_sql": "{%- macro get_create_intermediate_sql(relation, sql) -%}\n {{- log('Applying CREATE INTERMEDIATE to: ' ~ relation) -}}\n {{- adapter.dispatch('get_create_intermediate_sql', 'dbt')(relation, sql) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_create_intermediate_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.835989, "supported_languages": null}, "macro.dbt.default__get_create_intermediate_sql": {"name": "default__get_create_intermediate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create_intermediate.sql", "original_file_path": "macros/relations/create_intermediate.sql", "unique_id": "macro.dbt.default__get_create_intermediate_sql", "macro_sql": "{%- macro default__get_create_intermediate_sql(relation, sql) -%}\n\n -- get the standard intermediate name\n {% set intermediate_relation = make_intermediate_relation(relation) %}\n\n -- drop any pre-existing intermediate\n {{ get_drop_sql(intermediate_relation) }};\n\n {{ get_create_sql(intermediate_relation, sql) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.make_intermediate_relation", "macro.dbt.get_drop_sql", "macro.dbt.get_create_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.836252, "supported_languages": null}, "macro.dbt.get_drop_backup_sql": {"name": "get_drop_backup_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop_backup.sql", "original_file_path": "macros/relations/drop_backup.sql", "unique_id": "macro.dbt.get_drop_backup_sql", "macro_sql": "{%- macro get_drop_backup_sql(relation) -%}\n {{- log('Applying DROP BACKUP to: ' ~ relation) -}}\n {{- adapter.dispatch('get_drop_backup_sql', 'dbt')(relation) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_drop_backup_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.836576, "supported_languages": null}, "macro.dbt.default__get_drop_backup_sql": {"name": "default__get_drop_backup_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/drop_backup.sql", "original_file_path": "macros/relations/drop_backup.sql", "unique_id": "macro.dbt.default__get_drop_backup_sql", "macro_sql": "{%- macro default__get_drop_backup_sql(relation) -%}\n\n -- get the standard backup name\n {% set backup_relation = make_backup_relation(relation, relation.type) %}\n\n {{ get_drop_sql(backup_relation) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.make_backup_relation", "macro.dbt.get_drop_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8367932, "supported_languages": null}, "macro.dbt.get_rename_sql": {"name": "get_rename_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename.sql", "original_file_path": "macros/relations/rename.sql", "unique_id": "macro.dbt.get_rename_sql", "macro_sql": "{%- macro get_rename_sql(relation, new_name) -%}\n {{- log('Applying RENAME to: ' ~ relation) -}}\n {{- adapter.dispatch('get_rename_sql', 'dbt')(relation, new_name) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_rename_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.837513, "supported_languages": null}, "macro.dbt.default__get_rename_sql": {"name": "default__get_rename_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename.sql", "original_file_path": "macros/relations/rename.sql", "unique_id": "macro.dbt.default__get_rename_sql", "macro_sql": "{%- macro default__get_rename_sql(relation, new_name) -%}\n\n {%- if relation.is_view -%}\n {{ get_rename_view_sql(relation, new_name) }}\n\n {%- elif relation.is_table -%}\n {{ get_rename_table_sql(relation, new_name) }}\n\n {%- elif relation.is_materialized_view -%}\n {{ get_rename_materialized_view_sql(relation, new_name) }}\n\n {%- else -%}\n {{- exceptions.raise_compiler_error(\"`get_rename_sql` has not been implemented for: \" ~ relation.type ) -}}\n\n {%- endif -%}\n\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.get_rename_view_sql", "macro.dbt.get_rename_table_sql", "macro.dbt.get_rename_materialized_view_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.837974, "supported_languages": null}, "macro.dbt.rename_relation": {"name": "rename_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename.sql", "original_file_path": "macros/relations/rename.sql", "unique_id": "macro.dbt.rename_relation", "macro_sql": "{% macro rename_relation(from_relation, to_relation) -%}\n {{ return(adapter.dispatch('rename_relation', 'dbt')(from_relation, to_relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__rename_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.83819, "supported_languages": null}, "macro.dbt.default__rename_relation": {"name": "default__rename_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename.sql", "original_file_path": "macros/relations/rename.sql", "unique_id": "macro.dbt.default__rename_relation", "macro_sql": "{% macro default__rename_relation(from_relation, to_relation) -%}\n {% set target_name = adapter.quote_as_configured(to_relation.identifier, 'identifier') %}\n {% call statement('rename_relation') -%}\n alter table {{ from_relation }} rename to {{ target_name }}\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8384829, "supported_languages": null}, "macro.dbt.get_create_backup_sql": {"name": "get_create_backup_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create_backup.sql", "original_file_path": "macros/relations/create_backup.sql", "unique_id": "macro.dbt.get_create_backup_sql", "macro_sql": "{%- macro get_create_backup_sql(relation) -%}\n {{- log('Applying CREATE BACKUP to: ' ~ relation) -}}\n {{- adapter.dispatch('get_create_backup_sql', 'dbt')(relation) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_create_backup_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.838836, "supported_languages": null}, "macro.dbt.default__get_create_backup_sql": {"name": "default__get_create_backup_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create_backup.sql", "original_file_path": "macros/relations/create_backup.sql", "unique_id": "macro.dbt.default__get_create_backup_sql", "macro_sql": "{%- macro default__get_create_backup_sql(relation) -%}\n\n -- get the standard backup name\n {% set backup_relation = make_backup_relation(relation, relation.type) %}\n\n -- drop any pre-existing backup\n {{ get_drop_sql(backup_relation) }};\n\n {{ get_rename_sql(relation, backup_relation.identifier) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.make_backup_relation", "macro.dbt.get_drop_sql", "macro.dbt.get_rename_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.83912, "supported_languages": null}, "macro.dbt.get_create_sql": {"name": "get_create_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create.sql", "original_file_path": "macros/relations/create.sql", "unique_id": "macro.dbt.get_create_sql", "macro_sql": "{%- macro get_create_sql(relation, sql) -%}\n {{- log('Applying CREATE to: ' ~ relation) -}}\n {{- adapter.dispatch('get_create_sql', 'dbt')(relation, sql) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_create_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.839603, "supported_languages": null}, "macro.dbt.default__get_create_sql": {"name": "default__get_create_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/create.sql", "original_file_path": "macros/relations/create.sql", "unique_id": "macro.dbt.default__get_create_sql", "macro_sql": "{%- macro default__get_create_sql(relation, sql) -%}\n\n {%- if relation.is_view -%}\n {{ get_create_view_as_sql(relation, sql) }}\n\n {%- elif relation.is_table -%}\n {{ get_create_table_as_sql(False, relation, sql) }}\n\n {%- elif relation.is_materialized_view -%}\n {{ get_create_materialized_view_as_sql(relation, sql) }}\n\n {%- else -%}\n {{- exceptions.raise_compiler_error(\"`get_create_sql` has not been implemented for: \" ~ relation.type ) -}}\n\n {%- endif -%}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.get_create_view_as_sql", "macro.dbt.get_create_table_as_sql", "macro.dbt.get_create_materialized_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.840066, "supported_languages": null}, "macro.dbt.get_rename_intermediate_sql": {"name": "get_rename_intermediate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename_intermediate.sql", "original_file_path": "macros/relations/rename_intermediate.sql", "unique_id": "macro.dbt.get_rename_intermediate_sql", "macro_sql": "{%- macro get_rename_intermediate_sql(relation) -%}\n {{- log('Applying RENAME INTERMEDIATE to: ' ~ relation) -}}\n {{- adapter.dispatch('get_rename_intermediate_sql', 'dbt')(relation) -}}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": ["macro.dbt.default__get_rename_intermediate_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.840398, "supported_languages": null}, "macro.dbt.default__get_rename_intermediate_sql": {"name": "default__get_rename_intermediate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/rename_intermediate.sql", "original_file_path": "macros/relations/rename_intermediate.sql", "unique_id": "macro.dbt.default__get_rename_intermediate_sql", "macro_sql": "{%- macro default__get_rename_intermediate_sql(relation) -%}\n\n -- get the standard intermediate name\n {% set intermediate_relation = make_intermediate_relation(relation) %}\n\n {{ get_rename_sql(intermediate_relation, relation.identifier) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.make_intermediate_relation", "macro.dbt.get_rename_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8406148, "supported_languages": null}, "macro.dbt.drop_materialized_view": {"name": "drop_materialized_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/drop.sql", "original_file_path": "macros/relations/materialized_view/drop.sql", "unique_id": "macro.dbt.drop_materialized_view", "macro_sql": "{% macro drop_materialized_view(relation) -%}\n {{ return(adapter.dispatch('drop_materialized_view', 'dbt')(relation)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__drop_materialized_view"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.840886, "supported_languages": null}, "macro.dbt.default__drop_materialized_view": {"name": "default__drop_materialized_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/drop.sql", "original_file_path": "macros/relations/materialized_view/drop.sql", "unique_id": "macro.dbt.default__drop_materialized_view", "macro_sql": "{% macro default__drop_materialized_view(relation) -%}\n drop materialized view if exists {{ relation }} cascade\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8409941, "supported_languages": null}, "macro.dbt.get_replace_materialized_view_sql": {"name": "get_replace_materialized_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/replace.sql", "original_file_path": "macros/relations/materialized_view/replace.sql", "unique_id": "macro.dbt.get_replace_materialized_view_sql", "macro_sql": "{% macro get_replace_materialized_view_sql(relation, sql) %}\n {{- adapter.dispatch('get_replace_materialized_view_sql', 'dbt')(relation, sql) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_replace_materialized_view_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.84127, "supported_languages": null}, "macro.dbt.default__get_replace_materialized_view_sql": {"name": "default__get_replace_materialized_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/replace.sql", "original_file_path": "macros/relations/materialized_view/replace.sql", "unique_id": "macro.dbt.default__get_replace_materialized_view_sql", "macro_sql": "{% macro default__get_replace_materialized_view_sql(relation, sql) %}\n {{ exceptions.raise_compiler_error(\n \"`get_replace_materialized_view_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.841428, "supported_languages": null}, "macro.dbt.refresh_materialized_view": {"name": "refresh_materialized_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/refresh.sql", "original_file_path": "macros/relations/materialized_view/refresh.sql", "unique_id": "macro.dbt.refresh_materialized_view", "macro_sql": "{% macro refresh_materialized_view(relation) %}\n {{- log('Applying REFRESH to: ' ~ relation) -}}\n {{- adapter.dispatch('refresh_materialized_view', 'dbt')(relation) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__refresh_materialized_view"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.841743, "supported_languages": null}, "macro.dbt.default__refresh_materialized_view": {"name": "default__refresh_materialized_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/refresh.sql", "original_file_path": "macros/relations/materialized_view/refresh.sql", "unique_id": "macro.dbt.default__refresh_materialized_view", "macro_sql": "{% macro default__refresh_materialized_view(relation) %}\n {{ exceptions.raise_compiler_error(\"`refresh_materialized_view` has not been implemented for this adapter.\") }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8419452, "supported_languages": null}, "macro.dbt.get_rename_materialized_view_sql": {"name": "get_rename_materialized_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/rename.sql", "original_file_path": "macros/relations/materialized_view/rename.sql", "unique_id": "macro.dbt.get_rename_materialized_view_sql", "macro_sql": "{% macro get_rename_materialized_view_sql(relation, new_name) %}\n {{- adapter.dispatch('get_rename_materialized_view_sql', 'dbt')(relation, new_name) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_rename_materialized_view_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8422232, "supported_languages": null}, "macro.dbt.default__get_rename_materialized_view_sql": {"name": "default__get_rename_materialized_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/rename.sql", "original_file_path": "macros/relations/materialized_view/rename.sql", "unique_id": "macro.dbt.default__get_rename_materialized_view_sql", "macro_sql": "{% macro default__get_rename_materialized_view_sql(relation, new_name) %}\n {{ exceptions.raise_compiler_error(\n \"`get_rename_materialized_view_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8423731, "supported_languages": null}, "macro.dbt.get_alter_materialized_view_as_sql": {"name": "get_alter_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt.get_alter_materialized_view_as_sql", "macro_sql": "{% macro get_alter_materialized_view_as_sql(\n relation,\n configuration_changes,\n sql,\n existing_relation,\n backup_relation,\n intermediate_relation\n) %}\n {{- log('Applying ALTER to: ' ~ relation) -}}\n {{- adapter.dispatch('get_alter_materialized_view_as_sql', 'dbt')(\n relation,\n configuration_changes,\n sql,\n existing_relation,\n backup_relation,\n intermediate_relation\n ) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_alter_materialized_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8429928, "supported_languages": null}, "macro.dbt.default__get_alter_materialized_view_as_sql": {"name": "default__get_alter_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt.default__get_alter_materialized_view_as_sql", "macro_sql": "{% macro default__get_alter_materialized_view_as_sql(\n relation,\n configuration_changes,\n sql,\n existing_relation,\n backup_relation,\n intermediate_relation\n) %}\n {{ exceptions.raise_compiler_error(\"Materialized views have not been implemented for this adapter.\") }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8431869, "supported_languages": null}, "macro.dbt.get_materialized_view_configuration_changes": {"name": "get_materialized_view_configuration_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt.get_materialized_view_configuration_changes", "macro_sql": "{% macro get_materialized_view_configuration_changes(existing_relation, new_config) %}\n /* {#\n It's recommended that configuration changes be formatted as follows:\n {\"\": [{\"action\": \"\", \"context\": ...}]}\n\n For example:\n {\n \"indexes\": [\n {\"action\": \"drop\", \"context\": \"index_abc\"},\n {\"action\": \"create\", \"context\": {\"columns\": [\"column_1\", \"column_2\"], \"type\": \"hash\", \"unique\": True}},\n ],\n }\n\n Either way, `get_materialized_view_configuration_changes` needs to align with `get_alter_materialized_view_as_sql`.\n #} */\n {{- log('Determining configuration changes on: ' ~ existing_relation) -}}\n {%- do return(adapter.dispatch('get_materialized_view_configuration_changes', 'dbt')(existing_relation, new_config)) -%}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_materialized_view_configuration_changes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.843484, "supported_languages": null}, "macro.dbt.default__get_materialized_view_configuration_changes": {"name": "default__get_materialized_view_configuration_changes", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/alter.sql", "original_file_path": "macros/relations/materialized_view/alter.sql", "unique_id": "macro.dbt.default__get_materialized_view_configuration_changes", "macro_sql": "{% macro default__get_materialized_view_configuration_changes(existing_relation, new_config) %}\n {{ exceptions.raise_compiler_error(\"Materialized views have not been implemented for this adapter.\") }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8436348, "supported_languages": null}, "macro.dbt.get_create_materialized_view_as_sql": {"name": "get_create_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/create.sql", "original_file_path": "macros/relations/materialized_view/create.sql", "unique_id": "macro.dbt.get_create_materialized_view_as_sql", "macro_sql": "{% macro get_create_materialized_view_as_sql(relation, sql) -%}\n {{- adapter.dispatch('get_create_materialized_view_as_sql', 'dbt')(relation, sql) -}}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_create_materialized_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.843916, "supported_languages": null}, "macro.dbt.default__get_create_materialized_view_as_sql": {"name": "default__get_create_materialized_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/materialized_view/create.sql", "original_file_path": "macros/relations/materialized_view/create.sql", "unique_id": "macro.dbt.default__get_create_materialized_view_as_sql", "macro_sql": "{% macro default__get_create_materialized_view_as_sql(relation, sql) -%}\n {{ exceptions.raise_compiler_error(\n \"`get_create_materialized_view_as_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8440619, "supported_languages": null}, "macro.dbt.get_table_columns_and_constraints": {"name": "get_table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.get_table_columns_and_constraints", "macro_sql": "{%- macro get_table_columns_and_constraints() -%}\n {{ adapter.dispatch('get_table_columns_and_constraints', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__get_table_columns_and_constraints"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.845085, "supported_languages": null}, "macro.dbt.default__get_table_columns_and_constraints": {"name": "default__get_table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__get_table_columns_and_constraints", "macro_sql": "{% macro default__get_table_columns_and_constraints() -%}\n {{ return(table_columns_and_constraints()) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.table_columns_and_constraints"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.84521, "supported_languages": null}, "macro.dbt.table_columns_and_constraints": {"name": "table_columns_and_constraints", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.table_columns_and_constraints", "macro_sql": "{% macro table_columns_and_constraints() %}\n {# loop through user_provided_columns to create DDL with data types and constraints #}\n {%- set raw_column_constraints = adapter.render_raw_columns_constraints(raw_columns=model['columns']) -%}\n {%- set raw_model_constraints = adapter.render_raw_model_constraints(raw_constraints=model['constraints']) -%}\n (\n {% for c in raw_column_constraints -%}\n {{ c }}{{ \",\" if not loop.last or raw_model_constraints }}\n {% endfor %}\n {% for c in raw_model_constraints -%}\n {{ c }}{{ \",\" if not loop.last }}\n {% endfor -%}\n )\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.845769, "supported_languages": null}, "macro.dbt.get_assert_columns_equivalent": {"name": "get_assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.get_assert_columns_equivalent", "macro_sql": "\n\n{%- macro get_assert_columns_equivalent(sql) -%}\n {{ adapter.dispatch('get_assert_columns_equivalent', 'dbt')(sql) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__get_assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.845942, "supported_languages": null}, "macro.dbt.default__get_assert_columns_equivalent": {"name": "default__get_assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__get_assert_columns_equivalent", "macro_sql": "{% macro default__get_assert_columns_equivalent(sql) -%}\n {{ return(assert_columns_equivalent(sql)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8460832, "supported_languages": null}, "macro.dbt.assert_columns_equivalent": {"name": "assert_columns_equivalent", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.assert_columns_equivalent", "macro_sql": "{% macro assert_columns_equivalent(sql) %}\n\n {#-- First ensure the user has defined 'columns' in yaml specification --#}\n {%- set user_defined_columns = model['columns'] -%}\n {%- if not user_defined_columns -%}\n {{ exceptions.raise_contract_error([], []) }}\n {%- endif -%}\n\n {#-- Obtain the column schema provided by sql file. #}\n {%- set sql_file_provided_columns = get_column_schema_from_query(sql, config.get('sql_header', none)) -%}\n {#--Obtain the column schema provided by the schema file by generating an 'empty schema' query from the model's columns. #}\n {%- set schema_file_provided_columns = get_column_schema_from_query(get_empty_schema_sql(user_defined_columns)) -%}\n\n {#-- create dictionaries with name and formatted data type and strings for exception #}\n {%- set sql_columns = format_columns(sql_file_provided_columns) -%}\n {%- set yaml_columns = format_columns(schema_file_provided_columns) -%}\n\n {%- if sql_columns|length != yaml_columns|length -%}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n\n {%- for sql_col in sql_columns -%}\n {%- set yaml_col = [] -%}\n {%- for this_col in yaml_columns -%}\n {%- if this_col['name'] == sql_col['name'] -%}\n {%- do yaml_col.append(this_col) -%}\n {%- break -%}\n {%- endif -%}\n {%- endfor -%}\n {%- if not yaml_col -%}\n {#-- Column with name not found in yaml #}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n {%- if sql_col['formatted'] != yaml_col[0]['formatted'] -%}\n {#-- Column data types don't match #}\n {%- do exceptions.raise_contract_error(yaml_columns, sql_columns) -%}\n {%- endif -%}\n {%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_column_schema_from_query", "macro.dbt.get_empty_schema_sql", "macro.dbt.format_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.84747, "supported_languages": null}, "macro.dbt.format_columns": {"name": "format_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.format_columns", "macro_sql": "{% macro format_columns(columns) %}\n {% set formatted_columns = [] %}\n {% for column in columns %}\n {%- set formatted_column = adapter.dispatch('format_column', 'dbt')(column) -%}\n {%- do formatted_columns.append(formatted_column) -%}\n {% endfor %}\n {{ return(formatted_columns) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__format_column"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.847869, "supported_languages": null}, "macro.dbt.default__format_column": {"name": "default__format_column", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/column/columns_spec_ddl.sql", "original_file_path": "macros/relations/column/columns_spec_ddl.sql", "unique_id": "macro.dbt.default__format_column", "macro_sql": "{% macro default__format_column(column) -%}\n {% set data_type = column.dtype %}\n {% set formatted = column.column.lower() ~ \" \" ~ data_type %}\n {{ return({'name': column.name, 'data_type': data_type, 'formatted': formatted}) }}\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8482308, "supported_languages": null}, "macro.dbt.drop_table": {"name": "drop_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/drop.sql", "original_file_path": "macros/relations/table/drop.sql", "unique_id": "macro.dbt.drop_table", "macro_sql": "{% macro drop_table(relation) -%}\n {{ return(adapter.dispatch('drop_table', 'dbt')(relation)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__drop_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8485062, "supported_languages": null}, "macro.dbt.default__drop_table": {"name": "default__drop_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/drop.sql", "original_file_path": "macros/relations/table/drop.sql", "unique_id": "macro.dbt.default__drop_table", "macro_sql": "{% macro default__drop_table(relation) -%}\n drop table if exists {{ relation }} cascade\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.848614, "supported_languages": null}, "macro.dbt.get_replace_table_sql": {"name": "get_replace_table_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/replace.sql", "original_file_path": "macros/relations/table/replace.sql", "unique_id": "macro.dbt.get_replace_table_sql", "macro_sql": "{% macro get_replace_table_sql(relation, sql) %}\n {{- adapter.dispatch('get_replace_table_sql', 'dbt')(relation, sql) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_replace_table_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8488908, "supported_languages": null}, "macro.dbt.default__get_replace_table_sql": {"name": "default__get_replace_table_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/replace.sql", "original_file_path": "macros/relations/table/replace.sql", "unique_id": "macro.dbt.default__get_replace_table_sql", "macro_sql": "{% macro default__get_replace_table_sql(relation, sql) %}\n {{ exceptions.raise_compiler_error(\n \"`get_replace_table_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.849044, "supported_languages": null}, "macro.dbt.get_rename_table_sql": {"name": "get_rename_table_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/rename.sql", "original_file_path": "macros/relations/table/rename.sql", "unique_id": "macro.dbt.get_rename_table_sql", "macro_sql": "{% macro get_rename_table_sql(relation, new_name) %}\n {{- adapter.dispatch('get_rename_table_sql', 'dbt')(relation, new_name) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_rename_table_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.849322, "supported_languages": null}, "macro.dbt.default__get_rename_table_sql": {"name": "default__get_rename_table_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/rename.sql", "original_file_path": "macros/relations/table/rename.sql", "unique_id": "macro.dbt.default__get_rename_table_sql", "macro_sql": "{% macro default__get_rename_table_sql(relation, new_name) %}\n {{ exceptions.raise_compiler_error(\n \"`get_rename_table_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.849476, "supported_languages": null}, "macro.dbt.get_create_table_as_sql": {"name": "get_create_table_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.get_create_table_as_sql", "macro_sql": "{% macro get_create_table_as_sql(temporary, relation, sql) -%}\n {{ adapter.dispatch('get_create_table_as_sql', 'dbt')(temporary, relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_create_table_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8503501, "supported_languages": null}, "macro.dbt.default__get_create_table_as_sql": {"name": "default__get_create_table_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.default__get_create_table_as_sql", "macro_sql": "{% macro default__get_create_table_as_sql(temporary, relation, sql) -%}\n {{ return(create_table_as(temporary, relation, sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.850541, "supported_languages": null}, "macro.dbt.create_table_as": {"name": "create_table_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.create_table_as", "macro_sql": "{% macro create_table_as(temporary, relation, compiled_code, language='sql') -%}\n {# backward compatibility for create_table_as that does not support language #}\n {% if language == \"sql\" %}\n {{ adapter.dispatch('create_table_as', 'dbt')(temporary, relation, compiled_code)}}\n {% else %}\n {{ adapter.dispatch('create_table_as', 'dbt')(temporary, relation, compiled_code, language) }}\n {% endif %}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_table_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.851, "supported_languages": null}, "macro.dbt.default__create_table_as": {"name": "default__create_table_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.default__create_table_as", "macro_sql": "{% macro default__create_table_as(temporary, relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n\n create {% if temporary: -%}temporary{%- endif %} table\n {{ relation.include(database=(not temporary), schema=(not temporary)) }}\n {% set contract_config = config.get('contract') %}\n {% if contract_config.enforced and (not temporary) %}\n {{ get_assert_columns_equivalent(sql) }}\n {{ get_table_columns_and_constraints() }}\n {%- set sql = get_select_subquery(sql) %}\n {% endif %}\n as (\n {{ sql }}\n );\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_assert_columns_equivalent", "macro.dbt.get_table_columns_and_constraints", "macro.dbt.get_select_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.851733, "supported_languages": null}, "macro.dbt.default__get_column_names": {"name": "default__get_column_names", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.default__get_column_names", "macro_sql": "{% macro default__get_column_names() %}\n {#- loop through user_provided_columns to get column names -#}\n {%- set user_provided_columns = model['columns'] -%}\n {%- for i in user_provided_columns %}\n {%- set col = user_provided_columns[i] -%}\n {%- set col_name = adapter.quote(col['name']) if col.get('quote') else col['name'] -%}\n {{ col_name }}{{ \", \" if not loop.last }}\n {%- endfor -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.852216, "supported_languages": null}, "macro.dbt.get_select_subquery": {"name": "get_select_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.get_select_subquery", "macro_sql": "{% macro get_select_subquery(sql) %}\n {{ return(adapter.dispatch('get_select_subquery', 'dbt')(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_select_subquery"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8524108, "supported_languages": null}, "macro.dbt.default__get_select_subquery": {"name": "default__get_select_subquery", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/table/create.sql", "original_file_path": "macros/relations/table/create.sql", "unique_id": "macro.dbt.default__get_select_subquery", "macro_sql": "{% macro default__get_select_subquery(sql) %}\n select {{ adapter.dispatch('get_column_names', 'dbt')() }}\n from (\n {{ sql }}\n ) as model_subq\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_column_names"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.852594, "supported_languages": null}, "macro.dbt.drop_view": {"name": "drop_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/drop.sql", "original_file_path": "macros/relations/view/drop.sql", "unique_id": "macro.dbt.drop_view", "macro_sql": "{% macro drop_view(relation) -%}\n {{ return(adapter.dispatch('drop_view', 'dbt')(relation)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__drop_view"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.852861, "supported_languages": null}, "macro.dbt.default__drop_view": {"name": "default__drop_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/drop.sql", "original_file_path": "macros/relations/view/drop.sql", "unique_id": "macro.dbt.default__drop_view", "macro_sql": "{% macro default__drop_view(relation) -%}\n drop view if exists {{ relation }} cascade\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.852967, "supported_languages": null}, "macro.dbt.get_replace_view_sql": {"name": "get_replace_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt.get_replace_view_sql", "macro_sql": "{% macro get_replace_view_sql(relation, sql) %}\n {{- adapter.dispatch('get_replace_view_sql', 'dbt')(relation, sql) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_replace_view_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8538408, "supported_languages": null}, "macro.dbt.default__get_replace_view_sql": {"name": "default__get_replace_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt.default__get_replace_view_sql", "macro_sql": "{% macro default__get_replace_view_sql(relation, sql) %}\n {{ exceptions.raise_compiler_error(\n \"`get_replace_view_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.853994, "supported_languages": null}, "macro.dbt.create_or_replace_view": {"name": "create_or_replace_view", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt.create_or_replace_view", "macro_sql": "{% macro create_or_replace_view() %}\n {%- set identifier = model['alias'] -%}\n\n {%- set old_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) -%}\n {%- set exists_as_view = (old_relation is not none and old_relation.is_view) -%}\n\n {%- set target_relation = api.Relation.create(\n identifier=identifier, schema=schema, database=database,\n type='view') -%}\n {% set grant_config = config.get('grants') %}\n\n {{ run_hooks(pre_hooks) }}\n\n -- If there's a table with the same name and we weren't told to full refresh,\n -- that's an error. If we were told to full refresh, drop it. This behavior differs\n -- for Snowflake and BigQuery, so multiple dispatch is used.\n {%- if old_relation is not none and old_relation.is_table -%}\n {{ handle_existing_table(should_full_refresh(), old_relation) }}\n {%- endif -%}\n\n -- build model\n {% call statement('main') -%}\n {{ get_create_view_as_sql(target_relation, sql) }}\n {%- endcall %}\n\n {% set should_revoke = should_revoke(exists_as_view, full_refresh_mode=True) %}\n {% do apply_grants(target_relation, grant_config, should_revoke=should_revoke) %}\n\n {{ run_hooks(post_hooks) }}\n\n {{ return({'relations': [target_relation]}) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_hooks", "macro.dbt.handle_existing_table", "macro.dbt.should_full_refresh", "macro.dbt.statement", "macro.dbt.get_create_view_as_sql", "macro.dbt.should_revoke", "macro.dbt.apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.855236, "supported_languages": null}, "macro.dbt.handle_existing_table": {"name": "handle_existing_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt.handle_existing_table", "macro_sql": "{% macro handle_existing_table(full_refresh, old_relation) %}\n {{ adapter.dispatch('handle_existing_table', 'dbt')(full_refresh, old_relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__handle_existing_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.855444, "supported_languages": null}, "macro.dbt.default__handle_existing_table": {"name": "default__handle_existing_table", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/replace.sql", "original_file_path": "macros/relations/view/replace.sql", "unique_id": "macro.dbt.default__handle_existing_table", "macro_sql": "{% macro default__handle_existing_table(full_refresh, old_relation) %}\n {{ log(\"Dropping relation \" ~ old_relation ~ \" because it is of type \" ~ old_relation.type) }}\n {{ adapter.drop_relation(old_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.855676, "supported_languages": null}, "macro.dbt.get_rename_view_sql": {"name": "get_rename_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/rename.sql", "original_file_path": "macros/relations/view/rename.sql", "unique_id": "macro.dbt.get_rename_view_sql", "macro_sql": "{% macro get_rename_view_sql(relation, new_name) %}\n {{- adapter.dispatch('get_rename_view_sql', 'dbt')(relation, new_name) -}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_rename_view_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.855953, "supported_languages": null}, "macro.dbt.default__get_rename_view_sql": {"name": "default__get_rename_view_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/rename.sql", "original_file_path": "macros/relations/view/rename.sql", "unique_id": "macro.dbt.default__get_rename_view_sql", "macro_sql": "{% macro default__get_rename_view_sql(relation, new_name) %}\n {{ exceptions.raise_compiler_error(\n \"`get_rename_view_sql` has not been implemented for this adapter.\"\n ) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.856102, "supported_languages": null}, "macro.dbt.get_create_view_as_sql": {"name": "get_create_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/create.sql", "original_file_path": "macros/relations/view/create.sql", "unique_id": "macro.dbt.get_create_view_as_sql", "macro_sql": "{% macro get_create_view_as_sql(relation, sql) -%}\n {{ adapter.dispatch('get_create_view_as_sql', 'dbt')(relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_create_view_as_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.856544, "supported_languages": null}, "macro.dbt.default__get_create_view_as_sql": {"name": "default__get_create_view_as_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/create.sql", "original_file_path": "macros/relations/view/create.sql", "unique_id": "macro.dbt.default__get_create_view_as_sql", "macro_sql": "{% macro default__get_create_view_as_sql(relation, sql) -%}\n {{ return(create_view_as(relation, sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.create_view_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.856711, "supported_languages": null}, "macro.dbt.create_view_as": {"name": "create_view_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/create.sql", "original_file_path": "macros/relations/view/create.sql", "unique_id": "macro.dbt.create_view_as", "macro_sql": "{% macro create_view_as(relation, sql) -%}\n {{ adapter.dispatch('create_view_as', 'dbt')(relation, sql) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__create_view_as"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.856899, "supported_languages": null}, "macro.dbt.default__create_view_as": {"name": "default__create_view_as", "resource_type": "macro", "package_name": "dbt", "path": "macros/relations/view/create.sql", "original_file_path": "macros/relations/view/create.sql", "unique_id": "macro.dbt.default__create_view_as", "macro_sql": "{% macro default__create_view_as(relation, sql) -%}\n {%- set sql_header = config.get('sql_header', none) -%}\n\n {{ sql_header if sql_header is not none }}\n create view {{ relation }}\n {% set contract_config = config.get('contract') %}\n {% if contract_config.enforced %}\n {{ get_assert_columns_equivalent(sql) }}\n {%- endif %}\n as (\n {{ sql }}\n );\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.get_assert_columns_equivalent"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.857347, "supported_languages": null}, "macro.dbt.default__test_relationships": {"name": "default__test_relationships", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/relationships.sql", "original_file_path": "macros/generic_test_sql/relationships.sql", "unique_id": "macro.dbt.default__test_relationships", "macro_sql": "{% macro default__test_relationships(model, column_name, to, field) %}\n\nwith child as (\n select {{ column_name }} as from_field\n from {{ model }}\n where {{ column_name }} is not null\n),\n\nparent as (\n select {{ field }} as to_field\n from {{ to }}\n)\n\nselect\n from_field\n\nfrom child\nleft join parent\n on child.from_field = parent.to_field\n\nwhere parent.to_field is null\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.857707, "supported_languages": null}, "macro.dbt.default__test_not_null": {"name": "default__test_not_null", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/not_null.sql", "original_file_path": "macros/generic_test_sql/not_null.sql", "unique_id": "macro.dbt.default__test_not_null", "macro_sql": "{% macro default__test_not_null(model, column_name) %}\n\n{% set column_list = '*' if should_store_failures() else column_name %}\n\nselect {{ column_list }}\nfrom {{ model }}\nwhere {{ column_name }} is null\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_store_failures"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8580139, "supported_languages": null}, "macro.dbt.default__test_unique": {"name": "default__test_unique", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/unique.sql", "original_file_path": "macros/generic_test_sql/unique.sql", "unique_id": "macro.dbt.default__test_unique", "macro_sql": "{% macro default__test_unique(model, column_name) %}\n\nselect\n {{ column_name }} as unique_field,\n count(*) as n_records\n\nfrom {{ model }}\nwhere {{ column_name }} is not null\ngroup by {{ column_name }}\nhaving count(*) > 1\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.858266, "supported_languages": null}, "macro.dbt.default__test_accepted_values": {"name": "default__test_accepted_values", "resource_type": "macro", "package_name": "dbt", "path": "macros/generic_test_sql/accepted_values.sql", "original_file_path": "macros/generic_test_sql/accepted_values.sql", "unique_id": "macro.dbt.default__test_accepted_values", "macro_sql": "{% macro default__test_accepted_values(model, column_name, values, quote=True) %}\n\nwith all_values as (\n\n select\n {{ column_name }} as value_field,\n count(*) as n_records\n\n from {{ model }}\n group by {{ column_name }}\n\n)\n\nselect *\nfrom all_values\nwhere value_field not in (\n {% for value in values -%}\n {% if quote -%}\n '{{ value }}'\n {%- else -%}\n {{ value }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {%- endfor %}\n)\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.858853, "supported_languages": null}, "macro.dbt.statement": {"name": "statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.statement", "macro_sql": "\n{%- macro statement(name=None, fetch_result=False, auto_begin=True, language='sql') -%}\n {%- if execute: -%}\n {%- set compiled_code = caller() -%}\n\n {%- if name == 'main' -%}\n {{ log('Writing runtime {} for node \"{}\"'.format(language, model['unique_id'])) }}\n {{ write(compiled_code) }}\n {%- endif -%}\n {%- if language == 'sql'-%}\n {%- set res, table = adapter.execute(compiled_code, auto_begin=auto_begin, fetch=fetch_result) -%}\n {%- elif language == 'python' -%}\n {%- set res = submit_python_job(model, compiled_code) -%}\n {#-- TODO: What should table be for python models? --#}\n {%- set table = None -%}\n {%- else -%}\n {% do exceptions.raise_compiler_error(\"statement macro didn't get supported language\") %}\n {%- endif -%}\n\n {%- if name is not none -%}\n {{ store_result(name, response=res, agate_table=table) }}\n {%- endif -%}\n\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.860374, "supported_languages": null}, "macro.dbt.noop_statement": {"name": "noop_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.noop_statement", "macro_sql": "{% macro noop_statement(name=None, message=None, code=None, rows_affected=None, res=None) -%}\n {%- set sql = caller() -%}\n\n {%- if name == 'main' -%}\n {{ log('Writing runtime SQL for node \"{}\"'.format(model['unique_id'])) }}\n {{ write(sql) }}\n {%- endif -%}\n\n {%- if name is not none -%}\n {{ store_raw_result(name, message=message, code=code, rows_affected=rows_affected, agate_table=res) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.860985, "supported_languages": null}, "macro.dbt.run_query": {"name": "run_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/statement.sql", "original_file_path": "macros/etc/statement.sql", "unique_id": "macro.dbt.run_query", "macro_sql": "{% macro run_query(sql) %}\n {% call statement(\"run_query_statement\", fetch_result=true, auto_begin=false) %}\n {{ sql }}\n {% endcall %}\n\n {% do return(load_result(\"run_query_statement\").table) %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.86129, "supported_languages": null}, "macro.dbt.convert_datetime": {"name": "convert_datetime", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.convert_datetime", "macro_sql": "{% macro convert_datetime(date_str, date_fmt) %}\n\n {% set error_msg -%}\n The provided partition date '{{ date_str }}' does not match the expected format '{{ date_fmt }}'\n {%- endset %}\n\n {% set res = try_or_compiler_error(error_msg, modules.datetime.datetime.strptime, date_str.strip(), date_fmt) %}\n {{ return(res) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8632011, "supported_languages": null}, "macro.dbt.dates_in_range": {"name": "dates_in_range", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.dates_in_range", "macro_sql": "{% macro dates_in_range(start_date_str, end_date_str=none, in_fmt=\"%Y%m%d\", out_fmt=\"%Y%m%d\") %}\n {% set end_date_str = start_date_str if end_date_str is none else end_date_str %}\n\n {% set start_date = convert_datetime(start_date_str, in_fmt) %}\n {% set end_date = convert_datetime(end_date_str, in_fmt) %}\n\n {% set day_count = (end_date - start_date).days %}\n {% if day_count < 0 %}\n {% set msg -%}\n Partition start date is after the end date ({{ start_date }}, {{ end_date }})\n {%- endset %}\n\n {{ exceptions.raise_compiler_error(msg, model) }}\n {% endif %}\n\n {% set date_list = [] %}\n {% for i in range(0, day_count + 1) %}\n {% set the_date = (modules.datetime.timedelta(days=i) + start_date) %}\n {% if not out_fmt %}\n {% set _ = date_list.append(the_date) %}\n {% else %}\n {% set _ = date_list.append(the_date.strftime(out_fmt)) %}\n {% endif %}\n {% endfor %}\n\n {{ return(date_list) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.convert_datetime"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.864511, "supported_languages": null}, "macro.dbt.partition_range": {"name": "partition_range", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.partition_range", "macro_sql": "{% macro partition_range(raw_partition_date, date_fmt='%Y%m%d') %}\n {% set partition_range = (raw_partition_date | string).split(\",\") %}\n\n {% if (partition_range | length) == 1 %}\n {% set start_date = partition_range[0] %}\n {% set end_date = none %}\n {% elif (partition_range | length) == 2 %}\n {% set start_date = partition_range[0] %}\n {% set end_date = partition_range[1] %}\n {% else %}\n {{ exceptions.raise_compiler_error(\"Invalid partition time. Expected format: {Start Date}[,{End Date}]. Got: \" ~ raw_partition_date) }}\n {% endif %}\n\n {{ return(dates_in_range(start_date, end_date, in_fmt=date_fmt)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dates_in_range"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.86531, "supported_languages": null}, "macro.dbt.py_current_timestring": {"name": "py_current_timestring", "resource_type": "macro", "package_name": "dbt", "path": "macros/etc/datetime.sql", "original_file_path": "macros/etc/datetime.sql", "unique_id": "macro.dbt.py_current_timestring", "macro_sql": "{% macro py_current_timestring() %}\n {% set dt = modules.datetime.datetime.now() %}\n {% do return(dt.strftime(\"%Y%m%d%H%M%S%f\")) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8655539, "supported_languages": null}, "macro.dbt.except": {"name": "except", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/except.sql", "original_file_path": "macros/utils/except.sql", "unique_id": "macro.dbt.except", "macro_sql": "{% macro except() %}\n {{ return(adapter.dispatch('except', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8657868, "supported_languages": null}, "macro.dbt.default__except": {"name": "default__except", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/except.sql", "original_file_path": "macros/utils/except.sql", "unique_id": "macro.dbt.default__except", "macro_sql": "{% macro default__except() %}\n\n except\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.865867, "supported_languages": null}, "macro.dbt.get_intervals_between": {"name": "get_intervals_between", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_spine.sql", "original_file_path": "macros/utils/date_spine.sql", "unique_id": "macro.dbt.get_intervals_between", "macro_sql": "{% macro get_intervals_between(start_date, end_date, datepart) -%}\n {{ return(adapter.dispatch('get_intervals_between', 'dbt')(start_date, end_date, datepart)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_intervals_between"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.866625, "supported_languages": null}, "macro.dbt.default__get_intervals_between": {"name": "default__get_intervals_between", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_spine.sql", "original_file_path": "macros/utils/date_spine.sql", "unique_id": "macro.dbt.default__get_intervals_between", "macro_sql": "{% macro default__get_intervals_between(start_date, end_date, datepart) -%}\n {%- call statement('get_intervals_between', fetch_result=True) %}\n\n select {{ dbt.datediff(start_date, end_date, datepart) }}\n\n {%- endcall -%}\n\n {%- set value_list = load_result('get_intervals_between') -%}\n\n {%- if value_list and value_list['data'] -%}\n {%- set values = value_list['data'] | map(attribute=0) | list %}\n {{ return(values[0]) }}\n {%- else -%}\n {{ return(1) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.867249, "supported_languages": null}, "macro.dbt.date_spine": {"name": "date_spine", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_spine.sql", "original_file_path": "macros/utils/date_spine.sql", "unique_id": "macro.dbt.date_spine", "macro_sql": "{% macro date_spine(datepart, start_date, end_date) %}\n {{ return(adapter.dispatch('date_spine', 'dbt')(datepart, start_date, end_date)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__date_spine"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8674932, "supported_languages": null}, "macro.dbt.default__date_spine": {"name": "default__date_spine", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_spine.sql", "original_file_path": "macros/utils/date_spine.sql", "unique_id": "macro.dbt.default__date_spine", "macro_sql": "{% macro default__date_spine(datepart, start_date, end_date) %}\n\n\n {# call as follows:\n\n date_spine(\n \"day\",\n \"to_date('01/01/2016', 'mm/dd/yyyy')\",\n \"dbt.dateadd(week, 1, current_date)\"\n ) #}\n\n\n with rawdata as (\n\n {{dbt.generate_series(\n dbt.get_intervals_between(start_date, end_date, datepart)\n )}}\n\n ),\n\n all_periods as (\n\n select (\n {{\n dbt.dateadd(\n datepart,\n \"row_number() over (order by 1) - 1\",\n start_date\n )\n }}\n ) as date_{{datepart}}\n from rawdata\n\n ),\n\n filtered as (\n\n select *\n from all_periods\n where date_{{datepart}} <= {{ end_date }}\n\n )\n\n select * from filtered\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.generate_series", "macro.dbt.get_intervals_between", "macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8678799, "supported_languages": null}, "macro.dbt.replace": {"name": "replace", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/replace.sql", "original_file_path": "macros/utils/replace.sql", "unique_id": "macro.dbt.replace", "macro_sql": "{% macro replace(field, old_chars, new_chars) -%}\n {{ return(adapter.dispatch('replace', 'dbt') (field, old_chars, new_chars)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__replace"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.868221, "supported_languages": null}, "macro.dbt.default__replace": {"name": "default__replace", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/replace.sql", "original_file_path": "macros/utils/replace.sql", "unique_id": "macro.dbt.default__replace", "macro_sql": "{% macro default__replace(field, old_chars, new_chars) %}\n\n replace(\n {{ field }},\n {{ old_chars }},\n {{ new_chars }}\n )\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.868392, "supported_languages": null}, "macro.dbt.concat": {"name": "concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/concat.sql", "original_file_path": "macros/utils/concat.sql", "unique_id": "macro.dbt.concat", "macro_sql": "{% macro concat(fields) -%}\n {{ return(adapter.dispatch('concat', 'dbt')(fields)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.868643, "supported_languages": null}, "macro.dbt.default__concat": {"name": "default__concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/concat.sql", "original_file_path": "macros/utils/concat.sql", "unique_id": "macro.dbt.default__concat", "macro_sql": "{% macro default__concat(fields) -%}\n {{ fields|join(' || ') }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8687701, "supported_languages": null}, "macro.dbt.get_powers_of_two": {"name": "get_powers_of_two", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/generate_series.sql", "original_file_path": "macros/utils/generate_series.sql", "unique_id": "macro.dbt.get_powers_of_two", "macro_sql": "{% macro get_powers_of_two(upper_bound) %}\n {{ return(adapter.dispatch('get_powers_of_two', 'dbt')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.869621, "supported_languages": null}, "macro.dbt.default__get_powers_of_two": {"name": "default__get_powers_of_two", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/generate_series.sql", "original_file_path": "macros/utils/generate_series.sql", "unique_id": "macro.dbt.default__get_powers_of_two", "macro_sql": "{% macro default__get_powers_of_two(upper_bound) %}\n\n {% if upper_bound <= 0 %}\n {{ exceptions.raise_compiler_error(\"upper bound must be positive\") }}\n {% endif %}\n\n {% for _ in range(1, 100) %}\n {% if upper_bound <= 2 ** loop.index %}{{ return(loop.index) }}{% endif %}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.870055, "supported_languages": null}, "macro.dbt.generate_series": {"name": "generate_series", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/generate_series.sql", "original_file_path": "macros/utils/generate_series.sql", "unique_id": "macro.dbt.generate_series", "macro_sql": "{% macro generate_series(upper_bound) %}\n {{ return(adapter.dispatch('generate_series', 'dbt')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__generate_series"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.870249, "supported_languages": null}, "macro.dbt.default__generate_series": {"name": "default__generate_series", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/generate_series.sql", "original_file_path": "macros/utils/generate_series.sql", "unique_id": "macro.dbt.default__generate_series", "macro_sql": "{% macro default__generate_series(upper_bound) %}\n\n {% set n = dbt.get_powers_of_two(upper_bound) %}\n\n with p as (\n select 0 as generated_number union all select 1\n ), unioned as (\n\n select\n\n {% for i in range(n) %}\n p{{i}}.generated_number * power(2, {{i}})\n {% if not loop.last %} + {% endif %}\n {% endfor %}\n + 1\n as generated_number\n\n from\n\n {% for i in range(n) %}\n p as p{{i}}\n {% if not loop.last %} cross join {% endif %}\n {% endfor %}\n\n )\n\n select *\n from unioned\n where generated_number <= {{upper_bound}}\n order by generated_number\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.870784, "supported_languages": null}, "macro.dbt.length": {"name": "length", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/length.sql", "original_file_path": "macros/utils/length.sql", "unique_id": "macro.dbt.length", "macro_sql": "{% macro length(expression) -%}\n {{ return(adapter.dispatch('length', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__length"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.871049, "supported_languages": null}, "macro.dbt.default__length": {"name": "default__length", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/length.sql", "original_file_path": "macros/utils/length.sql", "unique_id": "macro.dbt.default__length", "macro_sql": "{% macro default__length(expression) %}\n\n length(\n {{ expression }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.87116, "supported_languages": null}, "macro.dbt.dateadd": {"name": "dateadd", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt.dateadd", "macro_sql": "{% macro dateadd(datepart, interval, from_date_or_timestamp) %}\n {{ return(adapter.dispatch('dateadd', 'dbt')(datepart, interval, from_date_or_timestamp)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.871509, "supported_languages": null}, "macro.dbt.default__dateadd": {"name": "default__dateadd", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/dateadd.sql", "original_file_path": "macros/utils/dateadd.sql", "unique_id": "macro.dbt.default__dateadd", "macro_sql": "{% macro default__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n dateadd(\n {{ datepart }},\n {{ interval }},\n {{ from_date_or_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8716831, "supported_languages": null}, "macro.dbt.intersect": {"name": "intersect", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/intersect.sql", "original_file_path": "macros/utils/intersect.sql", "unique_id": "macro.dbt.intersect", "macro_sql": "{% macro intersect() %}\n {{ return(adapter.dispatch('intersect', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__intersect"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.871914, "supported_languages": null}, "macro.dbt.default__intersect": {"name": "default__intersect", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/intersect.sql", "original_file_path": "macros/utils/intersect.sql", "unique_id": "macro.dbt.default__intersect", "macro_sql": "{% macro default__intersect() %}\n\n intersect\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8720589, "supported_languages": null}, "macro.dbt.escape_single_quotes": {"name": "escape_single_quotes", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/escape_single_quotes.sql", "original_file_path": "macros/utils/escape_single_quotes.sql", "unique_id": "macro.dbt.escape_single_quotes", "macro_sql": "{% macro escape_single_quotes(expression) %}\n {{ return(adapter.dispatch('escape_single_quotes', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__escape_single_quotes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.872328, "supported_languages": null}, "macro.dbt.default__escape_single_quotes": {"name": "default__escape_single_quotes", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/escape_single_quotes.sql", "original_file_path": "macros/utils/escape_single_quotes.sql", "unique_id": "macro.dbt.default__escape_single_quotes", "macro_sql": "{% macro default__escape_single_quotes(expression) -%}\n{{ expression | replace(\"'\",\"''\") }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8724759, "supported_languages": null}, "macro.dbt.right": {"name": "right", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/right.sql", "original_file_path": "macros/utils/right.sql", "unique_id": "macro.dbt.right", "macro_sql": "{% macro right(string_text, length_expression) -%}\n {{ return(adapter.dispatch('right', 'dbt') (string_text, length_expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__right"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8727732, "supported_languages": null}, "macro.dbt.default__right": {"name": "default__right", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/right.sql", "original_file_path": "macros/utils/right.sql", "unique_id": "macro.dbt.default__right", "macro_sql": "{% macro default__right(string_text, length_expression) %}\n\n right(\n {{ string_text }},\n {{ length_expression }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.872913, "supported_languages": null}, "macro.dbt.listagg": {"name": "listagg", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt.listagg", "macro_sql": "{% macro listagg(measure, delimiter_text=\"','\", order_by_clause=none, limit_num=none) -%}\n {{ return(adapter.dispatch('listagg', 'dbt') (measure, delimiter_text, order_by_clause, limit_num)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__listagg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8735821, "supported_languages": null}, "macro.dbt.default__listagg": {"name": "default__listagg", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/listagg.sql", "original_file_path": "macros/utils/listagg.sql", "unique_id": "macro.dbt.default__listagg", "macro_sql": "{% macro default__listagg(measure, delimiter_text, order_by_clause, limit_num) -%}\n\n {% if limit_num -%}\n array_to_string(\n array_slice(\n array_agg(\n {{ measure }}\n ){% if order_by_clause -%}\n within group ({{ order_by_clause }})\n {%- endif %}\n ,0\n ,{{ limit_num }}\n ),\n {{ delimiter_text }}\n )\n {%- else %}\n listagg(\n {{ measure }},\n {{ delimiter_text }}\n )\n {% if order_by_clause -%}\n within group ({{ order_by_clause }})\n {%- endif %}\n {%- endif %}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8740008, "supported_languages": null}, "macro.dbt.datediff": {"name": "datediff", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt.datediff", "macro_sql": "{% macro datediff(first_date, second_date, datepart) %}\n {{ return(adapter.dispatch('datediff', 'dbt')(first_date, second_date, datepart)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.874356, "supported_languages": null}, "macro.dbt.default__datediff": {"name": "default__datediff", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/datediff.sql", "original_file_path": "macros/utils/datediff.sql", "unique_id": "macro.dbt.default__datediff", "macro_sql": "{% macro default__datediff(first_date, second_date, datepart) -%}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8745291, "supported_languages": null}, "macro.dbt.safe_cast": {"name": "safe_cast", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/safe_cast.sql", "original_file_path": "macros/utils/safe_cast.sql", "unique_id": "macro.dbt.safe_cast", "macro_sql": "{% macro safe_cast(field, type) %}\n {{ return(adapter.dispatch('safe_cast', 'dbt') (field, type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__safe_cast"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.87483, "supported_languages": null}, "macro.dbt.default__safe_cast": {"name": "default__safe_cast", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/safe_cast.sql", "original_file_path": "macros/utils/safe_cast.sql", "unique_id": "macro.dbt.default__safe_cast", "macro_sql": "{% macro default__safe_cast(field, type) %}\n {# most databases don't support this function yet\n so we just need to use cast #}\n cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.874974, "supported_languages": null}, "macro.dbt.hash": {"name": "hash", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/hash.sql", "original_file_path": "macros/utils/hash.sql", "unique_id": "macro.dbt.hash", "macro_sql": "{% macro hash(field) -%}\n {{ return(adapter.dispatch('hash', 'dbt') (field)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__hash"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8752398, "supported_languages": null}, "macro.dbt.default__hash": {"name": "default__hash", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/hash.sql", "original_file_path": "macros/utils/hash.sql", "unique_id": "macro.dbt.default__hash", "macro_sql": "{% macro default__hash(field) -%}\n md5(cast({{ field }} as {{ api.Column.translate_type('string') }}))\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.875406, "supported_languages": null}, "macro.dbt.cast_bool_to_text": {"name": "cast_bool_to_text", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/cast_bool_to_text.sql", "original_file_path": "macros/utils/cast_bool_to_text.sql", "unique_id": "macro.dbt.cast_bool_to_text", "macro_sql": "{% macro cast_bool_to_text(field) %}\n {{ adapter.dispatch('cast_bool_to_text', 'dbt') (field) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__cast_bool_to_text"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.875654, "supported_languages": null}, "macro.dbt.default__cast_bool_to_text": {"name": "default__cast_bool_to_text", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/cast_bool_to_text.sql", "original_file_path": "macros/utils/cast_bool_to_text.sql", "unique_id": "macro.dbt.default__cast_bool_to_text", "macro_sql": "{% macro default__cast_bool_to_text(field) %}\n cast({{ field }} as {{ api.Column.translate_type('string') }})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.875825, "supported_languages": null}, "macro.dbt.any_value": {"name": "any_value", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/any_value.sql", "original_file_path": "macros/utils/any_value.sql", "unique_id": "macro.dbt.any_value", "macro_sql": "{% macro any_value(expression) -%}\n {{ return(adapter.dispatch('any_value', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__any_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8760781, "supported_languages": null}, "macro.dbt.default__any_value": {"name": "default__any_value", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/any_value.sql", "original_file_path": "macros/utils/any_value.sql", "unique_id": "macro.dbt.default__any_value", "macro_sql": "{% macro default__any_value(expression) -%}\n\n any_value({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8761868, "supported_languages": null}, "macro.dbt.position": {"name": "position", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/position.sql", "original_file_path": "macros/utils/position.sql", "unique_id": "macro.dbt.position", "macro_sql": "{% macro position(substring_text, string_text) -%}\n {{ return(adapter.dispatch('position', 'dbt') (substring_text, string_text)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__position"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.87648, "supported_languages": null}, "macro.dbt.default__position": {"name": "default__position", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/position.sql", "original_file_path": "macros/utils/position.sql", "unique_id": "macro.dbt.default__position", "macro_sql": "{% macro default__position(substring_text, string_text) %}\n\n position(\n {{ substring_text }} in {{ string_text }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.876619, "supported_languages": null}, "macro.dbt.string_literal": {"name": "string_literal", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/literal.sql", "original_file_path": "macros/utils/literal.sql", "unique_id": "macro.dbt.string_literal", "macro_sql": "{%- macro string_literal(value) -%}\n {{ return(adapter.dispatch('string_literal', 'dbt') (value)) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__string_literal"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.876866, "supported_languages": null}, "macro.dbt.default__string_literal": {"name": "default__string_literal", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/literal.sql", "original_file_path": "macros/utils/literal.sql", "unique_id": "macro.dbt.default__string_literal", "macro_sql": "{% macro default__string_literal(value) -%}\n '{{ value }}'\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.877034, "supported_languages": null}, "macro.dbt.type_string": {"name": "type_string", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_string", "macro_sql": "\n\n{%- macro type_string() -%}\n {{ return(adapter.dispatch('type_string', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8779662, "supported_languages": null}, "macro.dbt.default__type_string": {"name": "default__type_string", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_string", "macro_sql": "{% macro default__type_string() %}\n {{ return(api.Column.translate_type(\"string\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.878122, "supported_languages": null}, "macro.dbt.type_timestamp": {"name": "type_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_timestamp", "macro_sql": "\n\n{%- macro type_timestamp() -%}\n {{ return(adapter.dispatch('type_timestamp', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.878291, "supported_languages": null}, "macro.dbt.default__type_timestamp": {"name": "default__type_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_timestamp", "macro_sql": "{% macro default__type_timestamp() %}\n {{ return(api.Column.translate_type(\"timestamp\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.878448, "supported_languages": null}, "macro.dbt.type_float": {"name": "type_float", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_float", "macro_sql": "\n\n{%- macro type_float() -%}\n {{ return(adapter.dispatch('type_float', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_float"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.878614, "supported_languages": null}, "macro.dbt.default__type_float": {"name": "default__type_float", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_float", "macro_sql": "{% macro default__type_float() %}\n {{ return(api.Column.translate_type(\"float\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8787708, "supported_languages": null}, "macro.dbt.type_numeric": {"name": "type_numeric", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_numeric", "macro_sql": "\n\n{%- macro type_numeric() -%}\n {{ return(adapter.dispatch('type_numeric', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_numeric"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.878939, "supported_languages": null}, "macro.dbt.default__type_numeric": {"name": "default__type_numeric", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_numeric", "macro_sql": "{% macro default__type_numeric() %}\n {{ return(api.Column.numeric_type(\"numeric\", 28, 6)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8791249, "supported_languages": null}, "macro.dbt.type_bigint": {"name": "type_bigint", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_bigint", "macro_sql": "\n\n{%- macro type_bigint() -%}\n {{ return(adapter.dispatch('type_bigint', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_bigint"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.879292, "supported_languages": null}, "macro.dbt.default__type_bigint": {"name": "default__type_bigint", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_bigint", "macro_sql": "{% macro default__type_bigint() %}\n {{ return(api.Column.translate_type(\"bigint\")) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8794482, "supported_languages": null}, "macro.dbt.type_int": {"name": "type_int", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_int", "macro_sql": "\n\n{%- macro type_int() -%}\n {{ return(adapter.dispatch('type_int', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.879612, "supported_languages": null}, "macro.dbt.default__type_int": {"name": "default__type_int", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_int", "macro_sql": "{%- macro default__type_int() -%}\n {{ return(api.Column.translate_type(\"integer\")) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.879762, "supported_languages": null}, "macro.dbt.type_boolean": {"name": "type_boolean", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.type_boolean", "macro_sql": "\n\n{%- macro type_boolean() -%}\n {{ return(adapter.dispatch('type_boolean', 'dbt')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__type_boolean"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8799229, "supported_languages": null}, "macro.dbt.default__type_boolean": {"name": "default__type_boolean", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/data_types.sql", "original_file_path": "macros/utils/data_types.sql", "unique_id": "macro.dbt.default__type_boolean", "macro_sql": "{%- macro default__type_boolean() -%}\n {{ return(api.Column.translate_type(\"boolean\")) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.880075, "supported_languages": null}, "macro.dbt.array_concat": {"name": "array_concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_concat.sql", "original_file_path": "macros/utils/array_concat.sql", "unique_id": "macro.dbt.array_concat", "macro_sql": "{% macro array_concat(array_1, array_2) -%}\n {{ return(adapter.dispatch('array_concat', 'dbt')(array_1, array_2)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__array_concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.880357, "supported_languages": null}, "macro.dbt.default__array_concat": {"name": "default__array_concat", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_concat.sql", "original_file_path": "macros/utils/array_concat.sql", "unique_id": "macro.dbt.default__array_concat", "macro_sql": "{% macro default__array_concat(array_1, array_2) -%}\n array_cat({{ array_1 }}, {{ array_2 }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.880492, "supported_languages": null}, "macro.dbt.bool_or": {"name": "bool_or", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/bool_or.sql", "original_file_path": "macros/utils/bool_or.sql", "unique_id": "macro.dbt.bool_or", "macro_sql": "{% macro bool_or(expression) -%}\n {{ return(adapter.dispatch('bool_or', 'dbt') (expression)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__bool_or"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.880744, "supported_languages": null}, "macro.dbt.default__bool_or": {"name": "default__bool_or", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/bool_or.sql", "original_file_path": "macros/utils/bool_or.sql", "unique_id": "macro.dbt.default__bool_or", "macro_sql": "{% macro default__bool_or(expression) -%}\n\n bool_or({{ expression }})\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.880851, "supported_languages": null}, "macro.dbt.last_day": {"name": "last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.last_day", "macro_sql": "{% macro last_day(date, datepart) %}\n {{ return(adapter.dispatch('last_day', 'dbt') (date, datepart)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__last_day"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8811991, "supported_languages": null}, "macro.dbt.default_last_day": {"name": "default_last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.default_last_day", "macro_sql": "\n\n{%- macro default_last_day(date, datepart) -%}\n cast(\n {{dbt.dateadd('day', '-1',\n dbt.dateadd(datepart, '1', dbt.date_trunc(datepart, date))\n )}}\n as date)\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.dateadd", "macro.dbt.date_trunc"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8815339, "supported_languages": null}, "macro.dbt.default__last_day": {"name": "default__last_day", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/last_day.sql", "original_file_path": "macros/utils/last_day.sql", "unique_id": "macro.dbt.default__last_day", "macro_sql": "{% macro default__last_day(date, datepart) -%}\n {{dbt.default_last_day(date, datepart)}}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default_last_day"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.881688, "supported_languages": null}, "macro.dbt.split_part": {"name": "split_part", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt.split_part", "macro_sql": "{% macro split_part(string_text, delimiter_text, part_number) %}\n {{ return(adapter.dispatch('split_part', 'dbt') (string_text, delimiter_text, part_number)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__split_part"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.882236, "supported_languages": null}, "macro.dbt.default__split_part": {"name": "default__split_part", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt.default__split_part", "macro_sql": "{% macro default__split_part(string_text, delimiter_text, part_number) %}\n\n split_part(\n {{ string_text }},\n {{ delimiter_text }},\n {{ part_number }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8824089, "supported_languages": null}, "macro.dbt._split_part_negative": {"name": "_split_part_negative", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/split_part.sql", "original_file_path": "macros/utils/split_part.sql", "unique_id": "macro.dbt._split_part_negative", "macro_sql": "{% macro _split_part_negative(string_text, delimiter_text, part_number) %}\n\n split_part(\n {{ string_text }},\n {{ delimiter_text }},\n length({{ string_text }})\n - length(\n replace({{ string_text }}, {{ delimiter_text }}, '')\n ) + 2 + {{ part_number }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.882642, "supported_languages": null}, "macro.dbt.date_trunc": {"name": "date_trunc", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_trunc.sql", "original_file_path": "macros/utils/date_trunc.sql", "unique_id": "macro.dbt.date_trunc", "macro_sql": "{% macro date_trunc(datepart, date) -%}\n {{ return(adapter.dispatch('date_trunc', 'dbt') (datepart, date)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__date_trunc"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8829272, "supported_languages": null}, "macro.dbt.default__date_trunc": {"name": "default__date_trunc", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/date_trunc.sql", "original_file_path": "macros/utils/date_trunc.sql", "unique_id": "macro.dbt.default__date_trunc", "macro_sql": "{% macro default__date_trunc(datepart, date) -%}\n date_trunc('{{datepart}}', {{date}})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.883059, "supported_languages": null}, "macro.dbt.array_construct": {"name": "array_construct", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_construct.sql", "original_file_path": "macros/utils/array_construct.sql", "unique_id": "macro.dbt.array_construct", "macro_sql": "{% macro array_construct(inputs=[], data_type=api.Column.translate_type('integer')) -%}\n {{ return(adapter.dispatch('array_construct', 'dbt')(inputs, data_type)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__array_construct"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.883442, "supported_languages": null}, "macro.dbt.default__array_construct": {"name": "default__array_construct", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_construct.sql", "original_file_path": "macros/utils/array_construct.sql", "unique_id": "macro.dbt.default__array_construct", "macro_sql": "{% macro default__array_construct(inputs, data_type) -%}\n {% if inputs|length > 0 %}\n array[ {{ inputs|join(' , ') }} ]\n {% else %}\n array[]::{{data_type}}[]\n {% endif %}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.883693, "supported_languages": null}, "macro.dbt.array_append": {"name": "array_append", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_append.sql", "original_file_path": "macros/utils/array_append.sql", "unique_id": "macro.dbt.array_append", "macro_sql": "{% macro array_append(array, new_element) -%}\n {{ return(adapter.dispatch('array_append', 'dbt')(array, new_element)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__array_append"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8839822, "supported_languages": null}, "macro.dbt.default__array_append": {"name": "default__array_append", "resource_type": "macro", "package_name": "dbt", "path": "macros/utils/array_append.sql", "original_file_path": "macros/utils/array_append.sql", "unique_id": "macro.dbt.default__array_append", "macro_sql": "{% macro default__array_append(array, new_element) -%}\n array_append({{ array }}, {{ new_element }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.884118, "supported_languages": null}, "macro.dbt.create_schema": {"name": "create_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.create_schema", "macro_sql": "{% macro create_schema(relation) -%}\n {{ adapter.dispatch('create_schema', 'dbt')(relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_schema"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.884493, "supported_languages": null}, "macro.dbt.default__create_schema": {"name": "default__create_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.default__create_schema", "macro_sql": "{% macro default__create_schema(relation) -%}\n {%- call statement('create_schema') -%}\n create schema if not exists {{ relation.without_identifier() }}\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.884685, "supported_languages": null}, "macro.dbt.drop_schema": {"name": "drop_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.drop_schema", "macro_sql": "{% macro drop_schema(relation) -%}\n {{ adapter.dispatch('drop_schema', 'dbt')(relation) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__drop_schema"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.884853, "supported_languages": null}, "macro.dbt.default__drop_schema": {"name": "default__drop_schema", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/schema.sql", "original_file_path": "macros/adapters/schema.sql", "unique_id": "macro.dbt.default__drop_schema", "macro_sql": "{% macro default__drop_schema(relation) -%}\n {%- call statement('drop_schema') -%}\n drop schema if exists {{ relation.without_identifier() }} cascade\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.885041, "supported_languages": null}, "macro.dbt.current_timestamp": {"name": "current_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp", "macro_sql": "{%- macro current_timestamp() -%}\n {{ adapter.dispatch('current_timestamp', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.885529, "supported_languages": null}, "macro.dbt.default__current_timestamp": {"name": "default__current_timestamp", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp", "macro_sql": "{% macro default__current_timestamp() -%}\n {{ exceptions.raise_not_implemented(\n 'current_timestamp macro not implemented for adapter ' + adapter.type()) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8856819, "supported_languages": null}, "macro.dbt.snapshot_get_time": {"name": "snapshot_get_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.snapshot_get_time", "macro_sql": "\n\n{%- macro snapshot_get_time() -%}\n {{ adapter.dispatch('snapshot_get_time', 'dbt')() }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt.default__snapshot_get_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.885835, "supported_languages": null}, "macro.dbt.default__snapshot_get_time": {"name": "default__snapshot_get_time", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__snapshot_get_time", "macro_sql": "{% macro default__snapshot_get_time() %}\n {{ current_timestamp() }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.885942, "supported_languages": null}, "macro.dbt.current_timestamp_backcompat": {"name": "current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp_backcompat", "macro_sql": "{% macro current_timestamp_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__current_timestamp_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.886112, "supported_languages": null}, "macro.dbt.default__current_timestamp_backcompat": {"name": "default__current_timestamp_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp_backcompat", "macro_sql": "{% macro default__current_timestamp_backcompat() %}\n current_timestamp::timestamp\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8861902, "supported_languages": null}, "macro.dbt.current_timestamp_in_utc_backcompat": {"name": "current_timestamp_in_utc_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.current_timestamp_in_utc_backcompat", "macro_sql": "{% macro current_timestamp_in_utc_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_in_utc_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__current_timestamp_in_utc_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.886422, "supported_languages": null}, "macro.dbt.default__current_timestamp_in_utc_backcompat": {"name": "default__current_timestamp_in_utc_backcompat", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/timestamps.sql", "original_file_path": "macros/adapters/timestamps.sql", "unique_id": "macro.dbt.default__current_timestamp_in_utc_backcompat", "macro_sql": "{% macro default__current_timestamp_in_utc_backcompat() %}\n {{ return(adapter.dispatch('current_timestamp_backcompat', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.current_timestamp_backcompat", "macro.dbt_bigquery.bigquery__current_timestamp_backcompat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.886594, "supported_languages": null}, "macro.dbt.get_create_index_sql": {"name": "get_create_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.get_create_index_sql", "macro_sql": "{% macro get_create_index_sql(relation, index_dict) -%}\n {{ return(adapter.dispatch('get_create_index_sql', 'dbt')(relation, index_dict)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_create_index_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.887446, "supported_languages": null}, "macro.dbt.default__get_create_index_sql": {"name": "default__get_create_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__get_create_index_sql", "macro_sql": "{% macro default__get_create_index_sql(relation, index_dict) -%}\n {% do return(None) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.887585, "supported_languages": null}, "macro.dbt.create_indexes": {"name": "create_indexes", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.create_indexes", "macro_sql": "{% macro create_indexes(relation) -%}\n {{ adapter.dispatch('create_indexes', 'dbt')(relation) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__create_indexes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8877509, "supported_languages": null}, "macro.dbt.default__create_indexes": {"name": "default__create_indexes", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__create_indexes", "macro_sql": "{% macro default__create_indexes(relation) -%}\n {%- set _indexes = config.get('indexes', default=[]) -%}\n\n {% for _index_dict in _indexes %}\n {% set create_index_sql = get_create_index_sql(relation, _index_dict) %}\n {% if create_index_sql %}\n {% do run_query(create_index_sql) %}\n {% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_create_index_sql", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.888166, "supported_languages": null}, "macro.dbt.get_drop_index_sql": {"name": "get_drop_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.get_drop_index_sql", "macro_sql": "{% macro get_drop_index_sql(relation, index_name) -%}\n {{ adapter.dispatch('get_drop_index_sql', 'dbt')(relation, index_name) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_drop_index_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8883588, "supported_languages": null}, "macro.dbt.default__get_drop_index_sql": {"name": "default__get_drop_index_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__get_drop_index_sql", "macro_sql": "{% macro default__get_drop_index_sql(relation, index_name) -%}\n {{ exceptions.raise_compiler_error(\"`get_drop_index_sql has not been implemented for this adapter.\") }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8884978, "supported_languages": null}, "macro.dbt.get_show_indexes_sql": {"name": "get_show_indexes_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.get_show_indexes_sql", "macro_sql": "{% macro get_show_indexes_sql(relation) -%}\n {{ adapter.dispatch('get_show_indexes_sql', 'dbt')(relation) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_show_indexes_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8886569, "supported_languages": null}, "macro.dbt.default__get_show_indexes_sql": {"name": "default__get_show_indexes_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/indexes.sql", "original_file_path": "macros/adapters/indexes.sql", "unique_id": "macro.dbt.default__get_show_indexes_sql", "macro_sql": "{% macro default__get_show_indexes_sql(relation) -%}\n {{ exceptions.raise_compiler_error(\"`get_show_indexes_sql has not been implemented for this adapter.\") }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.888791, "supported_languages": null}, "macro.dbt.make_intermediate_relation": {"name": "make_intermediate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_intermediate_relation", "macro_sql": "{% macro make_intermediate_relation(base_relation, suffix='__dbt_tmp') %}\n {{ return(adapter.dispatch('make_intermediate_relation', 'dbt')(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__make_intermediate_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8908448, "supported_languages": null}, "macro.dbt.default__make_intermediate_relation": {"name": "default__make_intermediate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_intermediate_relation", "macro_sql": "{% macro default__make_intermediate_relation(base_relation, suffix) %}\n {{ return(default__make_temp_relation(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__make_temp_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.891017, "supported_languages": null}, "macro.dbt.make_temp_relation": {"name": "make_temp_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_temp_relation", "macro_sql": "{% macro make_temp_relation(base_relation, suffix='__dbt_tmp') %}\n {{ return(adapter.dispatch('make_temp_relation', 'dbt')(base_relation, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__make_temp_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.891246, "supported_languages": null}, "macro.dbt.default__make_temp_relation": {"name": "default__make_temp_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_temp_relation", "macro_sql": "{% macro default__make_temp_relation(base_relation, suffix) %}\n {%- set temp_identifier = base_relation.identifier ~ suffix -%}\n {%- set temp_relation = base_relation.incorporate(\n path={\"identifier\": temp_identifier}) -%}\n\n {{ return(temp_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8915489, "supported_languages": null}, "macro.dbt.make_backup_relation": {"name": "make_backup_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.make_backup_relation", "macro_sql": "{% macro make_backup_relation(base_relation, backup_relation_type, suffix='__dbt_backup') %}\n {{ return(adapter.dispatch('make_backup_relation', 'dbt')(base_relation, backup_relation_type, suffix)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__make_backup_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8918028, "supported_languages": null}, "macro.dbt.default__make_backup_relation": {"name": "default__make_backup_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__make_backup_relation", "macro_sql": "{% macro default__make_backup_relation(base_relation, backup_relation_type, suffix) %}\n {%- set backup_identifier = base_relation.identifier ~ suffix -%}\n {%- set backup_relation = base_relation.incorporate(\n path={\"identifier\": backup_identifier},\n type=backup_relation_type\n ) -%}\n {{ return(backup_relation) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8921359, "supported_languages": null}, "macro.dbt.truncate_relation": {"name": "truncate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.truncate_relation", "macro_sql": "{% macro truncate_relation(relation) -%}\n {{ return(adapter.dispatch('truncate_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__truncate_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.892322, "supported_languages": null}, "macro.dbt.default__truncate_relation": {"name": "default__truncate_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__truncate_relation", "macro_sql": "{% macro default__truncate_relation(relation) -%}\n {% call statement('truncate_relation') -%}\n truncate table {{ relation }}\n {%- endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8924851, "supported_languages": null}, "macro.dbt.get_or_create_relation": {"name": "get_or_create_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.get_or_create_relation", "macro_sql": "{% macro get_or_create_relation(database, schema, identifier, type) -%}\n {{ return(adapter.dispatch('get_or_create_relation', 'dbt')(database, schema, identifier, type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_or_create_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.892747, "supported_languages": null}, "macro.dbt.default__get_or_create_relation": {"name": "default__get_or_create_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.default__get_or_create_relation", "macro_sql": "{% macro default__get_or_create_relation(database, schema, identifier, type) %}\n {%- set target_relation = adapter.get_relation(database=database, schema=schema, identifier=identifier) %}\n\n {% if target_relation %}\n {% do return([true, target_relation]) %}\n {% endif %}\n\n {%- set new_relation = api.Relation.create(\n database=database,\n schema=schema,\n identifier=identifier,\n type=type\n ) -%}\n {% do return([false, new_relation]) %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.893389, "supported_languages": null}, "macro.dbt.load_cached_relation": {"name": "load_cached_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.load_cached_relation", "macro_sql": "{% macro load_cached_relation(relation) %}\n {% do return(adapter.get_relation(\n database=relation.database,\n schema=relation.schema,\n identifier=relation.identifier\n )) -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.893636, "supported_languages": null}, "macro.dbt.load_relation": {"name": "load_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/relation.sql", "original_file_path": "macros/adapters/relation.sql", "unique_id": "macro.dbt.load_relation", "macro_sql": "{% macro load_relation(relation) %}\n {{ return(load_cached_relation(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.load_cached_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8937879, "supported_languages": null}, "macro.dbt.collect_freshness": {"name": "collect_freshness", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/freshness.sql", "original_file_path": "macros/adapters/freshness.sql", "unique_id": "macro.dbt.collect_freshness", "macro_sql": "{% macro collect_freshness(source, loaded_at_field, filter) %}\n {{ return(adapter.dispatch('collect_freshness', 'dbt')(source, loaded_at_field, filter))}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__collect_freshness"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.894218, "supported_languages": null}, "macro.dbt.default__collect_freshness": {"name": "default__collect_freshness", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/freshness.sql", "original_file_path": "macros/adapters/freshness.sql", "unique_id": "macro.dbt.default__collect_freshness", "macro_sql": "{% macro default__collect_freshness(source, loaded_at_field, filter) %}\n {% call statement('collect_freshness', fetch_result=True, auto_begin=False) -%}\n select\n max({{ loaded_at_field }}) as max_loaded_at,\n {{ current_timestamp() }} as snapshotted_at\n from {{ source }}\n {% if filter %}\n where {{ filter }}\n {% endif %}\n {% endcall %}\n {{ return(load_result('collect_freshness')) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.894644, "supported_languages": null}, "macro.dbt.validate_sql": {"name": "validate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/validate_sql.sql", "original_file_path": "macros/adapters/validate_sql.sql", "unique_id": "macro.dbt.validate_sql", "macro_sql": "{% macro validate_sql(sql) -%}\n {{ return(adapter.dispatch('validate_sql', 'dbt')(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__validate_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.894937, "supported_languages": null}, "macro.dbt.default__validate_sql": {"name": "default__validate_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/validate_sql.sql", "original_file_path": "macros/adapters/validate_sql.sql", "unique_id": "macro.dbt.default__validate_sql", "macro_sql": "{% macro default__validate_sql(sql) -%}\n {% call statement('validate_sql') -%}\n explain {{ sql }}\n {% endcall %}\n {{ return(load_result('validate_sql')) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.89517, "supported_languages": null}, "macro.dbt.copy_grants": {"name": "copy_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.copy_grants", "macro_sql": "{% macro copy_grants() %}\n {{ return(adapter.dispatch('copy_grants', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__copy_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.896918, "supported_languages": null}, "macro.dbt.default__copy_grants": {"name": "default__copy_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__copy_grants", "macro_sql": "{% macro default__copy_grants() %}\n {{ return(True) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8970408, "supported_languages": null}, "macro.dbt.support_multiple_grantees_per_dcl_statement": {"name": "support_multiple_grantees_per_dcl_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.support_multiple_grantees_per_dcl_statement", "macro_sql": "{% macro support_multiple_grantees_per_dcl_statement() %}\n {{ return(adapter.dispatch('support_multiple_grantees_per_dcl_statement', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__support_multiple_grantees_per_dcl_statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.897218, "supported_languages": null}, "macro.dbt.default__support_multiple_grantees_per_dcl_statement": {"name": "default__support_multiple_grantees_per_dcl_statement", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__support_multiple_grantees_per_dcl_statement", "macro_sql": "\n\n{%- macro default__support_multiple_grantees_per_dcl_statement() -%}\n {{ return(True) }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.897333, "supported_languages": null}, "macro.dbt.should_revoke": {"name": "should_revoke", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.should_revoke", "macro_sql": "{% macro should_revoke(existing_relation, full_refresh_mode=True) %}\n\n {% if not existing_relation %}\n {#-- The table doesn't already exist, so no grants to copy over --#}\n {{ return(False) }}\n {% elif full_refresh_mode %}\n {#-- The object is being REPLACED -- whether grants are copied over depends on the value of user config --#}\n {{ return(copy_grants()) }}\n {% else %}\n {#-- The table is being merged/upserted/inserted -- grants will be carried over --#}\n {{ return(True) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.copy_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.897686, "supported_languages": null}, "macro.dbt.get_show_grant_sql": {"name": "get_show_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_show_grant_sql", "macro_sql": "{% macro get_show_grant_sql(relation) %}\n {{ return(adapter.dispatch(\"get_show_grant_sql\", \"dbt\")(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_show_grant_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.897881, "supported_languages": null}, "macro.dbt.default__get_show_grant_sql": {"name": "default__get_show_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_show_grant_sql", "macro_sql": "{% macro default__get_show_grant_sql(relation) %}\n show grants on {{ relation }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.897989, "supported_languages": null}, "macro.dbt.get_grant_sql": {"name": "get_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_grant_sql", "macro_sql": "{% macro get_grant_sql(relation, privilege, grantees) %}\n {{ return(adapter.dispatch('get_grant_sql', 'dbt')(relation, privilege, grantees)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_grant_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8982248, "supported_languages": null}, "macro.dbt.default__get_grant_sql": {"name": "default__get_grant_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_grant_sql", "macro_sql": "\n\n{%- macro default__get_grant_sql(relation, privilege, grantees) -%}\n grant {{ privilege }} on {{ relation }} to {{ grantees | join(', ') }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.898423, "supported_languages": null}, "macro.dbt.get_revoke_sql": {"name": "get_revoke_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_revoke_sql", "macro_sql": "{% macro get_revoke_sql(relation, privilege, grantees) %}\n {{ return(adapter.dispatch('get_revoke_sql', 'dbt')(relation, privilege, grantees)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_revoke_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8986611, "supported_languages": null}, "macro.dbt.default__get_revoke_sql": {"name": "default__get_revoke_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_revoke_sql", "macro_sql": "\n\n{%- macro default__get_revoke_sql(relation, privilege, grantees) -%}\n revoke {{ privilege }} on {{ relation }} from {{ grantees | join(', ') }}\n{%- endmacro -%}\n\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8988538, "supported_languages": null}, "macro.dbt.get_dcl_statement_list": {"name": "get_dcl_statement_list", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.get_dcl_statement_list", "macro_sql": "{% macro get_dcl_statement_list(relation, grant_config, get_dcl_macro) %}\n {{ return(adapter.dispatch('get_dcl_statement_list', 'dbt')(relation, grant_config, get_dcl_macro)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_dcl_statement_list"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.8990872, "supported_languages": null}, "macro.dbt.default__get_dcl_statement_list": {"name": "default__get_dcl_statement_list", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__get_dcl_statement_list", "macro_sql": "\n\n{%- macro default__get_dcl_statement_list(relation, grant_config, get_dcl_macro) -%}\n {#\n -- Unpack grant_config into specific privileges and the set of users who need them granted/revoked.\n -- Depending on whether this database supports multiple grantees per statement, pass in the list of\n -- all grantees per privilege, or (if not) template one statement per privilege-grantee pair.\n -- `get_dcl_macro` will be either `get_grant_sql` or `get_revoke_sql`\n #}\n {%- set dcl_statements = [] -%}\n {%- for privilege, grantees in grant_config.items() %}\n {%- if support_multiple_grantees_per_dcl_statement() and grantees -%}\n {%- set dcl = get_dcl_macro(relation, privilege, grantees) -%}\n {%- do dcl_statements.append(dcl) -%}\n {%- else -%}\n {%- for grantee in grantees -%}\n {% set dcl = get_dcl_macro(relation, privilege, [grantee]) %}\n {%- do dcl_statements.append(dcl) -%}\n {% endfor -%}\n {%- endif -%}\n {%- endfor -%}\n {{ return(dcl_statements) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.support_multiple_grantees_per_dcl_statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.899849, "supported_languages": null}, "macro.dbt.call_dcl_statements": {"name": "call_dcl_statements", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.call_dcl_statements", "macro_sql": "{% macro call_dcl_statements(dcl_statement_list) %}\n {{ return(adapter.dispatch(\"call_dcl_statements\", \"dbt\")(dcl_statement_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__call_dcl_statements"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9000409, "supported_languages": null}, "macro.dbt.default__call_dcl_statements": {"name": "default__call_dcl_statements", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__call_dcl_statements", "macro_sql": "{% macro default__call_dcl_statements(dcl_statement_list) %}\n {#\n -- By default, supply all grant + revoke statements in a single semicolon-separated block,\n -- so that they're all processed together.\n\n -- Some databases do not support this. Those adapters will need to override this macro\n -- to run each statement individually.\n #}\n {% call statement('grants') %}\n {% for dcl_statement in dcl_statement_list %}\n {{ dcl_statement }};\n {% endfor %}\n {% endcall %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9002938, "supported_languages": null}, "macro.dbt.apply_grants": {"name": "apply_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.apply_grants", "macro_sql": "{% macro apply_grants(relation, grant_config, should_revoke) %}\n {{ return(adapter.dispatch(\"apply_grants\", \"dbt\")(relation, grant_config, should_revoke)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__apply_grants"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.900533, "supported_languages": null}, "macro.dbt.default__apply_grants": {"name": "default__apply_grants", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/apply_grants.sql", "original_file_path": "macros/adapters/apply_grants.sql", "unique_id": "macro.dbt.default__apply_grants", "macro_sql": "{% macro default__apply_grants(relation, grant_config, should_revoke=True) %}\n {#-- If grant_config is {} or None, this is a no-op --#}\n {% if grant_config %}\n {% if should_revoke %}\n {#-- We think previous grants may have carried over --#}\n {#-- Show current grants and calculate diffs --#}\n {% set current_grants_table = run_query(get_show_grant_sql(relation)) %}\n {% set current_grants_dict = adapter.standardize_grants_dict(current_grants_table) %}\n {% set needs_granting = diff_of_two_dicts(grant_config, current_grants_dict) %}\n {% set needs_revoking = diff_of_two_dicts(current_grants_dict, grant_config) %}\n {% if not (needs_granting or needs_revoking) %}\n {{ log('On ' ~ relation ~': All grants are in place, no revocation or granting needed.')}}\n {% endif %}\n {% else %}\n {#-- We don't think there's any chance of previous grants having carried over. --#}\n {#-- Jump straight to granting what the user has configured. --#}\n {% set needs_revoking = {} %}\n {% set needs_granting = grant_config %}\n {% endif %}\n {% if needs_granting or needs_revoking %}\n {% set revoke_statement_list = get_dcl_statement_list(relation, needs_revoking, get_revoke_sql) %}\n {% set grant_statement_list = get_dcl_statement_list(relation, needs_granting, get_grant_sql) %}\n {% set dcl_statement_list = revoke_statement_list + grant_statement_list %}\n {% if dcl_statement_list %}\n {{ call_dcl_statements(dcl_statement_list) }}\n {% endif %}\n {% endif %}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query", "macro.dbt.get_show_grant_sql", "macro.dbt.get_dcl_statement_list", "macro.dbt.call_dcl_statements"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.901719, "supported_languages": null}, "macro.dbt.get_show_sql": {"name": "get_show_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/show.sql", "original_file_path": "macros/adapters/show.sql", "unique_id": "macro.dbt.get_show_sql", "macro_sql": "{% macro get_show_sql(compiled_code, sql_header, limit) -%}\n {%- if sql_header -%}\n {{ sql_header }}\n {%- endif -%}\n {%- if limit is not none -%}\n {{ get_limit_subquery_sql(compiled_code, limit) }}\n {%- else -%}\n {{ compiled_code }}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_limit_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.902266, "supported_languages": null}, "macro.dbt.get_limit_subquery_sql": {"name": "get_limit_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/show.sql", "original_file_path": "macros/adapters/show.sql", "unique_id": "macro.dbt.get_limit_subquery_sql", "macro_sql": "{% macro get_limit_subquery_sql(sql, limit) %}\n {{ adapter.dispatch('get_limit_subquery_sql', 'dbt')(sql, limit) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_limit_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.902463, "supported_languages": null}, "macro.dbt.default__get_limit_subquery_sql": {"name": "default__get_limit_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/show.sql", "original_file_path": "macros/adapters/show.sql", "unique_id": "macro.dbt.default__get_limit_subquery_sql", "macro_sql": "{% macro default__get_limit_subquery_sql(sql, limit) %}\n select *\n from (\n {{ sql }}\n ) as model_limit_subq\n limit {{ limit }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9026072, "supported_languages": null}, "macro.dbt.alter_column_comment": {"name": "alter_column_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.alter_column_comment", "macro_sql": "{% macro alter_column_comment(relation, column_dict) -%}\n {{ return(adapter.dispatch('alter_column_comment', 'dbt')(relation, column_dict)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__alter_column_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9032981, "supported_languages": null}, "macro.dbt.default__alter_column_comment": {"name": "default__alter_column_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__alter_column_comment", "macro_sql": "{% macro default__alter_column_comment(relation, column_dict) -%}\n {{ exceptions.raise_not_implemented(\n 'alter_column_comment macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.903473, "supported_languages": null}, "macro.dbt.alter_relation_comment": {"name": "alter_relation_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.alter_relation_comment", "macro_sql": "{% macro alter_relation_comment(relation, relation_comment) -%}\n {{ return(adapter.dispatch('alter_relation_comment', 'dbt')(relation, relation_comment)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__alter_relation_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.903687, "supported_languages": null}, "macro.dbt.default__alter_relation_comment": {"name": "default__alter_relation_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__alter_relation_comment", "macro_sql": "{% macro default__alter_relation_comment(relation, relation_comment) -%}\n {{ exceptions.raise_not_implemented(\n 'alter_relation_comment macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.903865, "supported_languages": null}, "macro.dbt.persist_docs": {"name": "persist_docs", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.persist_docs", "macro_sql": "{% macro persist_docs(relation, model, for_relation=true, for_columns=true) -%}\n {{ return(adapter.dispatch('persist_docs', 'dbt')(relation, model, for_relation, for_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__persist_docs"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9041438, "supported_languages": null}, "macro.dbt.default__persist_docs": {"name": "default__persist_docs", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/persist_docs.sql", "original_file_path": "macros/adapters/persist_docs.sql", "unique_id": "macro.dbt.default__persist_docs", "macro_sql": "{% macro default__persist_docs(relation, model, for_relation, for_columns) -%}\n {% if for_relation and config.persist_relation_docs() and model.description %}\n {% do run_query(alter_relation_comment(relation, model.description)) %}\n {% endif %}\n\n {% if for_columns and config.persist_column_docs() and model.columns %}\n {% do run_query(alter_column_comment(relation, model.columns)) %}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query", "macro.dbt.alter_relation_comment", "macro.dbt.alter_column_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.904652, "supported_languages": null}, "macro.dbt.get_catalog_relations": {"name": "get_catalog_relations", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.get_catalog_relations", "macro_sql": "{% macro get_catalog_relations(information_schema, relations) -%}\n {{ return(adapter.dispatch('get_catalog_relations', 'dbt')(information_schema, relations)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_catalog_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.907551, "supported_languages": null}, "macro.dbt.default__get_catalog_relations": {"name": "default__get_catalog_relations", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__get_catalog_relations", "macro_sql": "{% macro default__get_catalog_relations(information_schema, relations) -%}\n {% set typename = adapter.type() %}\n {% set msg -%}\n get_catalog_relations not implemented for {{ typename }}\n {%- endset %}\n\n {{ exceptions.raise_compiler_error(msg) }}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9078138, "supported_languages": null}, "macro.dbt.get_catalog": {"name": "get_catalog", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.get_catalog", "macro_sql": "{% macro get_catalog(information_schema, schemas) -%}\n {{ return(adapter.dispatch('get_catalog', 'dbt')(information_schema, schemas)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_catalog"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.908025, "supported_languages": null}, "macro.dbt.default__get_catalog": {"name": "default__get_catalog", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__get_catalog", "macro_sql": "{% macro default__get_catalog(information_schema, schemas) -%}\n\n {% set typename = adapter.type() %}\n {% set msg -%}\n get_catalog not implemented for {{ typename }}\n {%- endset %}\n\n {{ exceptions.raise_compiler_error(msg) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.908288, "supported_languages": null}, "macro.dbt.information_schema_name": {"name": "information_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.information_schema_name", "macro_sql": "{% macro information_schema_name(database) %}\n {{ return(adapter.dispatch('information_schema_name', 'dbt')(database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__information_schema_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9084811, "supported_languages": null}, "macro.dbt.default__information_schema_name": {"name": "default__information_schema_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__information_schema_name", "macro_sql": "{% macro default__information_schema_name(database) -%}\n {%- if database -%}\n {{ database }}.INFORMATION_SCHEMA\n {%- else -%}\n INFORMATION_SCHEMA\n {%- endif -%}\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.908642, "supported_languages": null}, "macro.dbt.list_schemas": {"name": "list_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.list_schemas", "macro_sql": "{% macro list_schemas(database) -%}\n {{ return(adapter.dispatch('list_schemas', 'dbt')(database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__list_schemas"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.908829, "supported_languages": null}, "macro.dbt.default__list_schemas": {"name": "default__list_schemas", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__list_schemas", "macro_sql": "{% macro default__list_schemas(database) -%}\n {% set sql %}\n select distinct schema_name\n from {{ information_schema_name(database) }}.SCHEMATA\n where catalog_name ilike '{{ database }}'\n {% endset %}\n {{ return(run_query(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.information_schema_name", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.909267, "supported_languages": null}, "macro.dbt.check_schema_exists": {"name": "check_schema_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.check_schema_exists", "macro_sql": "{% macro check_schema_exists(information_schema, schema) -%}\n {{ return(adapter.dispatch('check_schema_exists', 'dbt')(information_schema, schema)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__check_schema_exists"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9094799, "supported_languages": null}, "macro.dbt.default__check_schema_exists": {"name": "default__check_schema_exists", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__check_schema_exists", "macro_sql": "{% macro default__check_schema_exists(information_schema, schema) -%}\n {% set sql -%}\n select count(*)\n from {{ information_schema.replace(information_schema_view='SCHEMATA') }}\n where catalog_name='{{ information_schema.database }}'\n and schema_name='{{ schema }}'\n {%- endset %}\n {{ return(run_query(sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.replace", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.909787, "supported_languages": null}, "macro.dbt.list_relations_without_caching": {"name": "list_relations_without_caching", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.list_relations_without_caching", "macro_sql": "{% macro list_relations_without_caching(schema_relation) %}\n {{ return(adapter.dispatch('list_relations_without_caching', 'dbt')(schema_relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__list_relations_without_caching"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.909981, "supported_languages": null}, "macro.dbt.default__list_relations_without_caching": {"name": "default__list_relations_without_caching", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__list_relations_without_caching", "macro_sql": "{% macro default__list_relations_without_caching(schema_relation) %}\n {{ exceptions.raise_not_implemented(\n 'list_relations_without_caching macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9101472, "supported_languages": null}, "macro.dbt.get_relations": {"name": "get_relations", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.get_relations", "macro_sql": "{% macro get_relations() %}\n {{ return(adapter.dispatch('get_relations', 'dbt')()) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.91032, "supported_languages": null}, "macro.dbt.default__get_relations": {"name": "default__get_relations", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__get_relations", "macro_sql": "{% macro default__get_relations() %}\n {{ exceptions.raise_not_implemented(\n 'get_relations macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.910479, "supported_languages": null}, "macro.dbt.get_relation_last_modified": {"name": "get_relation_last_modified", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.get_relation_last_modified", "macro_sql": "{% macro get_relation_last_modified(information_schema, relations) %}\n {{ return(adapter.dispatch('get_relation_last_modified', 'dbt')(information_schema, relations)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_relation_last_modified"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.910694, "supported_languages": null}, "macro.dbt.default__get_relation_last_modified": {"name": "default__get_relation_last_modified", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/metadata.sql", "original_file_path": "macros/adapters/metadata.sql", "unique_id": "macro.dbt.default__get_relation_last_modified", "macro_sql": "{% macro default__get_relation_last_modified(information_schema, relations) %}\n {{ exceptions.raise_not_implemented(\n 'get_relation_last_modified macro not implemented for adapter ' + adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9108732, "supported_languages": null}, "macro.dbt.get_columns_in_relation": {"name": "get_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_columns_in_relation", "macro_sql": "{% macro get_columns_in_relation(relation) -%}\n {{ return(adapter.dispatch('get_columns_in_relation', 'dbt')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9131908, "supported_languages": null}, "macro.dbt.default__get_columns_in_relation": {"name": "default__get_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_columns_in_relation", "macro_sql": "{% macro default__get_columns_in_relation(relation) -%}\n {{ exceptions.raise_not_implemented(\n 'get_columns_in_relation macro not implemented for adapter '+adapter.type()) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.913358, "supported_languages": null}, "macro.dbt.sql_convert_columns_in_relation": {"name": "sql_convert_columns_in_relation", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.sql_convert_columns_in_relation", "macro_sql": "{% macro sql_convert_columns_in_relation(table) -%}\n {% set columns = [] %}\n {% for row in table %}\n {% do columns.append(api.Column(*row)) %}\n {% endfor %}\n {{ return(columns) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9136739, "supported_languages": null}, "macro.dbt.get_empty_subquery_sql": {"name": "get_empty_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_empty_subquery_sql", "macro_sql": "{% macro get_empty_subquery_sql(select_sql, select_sql_header=none) -%}\n {{ return(adapter.dispatch('get_empty_subquery_sql', 'dbt')(select_sql, select_sql_header)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9139001, "supported_languages": null}, "macro.dbt.default__get_empty_subquery_sql": {"name": "default__get_empty_subquery_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_empty_subquery_sql", "macro_sql": "{% macro default__get_empty_subquery_sql(select_sql, select_sql_header=none) %}\n {%- if select_sql_header is not none -%}\n {{ select_sql_header }}\n {%- endif -%}\n select * from (\n {{ select_sql }}\n ) as __dbt_sbq\n where false\n limit 0\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.91411, "supported_languages": null}, "macro.dbt.get_empty_schema_sql": {"name": "get_empty_schema_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_empty_schema_sql", "macro_sql": "{% macro get_empty_schema_sql(columns) -%}\n {{ return(adapter.dispatch('get_empty_schema_sql', 'dbt')(columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__get_empty_schema_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.914298, "supported_languages": null}, "macro.dbt.default__get_empty_schema_sql": {"name": "default__get_empty_schema_sql", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_empty_schema_sql", "macro_sql": "{% macro default__get_empty_schema_sql(columns) %}\n {%- set col_err = [] -%}\n {%- set col_naked_numeric = [] -%}\n select\n {% for i in columns %}\n {%- set col = columns[i] -%}\n {%- if col['data_type'] is not defined -%}\n {%- do col_err.append(col['name']) -%}\n {#-- If this column's type is just 'numeric' then it is missing precision/scale, raise a warning --#}\n {%- elif col['data_type'].strip().lower() in ('numeric', 'decimal', 'number') -%}\n {%- do col_naked_numeric.append(col['name']) -%}\n {%- endif -%}\n {% set col_name = adapter.quote(col['name']) if col.get('quote') else col['name'] %}\n cast(null as {{ col['data_type'] }}) as {{ col_name }}{{ \", \" if not loop.last }}\n {%- endfor -%}\n {%- if (col_err | length) > 0 -%}\n {{ exceptions.column_type_missing(column_names=col_err) }}\n {%- elif (col_naked_numeric | length) > 0 -%}\n {{ exceptions.warn(\"Detected columns with numeric type and unspecified precision/scale, this can lead to unintended rounding: \" ~ col_naked_numeric ~ \"`\") }}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9155478, "supported_languages": null}, "macro.dbt.get_column_schema_from_query": {"name": "get_column_schema_from_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_column_schema_from_query", "macro_sql": "{% macro get_column_schema_from_query(select_sql, select_sql_header=none) -%}\n {% set columns = [] %}\n {# -- Using an 'empty subquery' here to get the same schema as the given select_sql statement, without necessitating a data scan.#}\n {% set sql = get_empty_subquery_sql(select_sql, select_sql_header) %}\n {% set column_schema = adapter.get_column_schema_from_query(sql) %}\n {{ return(column_schema) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.915918, "supported_languages": null}, "macro.dbt.get_columns_in_query": {"name": "get_columns_in_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.get_columns_in_query", "macro_sql": "{% macro get_columns_in_query(select_sql) -%}\n {{ return(adapter.dispatch('get_columns_in_query', 'dbt')(select_sql)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__get_columns_in_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.916109, "supported_languages": null}, "macro.dbt.default__get_columns_in_query": {"name": "default__get_columns_in_query", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__get_columns_in_query", "macro_sql": "{% macro default__get_columns_in_query(select_sql) %}\n {% call statement('get_columns_in_query', fetch_result=True, auto_begin=False) -%}\n {{ get_empty_subquery_sql(select_sql) }}\n {% endcall %}\n {{ return(load_result('get_columns_in_query').table.columns | map(attribute='name') | list) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.get_empty_subquery_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.916476, "supported_languages": null}, "macro.dbt.alter_column_type": {"name": "alter_column_type", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.alter_column_type", "macro_sql": "{% macro alter_column_type(relation, column_name, new_column_type) -%}\n {{ return(adapter.dispatch('alter_column_type', 'dbt')(relation, column_name, new_column_type)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__alter_column_type"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.916716, "supported_languages": null}, "macro.dbt.default__alter_column_type": {"name": "default__alter_column_type", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__alter_column_type", "macro_sql": "{% macro default__alter_column_type(relation, column_name, new_column_type) -%}\n {#\n 1. Create a new column (w/ temp name and correct type)\n 2. Copy data over to it\n 3. Drop the existing column (cascade!)\n 4. Rename the new column to existing column\n #}\n {%- set tmp_column = column_name + \"__dbt_alter\" -%}\n\n {% call statement('alter_column_type') %}\n alter table {{ relation }} add column {{ adapter.quote(tmp_column) }} {{ new_column_type }};\n update {{ relation }} set {{ adapter.quote(tmp_column) }} = {{ adapter.quote(column_name) }};\n alter table {{ relation }} drop column {{ adapter.quote(column_name) }} cascade;\n alter table {{ relation }} rename column {{ adapter.quote(tmp_column) }} to {{ adapter.quote(column_name) }}\n {% endcall %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.917336, "supported_languages": null}, "macro.dbt.alter_relation_add_remove_columns": {"name": "alter_relation_add_remove_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.alter_relation_add_remove_columns", "macro_sql": "{% macro alter_relation_add_remove_columns(relation, add_columns = none, remove_columns = none) -%}\n {{ return(adapter.dispatch('alter_relation_add_remove_columns', 'dbt')(relation, add_columns, remove_columns)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.default__alter_relation_add_remove_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9176042, "supported_languages": null}, "macro.dbt.default__alter_relation_add_remove_columns": {"name": "default__alter_relation_add_remove_columns", "resource_type": "macro", "package_name": "dbt", "path": "macros/adapters/columns.sql", "original_file_path": "macros/adapters/columns.sql", "unique_id": "macro.dbt.default__alter_relation_add_remove_columns", "macro_sql": "{% macro default__alter_relation_add_remove_columns(relation, add_columns, remove_columns) %}\n\n {% if add_columns is none %}\n {% set add_columns = [] %}\n {% endif %}\n {% if remove_columns is none %}\n {% set remove_columns = [] %}\n {% endif %}\n\n {% set sql -%}\n\n alter {{ relation.type }} {{ relation }}\n\n {% for column in add_columns %}\n add column {{ column.name }} {{ column.data_type }}{{ ',' if not loop.last }}\n {% endfor %}{{ ',' if add_columns and remove_columns }}\n\n {% for column in remove_columns %}\n drop column {{ column.name }}{{ ',' if not loop.last }}\n {% endfor %}\n\n {%- endset -%}\n\n {% do run_query(sql) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.918415, "supported_languages": null}, "macro.dbt.resolve_model_name": {"name": "resolve_model_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.resolve_model_name", "macro_sql": "{% macro resolve_model_name(input_model_name) %}\n {{ return(adapter.dispatch('resolve_model_name', 'dbt')(input_model_name)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9200761, "supported_languages": null}, "macro.dbt.default__resolve_model_name": {"name": "default__resolve_model_name", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.default__resolve_model_name", "macro_sql": "\n\n{%- macro default__resolve_model_name(input_model_name) -%}\n {{ input_model_name | string | replace('\"', '\\\"') }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9202318, "supported_languages": null}, "macro.dbt.build_ref_function": {"name": "build_ref_function", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_ref_function", "macro_sql": "{% macro build_ref_function(model) %}\n\n {%- set ref_dict = {} -%}\n {%- for _ref in model.refs -%}\n {% set _ref_args = [_ref.get('package'), _ref['name']] if _ref.get('package') else [_ref['name'],] %}\n {%- set resolved = ref(*_ref_args, v=_ref.get('version')) -%}\n {%- if _ref.get('version') -%}\n {% do _ref_args.extend([\"v\" ~ _ref['version']]) %}\n {%- endif -%}\n {%- do ref_dict.update({_ref_args | join('.'): resolve_model_name(resolved)}) -%}\n {%- endfor -%}\n\ndef ref(*args, **kwargs):\n refs = {{ ref_dict | tojson }}\n key = '.'.join(args)\n version = kwargs.get(\"v\") or kwargs.get(\"version\")\n if version:\n key += f\".v{version}\"\n dbt_load_df_function = kwargs.get(\"dbt_load_df_function\")\n return dbt_load_df_function(refs[key])\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.921107, "supported_languages": null}, "macro.dbt.build_source_function": {"name": "build_source_function", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_source_function", "macro_sql": "{% macro build_source_function(model) %}\n\n {%- set source_dict = {} -%}\n {%- for _source in model.sources -%}\n {%- set resolved = source(*_source) -%}\n {%- do source_dict.update({_source | join('.'): resolve_model_name(resolved)}) -%}\n {%- endfor -%}\n\ndef source(*args, dbt_load_df_function):\n sources = {{ source_dict | tojson }}\n key = '.'.join(args)\n return dbt_load_df_function(sources[key])\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.resolve_model_name"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.921532, "supported_languages": null}, "macro.dbt.build_config_dict": {"name": "build_config_dict", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.build_config_dict", "macro_sql": "{% macro build_config_dict(model) %}\n {%- set config_dict = {} -%}\n {% set config_dbt_used = zip(model.config.config_keys_used, model.config.config_keys_defaults) | list %}\n {%- for key, default in config_dbt_used -%}\n {# weird type testing with enum, would be much easier to write this logic in Python! #}\n {%- if key == \"language\" -%}\n {%- set value = \"python\" -%}\n {%- endif -%}\n {%- set value = model.config.get(key, default) -%}\n {%- do config_dict.update({key: value}) -%}\n {%- endfor -%}\nconfig_dict = {{ config_dict }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.922132, "supported_languages": null}, "macro.dbt.py_script_postfix": {"name": "py_script_postfix", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.py_script_postfix", "macro_sql": "{% macro py_script_postfix(model) %}\n# This part is user provided model code\n# you will need to copy the next section to run the code\n# COMMAND ----------\n# this part is dbt logic for get ref work, do not modify\n\n{{ build_ref_function(model ) }}\n{{ build_source_function(model ) }}\n{{ build_config_dict(model) }}\n\nclass config:\n def __init__(self, *args, **kwargs):\n pass\n\n @staticmethod\n def get(key, default=None):\n return config_dict.get(key, default)\n\nclass this:\n \"\"\"dbt.this() or dbt.this.identifier\"\"\"\n database = \"{{ this.database }}\"\n schema = \"{{ this.schema }}\"\n identifier = \"{{ this.identifier }}\"\n {% set this_relation_name = resolve_model_name(this) %}\n def __repr__(self):\n return '{{ this_relation_name }}'\n\n\nclass dbtObj:\n def __init__(self, load_df_function) -> None:\n self.source = lambda *args: source(*args, dbt_load_df_function=load_df_function)\n self.ref = lambda *args, **kwargs: ref(*args, **kwargs, dbt_load_df_function=load_df_function)\n self.config = config\n self.this = this()\n self.is_incremental = {{ is_incremental() }}\n\n# COMMAND ----------\n{{py_script_comment()}}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.build_ref_function", "macro.dbt.build_source_function", "macro.dbt.build_config_dict", "macro.dbt.resolve_model_name", "macro.dbt.is_incremental", "macro.dbt.py_script_comment"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9226282, "supported_languages": null}, "macro.dbt.py_script_comment": {"name": "py_script_comment", "resource_type": "macro", "package_name": "dbt", "path": "macros/python_model/python.sql", "original_file_path": "macros/python_model/python.sql", "unique_id": "macro.dbt.py_script_comment", "macro_sql": "{%macro py_script_comment()%}\n{%endmacro%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.922704, "supported_languages": null}, "macro.dbt.test_unique": {"name": "test_unique", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_unique", "macro_sql": "{% test unique(model, column_name) %}\n {% set macro = adapter.dispatch('test_unique', 'dbt') %}\n {{ macro(model, column_name) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_bigquery.bigquery__test_unique"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.923223, "supported_languages": null}, "macro.dbt.test_not_null": {"name": "test_not_null", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_not_null", "macro_sql": "{% test not_null(model, column_name) %}\n {% set macro = adapter.dispatch('test_not_null', 'dbt') %}\n {{ macro(model, column_name) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9234629, "supported_languages": null}, "macro.dbt.test_accepted_values": {"name": "test_accepted_values", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_accepted_values", "macro_sql": "{% test accepted_values(model, column_name, values, quote=True) %}\n {% set macro = adapter.dispatch('test_accepted_values', 'dbt') %}\n {{ macro(model, column_name, values, quote) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_accepted_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.923761, "supported_languages": null}, "macro.dbt.test_relationships": {"name": "test_relationships", "resource_type": "macro", "package_name": "dbt", "path": "tests/generic/builtin.sql", "original_file_path": "tests/generic/builtin.sql", "unique_id": "macro.dbt.test_relationships", "macro_sql": "{% test relationships(model, column_name, to, field) %}\n {% set macro = adapter.dispatch('test_relationships', 'dbt') %}\n {{ macro(model, column_name, to, field) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt.default__test_relationships"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.924043, "supported_languages": null}, "macro.dbt_utils.get_url_host": {"name": "get_url_host", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_host.sql", "original_file_path": "macros/web/get_url_host.sql", "unique_id": "macro.dbt_utils.get_url_host", "macro_sql": "{% macro get_url_host(field) -%}\n {{ return(adapter.dispatch('get_url_host', 'dbt_utils')(field)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_host"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9244092, "supported_languages": null}, "macro.dbt_utils.default__get_url_host": {"name": "default__get_url_host", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_host.sql", "original_file_path": "macros/web/get_url_host.sql", "unique_id": "macro.dbt_utils.default__get_url_host", "macro_sql": "{% macro default__get_url_host(field) -%}\n\n{%- set parsed =\n dbt.split_part(\n dbt.split_part(\n dbt.replace(\n dbt.replace(\n dbt.replace(field, \"'android-app://'\", \"''\"\n ), \"'http://'\", \"''\"\n ), \"'https://'\", \"''\"\n ), \"'/'\", 1\n ), \"'?'\", 1\n )\n\n-%}\n\n\n {{ dbt.safe_cast(\n parsed,\n dbt.type_string()\n )}}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.split_part", "macro.dbt.replace", "macro.dbt.safe_cast", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.924905, "supported_languages": null}, "macro.dbt_utils.get_url_path": {"name": "get_url_path", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_path.sql", "original_file_path": "macros/web/get_url_path.sql", "unique_id": "macro.dbt_utils.get_url_path", "macro_sql": "{% macro get_url_path(field) -%}\n {{ return(adapter.dispatch('get_url_path', 'dbt_utils')(field)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_path"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.925406, "supported_languages": null}, "macro.dbt_utils.default__get_url_path": {"name": "default__get_url_path", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_path.sql", "original_file_path": "macros/web/get_url_path.sql", "unique_id": "macro.dbt_utils.default__get_url_path", "macro_sql": "{% macro default__get_url_path(field) -%}\n\n {%- set stripped_url =\n dbt.replace(\n dbt.replace(field, \"'http://'\", \"''\"), \"'https://'\", \"''\")\n -%}\n\n {%- set first_slash_pos -%}\n coalesce(\n nullif({{ dbt.position(\"'/'\", stripped_url) }}, 0),\n {{ dbt.position(\"'?'\", stripped_url) }} - 1\n )\n {%- endset -%}\n\n {%- set parsed_path =\n dbt.split_part(\n dbt.right(\n stripped_url,\n dbt.length(stripped_url) ~ \"-\" ~ first_slash_pos\n ),\n \"'?'\", 1\n )\n -%}\n\n {{ dbt.safe_cast(\n parsed_path,\n dbt.type_string()\n )}}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.replace", "macro.dbt.position", "macro.dbt.split_part", "macro.dbt.right", "macro.dbt.length", "macro.dbt.safe_cast", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.926165, "supported_languages": null}, "macro.dbt_utils.get_url_parameter": {"name": "get_url_parameter", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_parameter.sql", "original_file_path": "macros/web/get_url_parameter.sql", "unique_id": "macro.dbt_utils.get_url_parameter", "macro_sql": "{% macro get_url_parameter(field, url_parameter) -%}\n {{ return(adapter.dispatch('get_url_parameter', 'dbt_utils')(field, url_parameter)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_url_parameter"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9264908, "supported_languages": null}, "macro.dbt_utils.default__get_url_parameter": {"name": "default__get_url_parameter", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/web/get_url_parameter.sql", "original_file_path": "macros/web/get_url_parameter.sql", "unique_id": "macro.dbt_utils.default__get_url_parameter", "macro_sql": "{% macro default__get_url_parameter(field, url_parameter) -%}\n\n{%- set formatted_url_parameter = \"'\" + url_parameter + \"='\" -%}\n\n{%- set split = dbt.split_part(dbt.split_part(field, formatted_url_parameter, 2), \"'&'\", 1) -%}\n\nnullif({{ split }},'')\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.split_part"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.926829, "supported_languages": null}, "macro.dbt_utils.test_fewer_rows_than": {"name": "test_fewer_rows_than", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/fewer_rows_than.sql", "original_file_path": "macros/generic_tests/fewer_rows_than.sql", "unique_id": "macro.dbt_utils.test_fewer_rows_than", "macro_sql": "{% test fewer_rows_than(model, compare_model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_fewer_rows_than', 'dbt_utils')(model, compare_model, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_fewer_rows_than"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9279292, "supported_languages": null}, "macro.dbt_utils.default__test_fewer_rows_than": {"name": "default__test_fewer_rows_than", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/fewer_rows_than.sql", "original_file_path": "macros/generic_tests/fewer_rows_than.sql", "unique_id": "macro.dbt_utils.default__test_fewer_rows_than", "macro_sql": "{% macro default__test_fewer_rows_than(model, compare_model, group_by_columns) %}\n\n{{ config(fail_calc = 'sum(coalesce(row_count_delta, 0))') }}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set join_gb_cols %}\n {% for c in group_by_columns %}\n and a.{{c}} = b.{{c}}\n {% endfor %}\n {% endset %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n{#-- We must add a fake join key in case additional grouping variables are not provided --#}\n{#-- Redshift does not allow for dynamically created join conditions (e.g. full join on 1 = 1 --#}\n{#-- The same logic is used in equal_rowcount. In case of changes, maintain consistent logic --#}\n{% set group_by_columns = ['id_dbtutils_test_fewer_rows_than'] + group_by_columns %}\n{% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n\n\nwith a as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_fewer_rows_than,\n count(*) as count_our_model \n from {{ model }}\n {{ groupby_gb_cols }}\n\n),\nb as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_fewer_rows_than,\n count(*) as count_comparison_model \n from {{ compare_model }}\n {{ groupby_gb_cols }}\n\n),\ncounts as (\n\n select\n\n {% for c in group_by_columns -%}\n a.{{c}} as {{c}}_a,\n b.{{c}} as {{c}}_b,\n {% endfor %}\n\n count_our_model,\n count_comparison_model\n from a\n full join b on \n a.id_dbtutils_test_fewer_rows_than = b.id_dbtutils_test_fewer_rows_than\n {{ join_gb_cols }}\n\n),\nfinal as (\n\n select *,\n case\n -- fail the test if we have more rows than the reference model and return the row count delta\n when count_our_model > count_comparison_model then (count_our_model - count_comparison_model)\n -- fail the test if they are the same number\n when count_our_model = count_comparison_model then 1\n -- pass the test if the delta is positive (i.e. return the number 0)\n else 0\n end as row_count_delta\n from counts\n\n)\n\nselect * from final\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.928988, "supported_languages": null}, "macro.dbt_utils.test_equal_rowcount": {"name": "test_equal_rowcount", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equal_rowcount.sql", "original_file_path": "macros/generic_tests/equal_rowcount.sql", "unique_id": "macro.dbt_utils.test_equal_rowcount", "macro_sql": "{% test equal_rowcount(model, compare_model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_equal_rowcount', 'dbt_utils')(model, compare_model, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_equal_rowcount"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.92986, "supported_languages": null}, "macro.dbt_utils.default__test_equal_rowcount": {"name": "default__test_equal_rowcount", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equal_rowcount.sql", "original_file_path": "macros/generic_tests/equal_rowcount.sql", "unique_id": "macro.dbt_utils.default__test_equal_rowcount", "macro_sql": "{% macro default__test_equal_rowcount(model, compare_model, group_by_columns) %}\n\n{#-- Needs to be set at parse time, before we return '' below --#}\n{{ config(fail_calc = 'sum(coalesce(diff_count, 0))') }}\n\n{#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n{%- if not execute -%}\n {{ return('') }}\n{% endif %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(', ') + ', ' %}\n {% set join_gb_cols %}\n {% for c in group_by_columns %}\n and a.{{c}} = b.{{c}}\n {% endfor %}\n {% endset %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n{#-- We must add a fake join key in case additional grouping variables are not provided --#}\n{#-- Redshift does not allow for dynamically created join conditions (e.g. full join on 1 = 1 --#}\n{#-- The same logic is used in fewer_rows_than. In case of changes, maintain consistent logic --#}\n{% set group_by_columns = ['id_dbtutils_test_equal_rowcount'] + group_by_columns %}\n{% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n\nwith a as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_equal_rowcount,\n count(*) as count_a \n from {{ model }}\n {{groupby_gb_cols}}\n\n\n),\nb as (\n\n select \n {{select_gb_cols}}\n 1 as id_dbtutils_test_equal_rowcount,\n count(*) as count_b \n from {{ compare_model }}\n {{groupby_gb_cols}}\n\n),\nfinal as (\n\n select\n \n {% for c in group_by_columns -%}\n a.{{c}} as {{c}}_a,\n b.{{c}} as {{c}}_b,\n {% endfor %}\n\n count_a,\n count_b,\n abs(count_a - count_b) as diff_count\n\n from a\n full join b\n on\n a.id_dbtutils_test_equal_rowcount = b.id_dbtutils_test_equal_rowcount\n {{join_gb_cols}}\n\n\n)\n\nselect * from final\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.930985, "supported_languages": null}, "macro.dbt_utils.test_relationships_where": {"name": "test_relationships_where", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/relationships_where.sql", "original_file_path": "macros/generic_tests/relationships_where.sql", "unique_id": "macro.dbt_utils.test_relationships_where", "macro_sql": "{% test relationships_where(model, column_name, to, field, from_condition=\"1=1\", to_condition=\"1=1\") %}\n {{ return(adapter.dispatch('test_relationships_where', 'dbt_utils')(model, column_name, to, field, from_condition, to_condition)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_relationships_where"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.931645, "supported_languages": null}, "macro.dbt_utils.default__test_relationships_where": {"name": "default__test_relationships_where", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/relationships_where.sql", "original_file_path": "macros/generic_tests/relationships_where.sql", "unique_id": "macro.dbt_utils.default__test_relationships_where", "macro_sql": "{% macro default__test_relationships_where(model, column_name, to, field, from_condition=\"1=1\", to_condition=\"1=1\") %}\n\n{# T-SQL has no boolean data type so we use 1=1 which returns TRUE #}\n{# ref https://stackoverflow.com/a/7170753/3842610 #}\n\nwith left_table as (\n\n select\n {{column_name}} as id\n\n from {{model}}\n\n where {{column_name}} is not null\n and {{from_condition}}\n\n),\n\nright_table as (\n\n select\n {{field}} as id\n\n from {{to}}\n\n where {{field}} is not null\n and {{to_condition}}\n\n),\n\nexceptions as (\n\n select\n left_table.id,\n right_table.id as right_id\n\n from left_table\n\n left join right_table\n on left_table.id = right_table.id\n\n where right_table.id is null\n\n)\n\nselect * from exceptions\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.932002, "supported_languages": null}, "macro.dbt_utils.test_recency": {"name": "test_recency", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/recency.sql", "original_file_path": "macros/generic_tests/recency.sql", "unique_id": "macro.dbt_utils.test_recency", "macro_sql": "{% test recency(model, field, datepart, interval, ignore_time_component=False, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_recency', 'dbt_utils')(model, field, datepart, interval, ignore_time_component, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_recency"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9327471, "supported_languages": null}, "macro.dbt_utils.default__test_recency": {"name": "default__test_recency", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/recency.sql", "original_file_path": "macros/generic_tests/recency.sql", "unique_id": "macro.dbt_utils.default__test_recency", "macro_sql": "{% macro default__test_recency(model, field, datepart, interval, ignore_time_component, group_by_columns) %}\n\n{% set threshold = 'cast(' ~ dbt.dateadd(datepart, interval * -1, dbt.current_timestamp()) ~ ' as ' ~ ('date' if ignore_time_component else dbt.type_timestamp()) ~ ')' %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n\nwith recency as (\n\n select \n\n {{ select_gb_cols }}\n {% if ignore_time_component %}\n cast(max({{ field }}) as date) as most_recent\n {%- else %}\n max({{ field }}) as most_recent\n {%- endif %}\n\n from {{ model }}\n\n {{ groupby_gb_cols }}\n\n)\n\nselect\n\n {{ select_gb_cols }}\n most_recent,\n {{ threshold }} as threshold\n\nfrom recency\nwhere most_recent < {{ threshold }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dateadd", "macro.dbt.current_timestamp", "macro.dbt.type_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9336169, "supported_languages": null}, "macro.dbt_utils.test_not_constant": {"name": "test_not_constant", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_constant.sql", "original_file_path": "macros/generic_tests/not_constant.sql", "unique_id": "macro.dbt_utils.test_not_constant", "macro_sql": "{% test not_constant(model, column_name, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_not_constant', 'dbt_utils')(model, column_name, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_constant"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9340749, "supported_languages": null}, "macro.dbt_utils.default__test_not_constant": {"name": "default__test_not_constant", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_constant.sql", "original_file_path": "macros/generic_tests/not_constant.sql", "unique_id": "macro.dbt_utils.default__test_not_constant", "macro_sql": "{% macro default__test_not_constant(model, column_name, group_by_columns) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\n\nselect\n {# In TSQL, subquery aggregate columns need aliases #}\n {# thus: a filler col name, 'filler_column' #}\n {{select_gb_cols}}\n count(distinct {{ column_name }}) as filler_column\n\nfrom {{ model }}\n\n {{groupby_gb_cols}}\n\nhaving count(distinct {{ column_name }}) = 1\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.934552, "supported_languages": null}, "macro.dbt_utils.test_accepted_range": {"name": "test_accepted_range", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/accepted_range.sql", "original_file_path": "macros/generic_tests/accepted_range.sql", "unique_id": "macro.dbt_utils.test_accepted_range", "macro_sql": "{% test accepted_range(model, column_name, min_value=none, max_value=none, inclusive=true) %}\n {{ return(adapter.dispatch('test_accepted_range', 'dbt_utils')(model, column_name, min_value, max_value, inclusive)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_accepted_range"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.935175, "supported_languages": null}, "macro.dbt_utils.default__test_accepted_range": {"name": "default__test_accepted_range", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/accepted_range.sql", "original_file_path": "macros/generic_tests/accepted_range.sql", "unique_id": "macro.dbt_utils.default__test_accepted_range", "macro_sql": "{% macro default__test_accepted_range(model, column_name, min_value=none, max_value=none, inclusive=true) %}\n\nwith meet_condition as(\n select *\n from {{ model }}\n),\n\nvalidation_errors as (\n select *\n from meet_condition\n where\n -- never true, defaults to an empty result set. Exists to ensure any combo of the `or` clauses below succeeds\n 1 = 2\n\n {%- if min_value is not none %}\n -- records with a value >= min_value are permitted. The `not` flips this to find records that don't meet the rule.\n or not {{ column_name }} > {{- \"=\" if inclusive }} {{ min_value }}\n {%- endif %}\n\n {%- if max_value is not none %}\n -- records with a value <= max_value are permitted. The `not` flips this to find records that don't meet the rule.\n or not {{ column_name }} < {{- \"=\" if inclusive }} {{ max_value }}\n {%- endif %}\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.935667, "supported_languages": null}, "macro.dbt_utils.test_not_accepted_values": {"name": "test_not_accepted_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_accepted_values.sql", "original_file_path": "macros/generic_tests/not_accepted_values.sql", "unique_id": "macro.dbt_utils.test_not_accepted_values", "macro_sql": "{% test not_accepted_values(model, column_name, values, quote=True) %}\n {{ return(adapter.dispatch('test_not_accepted_values', 'dbt_utils')(model, column_name, values, quote)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_accepted_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.936241, "supported_languages": null}, "macro.dbt_utils.default__test_not_accepted_values": {"name": "default__test_not_accepted_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_accepted_values.sql", "original_file_path": "macros/generic_tests/not_accepted_values.sql", "unique_id": "macro.dbt_utils.default__test_not_accepted_values", "macro_sql": "{% macro default__test_not_accepted_values(model, column_name, values, quote=True) %}\nwith all_values as (\n\n select distinct\n {{ column_name }} as value_field\n\n from {{ model }}\n\n),\n\nvalidation_errors as (\n\n select\n value_field\n\n from all_values\n where value_field in (\n {% for value in values -%}\n {% if quote -%}\n '{{ value }}'\n {%- else -%}\n {{ value }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {%- endfor %}\n )\n\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.936637, "supported_languages": null}, "macro.dbt_utils.test_at_least_one": {"name": "test_at_least_one", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/at_least_one.sql", "original_file_path": "macros/generic_tests/at_least_one.sql", "unique_id": "macro.dbt_utils.test_at_least_one", "macro_sql": "{% test at_least_one(model, column_name, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_at_least_one', 'dbt_utils')(model, column_name, group_by_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_at_least_one"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.937304, "supported_languages": null}, "macro.dbt_utils.default__test_at_least_one": {"name": "default__test_at_least_one", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/at_least_one.sql", "original_file_path": "macros/generic_tests/at_least_one.sql", "unique_id": "macro.dbt_utils.default__test_at_least_one", "macro_sql": "{% macro default__test_at_least_one(model, column_name, group_by_columns) %}\n\n{% set pruned_cols = [column_name] %}\n\n{% if group_by_columns|length() > 0 %}\n\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n {% set pruned_cols = group_by_columns %}\n\n {% if column_name not in pruned_cols %}\n {% do pruned_cols.append(column_name) %}\n {% endif %}\n\n{% endif %}\n\n{% set select_pruned_cols = pruned_cols|join(' ,') %}\n\nselect *\nfrom (\n with pruned_rows as (\n select\n {{ select_pruned_cols }}\n from {{ model }}\n where {{ column_name }} is not null\n limit 1\n )\n select\n {# In TSQL, subquery aggregate columns need aliases #}\n {# thus: a filler col name, 'filler_column' #}\n {{select_gb_cols}}\n count({{ column_name }}) as filler_column\n\n from pruned_rows\n\n {{groupby_gb_cols}}\n\n having count({{ column_name }}) = 0\n\n) validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.938197, "supported_languages": null}, "macro.dbt_utils.test_unique_combination_of_columns": {"name": "test_unique_combination_of_columns", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/unique_combination_of_columns.sql", "original_file_path": "macros/generic_tests/unique_combination_of_columns.sql", "unique_id": "macro.dbt_utils.test_unique_combination_of_columns", "macro_sql": "{% test unique_combination_of_columns(model, combination_of_columns, quote_columns=false) %}\n {{ return(adapter.dispatch('test_unique_combination_of_columns', 'dbt_utils')(model, combination_of_columns, quote_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_unique_combination_of_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.938838, "supported_languages": null}, "macro.dbt_utils.default__test_unique_combination_of_columns": {"name": "default__test_unique_combination_of_columns", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/unique_combination_of_columns.sql", "original_file_path": "macros/generic_tests/unique_combination_of_columns.sql", "unique_id": "macro.dbt_utils.default__test_unique_combination_of_columns", "macro_sql": "{% macro default__test_unique_combination_of_columns(model, combination_of_columns, quote_columns=false) %}\n\n{% if not quote_columns %}\n {%- set column_list=combination_of_columns %}\n{% elif quote_columns %}\n {%- set column_list=[] %}\n {% for column in combination_of_columns -%}\n {% set column_list = column_list.append( adapter.quote(column) ) %}\n {%- endfor %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`quote_columns` argument for unique_combination_of_columns test must be one of [True, False] Got: '\" ~ quote ~\"'.'\"\n ) }}\n{% endif %}\n\n{%- set columns_csv=column_list | join(', ') %}\n\n\nwith validation_errors as (\n\n select\n {{ columns_csv }}\n from {{ model }}\n group by {{ columns_csv }}\n having count(*) > 1\n\n)\n\nselect *\nfrom validation_errors\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.939508, "supported_languages": null}, "macro.dbt_utils.test_cardinality_equality": {"name": "test_cardinality_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/cardinality_equality.sql", "original_file_path": "macros/generic_tests/cardinality_equality.sql", "unique_id": "macro.dbt_utils.test_cardinality_equality", "macro_sql": "{% test cardinality_equality(model, column_name, to, field) %}\n {{ return(adapter.dispatch('test_cardinality_equality', 'dbt_utils')(model, column_name, to, field)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_cardinality_equality"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.940063, "supported_languages": null}, "macro.dbt_utils.default__test_cardinality_equality": {"name": "default__test_cardinality_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/cardinality_equality.sql", "original_file_path": "macros/generic_tests/cardinality_equality.sql", "unique_id": "macro.dbt_utils.default__test_cardinality_equality", "macro_sql": "{% macro default__test_cardinality_equality(model, column_name, to, field) %}\n\n{# T-SQL does not let you use numbers as aliases for columns #}\n{# Thus, no \"GROUP BY 1\" #}\n\nwith table_a as (\nselect\n {{ column_name }},\n count(*) as num_rows\nfrom {{ model }}\ngroup by {{ column_name }}\n),\n\ntable_b as (\nselect\n {{ field }},\n count(*) as num_rows\nfrom {{ to }}\ngroup by {{ field }}\n),\n\nexcept_a as (\n select *\n from table_a\n {{ dbt.except() }}\n select *\n from table_b\n),\n\nexcept_b as (\n select *\n from table_b\n {{ dbt.except() }}\n select *\n from table_a\n),\n\nunioned as (\n select *\n from except_a\n union all\n select *\n from except_b\n)\n\nselect *\nfrom unioned\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.940419, "supported_languages": null}, "macro.dbt_utils.test_expression_is_true": {"name": "test_expression_is_true", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/expression_is_true.sql", "original_file_path": "macros/generic_tests/expression_is_true.sql", "unique_id": "macro.dbt_utils.test_expression_is_true", "macro_sql": "{% test expression_is_true(model, expression, column_name=None) %}\n {{ return(adapter.dispatch('test_expression_is_true', 'dbt_utils')(model, expression, column_name)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_expression_is_true"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.94083, "supported_languages": null}, "macro.dbt_utils.default__test_expression_is_true": {"name": "default__test_expression_is_true", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/expression_is_true.sql", "original_file_path": "macros/generic_tests/expression_is_true.sql", "unique_id": "macro.dbt_utils.default__test_expression_is_true", "macro_sql": "{% macro default__test_expression_is_true(model, expression, column_name) %}\n\n{% set column_list = '*' if should_store_failures() else \"1\" %}\n\nselect\n {{ column_list }}\nfrom {{ model }}\n{% if column_name is none %}\nwhere not({{ expression }})\n{%- else %}\nwhere not({{ column_name }} {{ expression }})\n{%- endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.should_store_failures"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.941205, "supported_languages": null}, "macro.dbt_utils.test_not_null_proportion": {"name": "test_not_null_proportion", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_null_proportion.sql", "original_file_path": "macros/generic_tests/not_null_proportion.sql", "unique_id": "macro.dbt_utils.test_not_null_proportion", "macro_sql": "{% macro test_not_null_proportion(model, group_by_columns = []) %}\n {{ return(adapter.dispatch('test_not_null_proportion', 'dbt_utils')(model, group_by_columns, **kwargs)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_null_proportion"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.941851, "supported_languages": null}, "macro.dbt_utils.default__test_not_null_proportion": {"name": "default__test_not_null_proportion", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_null_proportion.sql", "original_file_path": "macros/generic_tests/not_null_proportion.sql", "unique_id": "macro.dbt_utils.default__test_not_null_proportion", "macro_sql": "{% macro default__test_not_null_proportion(model, group_by_columns) %}\n\n{% set column_name = kwargs.get('column_name', kwargs.get('arg')) %}\n{% set at_least = kwargs.get('at_least', kwargs.get('arg')) %}\n{% set at_most = kwargs.get('at_most', kwargs.get('arg', 1)) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(' ,') + ', ' %}\n {% set groupby_gb_cols = 'group by ' + group_by_columns|join(',') %}\n{% endif %}\n\nwith validation as (\n select\n {{select_gb_cols}}\n sum(case when {{ column_name }} is null then 0 else 1 end) / cast(count(*) as numeric) as not_null_proportion\n from {{ model }}\n {{groupby_gb_cols}}\n),\nvalidation_errors as (\n select\n {{select_gb_cols}}\n not_null_proportion\n from validation\n where not_null_proportion < {{ at_least }} or not_null_proportion > {{ at_most }}\n)\nselect\n *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.94271, "supported_languages": null}, "macro.dbt_utils.test_sequential_values": {"name": "test_sequential_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/sequential_values.sql", "original_file_path": "macros/generic_tests/sequential_values.sql", "unique_id": "macro.dbt_utils.test_sequential_values", "macro_sql": "{% test sequential_values(model, column_name, interval=1, datepart=None, group_by_columns = []) %}\n\n {{ return(adapter.dispatch('test_sequential_values', 'dbt_utils')(model, column_name, interval, datepart, group_by_columns)) }}\n\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_sequential_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.943635, "supported_languages": null}, "macro.dbt_utils.default__test_sequential_values": {"name": "default__test_sequential_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/sequential_values.sql", "original_file_path": "macros/generic_tests/sequential_values.sql", "unique_id": "macro.dbt_utils.default__test_sequential_values", "macro_sql": "{% macro default__test_sequential_values(model, column_name, interval=1, datepart=None, group_by_columns = []) %}\n\n{% set previous_column_name = \"previous_\" ~ dbt_utils.slugify(column_name) %}\n\n{% if group_by_columns|length() > 0 %}\n {% set select_gb_cols = group_by_columns|join(',') + ', ' %}\n {% set partition_gb_cols = 'partition by ' + group_by_columns|join(',') %}\n{% endif %}\n\nwith windowed as (\n\n select\n {{ select_gb_cols }}\n {{ column_name }},\n lag({{ column_name }}) over (\n {{partition_gb_cols}}\n order by {{ column_name }}\n ) as {{ previous_column_name }}\n from {{ model }}\n),\n\nvalidation_errors as (\n select\n *\n from windowed\n {% if datepart %}\n where not(cast({{ column_name }} as {{ dbt.type_timestamp() }})= cast({{ dbt.dateadd(datepart, interval, previous_column_name) }} as {{ dbt.type_timestamp() }}))\n {% else %}\n where not({{ column_name }} = {{ previous_column_name }} + {{ interval }})\n {% endif %}\n)\n\nselect *\nfrom validation_errors\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.slugify", "macro.dbt.type_timestamp", "macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9445918, "supported_languages": null}, "macro.dbt_utils.test_equality": {"name": "test_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equality.sql", "original_file_path": "macros/generic_tests/equality.sql", "unique_id": "macro.dbt_utils.test_equality", "macro_sql": "{% test equality(model, compare_model, compare_columns=None) %}\n {{ return(adapter.dispatch('test_equality', 'dbt_utils')(model, compare_model, compare_columns)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_equality"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.945337, "supported_languages": null}, "macro.dbt_utils.default__test_equality": {"name": "default__test_equality", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/equality.sql", "original_file_path": "macros/generic_tests/equality.sql", "unique_id": "macro.dbt_utils.default__test_equality", "macro_sql": "{% macro default__test_equality(model, compare_model, compare_columns=None) %}\n\n{% set set_diff %}\n count(*) + coalesce(abs(\n sum(case when which_diff = 'a_minus_b' then 1 else 0 end) -\n sum(case when which_diff = 'b_minus_a' then 1 else 0 end)\n ), 0)\n{% endset %}\n\n{#-- Needs to be set at parse time, before we return '' below --#}\n{{ config(fail_calc = set_diff) }}\n\n{#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n{%- if not execute -%}\n {{ return('') }}\n{% endif %}\n\n-- setup\n{%- do dbt_utils._is_relation(model, 'test_equality') -%}\n\n{#-\nIf the compare_cols arg is provided, we can run this test without querying the\ninformation schema\u00a0\u2014 this allows the model to be an ephemeral model\n-#}\n\n{%- if not compare_columns -%}\n {%- do dbt_utils._is_ephemeral(model, 'test_equality') -%}\n {%- set compare_columns = adapter.get_columns_in_relation(model) | map(attribute='quoted') -%}\n{%- endif -%}\n\n{% set compare_cols_csv = compare_columns | join(', ') %}\n\nwith a as (\n\n select * from {{ model }}\n\n),\n\nb as (\n\n select * from {{ compare_model }}\n\n),\n\na_minus_b as (\n\n select {{compare_cols_csv}} from a\n {{ dbt.except() }}\n select {{compare_cols_csv}} from b\n\n),\n\nb_minus_a as (\n\n select {{compare_cols_csv}} from b\n {{ dbt.except() }}\n select {{compare_cols_csv}} from a\n\n),\n\nunioned as (\n\n select 'a_minus_b' as which_diff, a_minus_b.* from a_minus_b\n union all\n select 'b_minus_a' as which_diff, b_minus_a.* from b_minus_a\n\n)\n\nselect * from unioned\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.except"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.946254, "supported_languages": null}, "macro.dbt_utils.test_not_empty_string": {"name": "test_not_empty_string", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_empty_string.sql", "original_file_path": "macros/generic_tests/not_empty_string.sql", "unique_id": "macro.dbt_utils.test_not_empty_string", "macro_sql": "{% test not_empty_string(model, column_name, trim_whitespace=true) %}\n\n {{ return(adapter.dispatch('test_not_empty_string', 'dbt_utils')(model, column_name, trim_whitespace)) }}\n\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_not_empty_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.946788, "supported_languages": null}, "macro.dbt_utils.default__test_not_empty_string": {"name": "default__test_not_empty_string", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/not_empty_string.sql", "original_file_path": "macros/generic_tests/not_empty_string.sql", "unique_id": "macro.dbt_utils.default__test_not_empty_string", "macro_sql": "{% macro default__test_not_empty_string(model, column_name, trim_whitespace=true) %}\n\n with\n \n all_values as (\n\n select \n\n\n {% if trim_whitespace == true -%}\n\n trim({{ column_name }}) as {{ column_name }}\n\n {%- else -%}\n\n {{ column_name }}\n\n {%- endif %}\n \n from {{ model }}\n\n ),\n\n errors as (\n\n select * from all_values\n where {{ column_name }} = ''\n\n )\n\n select * from errors\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.947103, "supported_languages": null}, "macro.dbt_utils.test_mutually_exclusive_ranges": {"name": "test_mutually_exclusive_ranges", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/mutually_exclusive_ranges.sql", "original_file_path": "macros/generic_tests/mutually_exclusive_ranges.sql", "unique_id": "macro.dbt_utils.test_mutually_exclusive_ranges", "macro_sql": "{% test mutually_exclusive_ranges(model, lower_bound_column, upper_bound_column, partition_by=None, gaps='allowed', zero_length_range_allowed=False) %}\n {{ return(adapter.dispatch('test_mutually_exclusive_ranges', 'dbt_utils')(model, lower_bound_column, upper_bound_column, partition_by, gaps, zero_length_range_allowed)) }}\n{% endtest %}", "depends_on": {"macros": ["macro.dbt_utils.default__test_mutually_exclusive_ranges"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9506419, "supported_languages": null}, "macro.dbt_utils.default__test_mutually_exclusive_ranges": {"name": "default__test_mutually_exclusive_ranges", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/generic_tests/mutually_exclusive_ranges.sql", "original_file_path": "macros/generic_tests/mutually_exclusive_ranges.sql", "unique_id": "macro.dbt_utils.default__test_mutually_exclusive_ranges", "macro_sql": "{% macro default__test_mutually_exclusive_ranges(model, lower_bound_column, upper_bound_column, partition_by=None, gaps='allowed', zero_length_range_allowed=False) %}\n{% if gaps == 'not_allowed' %}\n {% set allow_gaps_operator='=' %}\n {% set allow_gaps_operator_in_words='equal_to' %}\n{% elif gaps == 'allowed' %}\n {% set allow_gaps_operator='<=' %}\n {% set allow_gaps_operator_in_words='less_than_or_equal_to' %}\n{% elif gaps == 'required' %}\n {% set allow_gaps_operator='<' %}\n {% set allow_gaps_operator_in_words='less_than' %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`gaps` argument for mutually_exclusive_ranges test must be one of ['not_allowed', 'allowed', 'required'] Got: '\" ~ gaps ~\"'.'\"\n ) }}\n{% endif %}\n{% if not zero_length_range_allowed %}\n {% set allow_zero_length_operator='<' %}\n {% set allow_zero_length_operator_in_words='less_than' %}\n{% elif zero_length_range_allowed %}\n {% set allow_zero_length_operator='<=' %}\n {% set allow_zero_length_operator_in_words='less_than_or_equal_to' %}\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"`zero_length_range_allowed` argument for mutually_exclusive_ranges test must be one of [true, false] Got: '\" ~ zero_length_range_allowed ~\"'.'\"\n ) }}\n{% endif %}\n\n{% set partition_clause=\"partition by \" ~ partition_by if partition_by else '' %}\n\nwith window_functions as (\n\n select\n {% if partition_by %}\n {{ partition_by }} as partition_by_col,\n {% endif %}\n {{ lower_bound_column }} as lower_bound,\n {{ upper_bound_column }} as upper_bound,\n\n lead({{ lower_bound_column }}) over (\n {{ partition_clause }}\n order by {{ lower_bound_column }}, {{ upper_bound_column }}\n ) as next_lower_bound,\n\n row_number() over (\n {{ partition_clause }}\n order by {{ lower_bound_column }} desc, {{ upper_bound_column }} desc\n ) = 1 as is_last_record\n\n from {{ model }}\n\n),\n\ncalc as (\n -- We want to return records where one of our assumptions fails, so we'll use\n -- the `not` function with `and` statements so we can write our assumptions more cleanly\n select\n *,\n\n -- For each record: lower_bound should be < upper_bound.\n -- Coalesce it to return an error on the null case (implicit assumption\n -- these columns are not_null)\n coalesce(\n lower_bound {{ allow_zero_length_operator }} upper_bound,\n false\n ) as lower_bound_{{ allow_zero_length_operator_in_words }}_upper_bound,\n\n -- For each record: upper_bound {{ allow_gaps_operator }} the next lower_bound.\n -- Coalesce it to handle null cases for the last record.\n coalesce(\n upper_bound {{ allow_gaps_operator }} next_lower_bound,\n is_last_record,\n false\n ) as upper_bound_{{ allow_gaps_operator_in_words }}_next_lower_bound\n\n from window_functions\n\n),\n\nvalidation_errors as (\n\n select\n *\n from calc\n\n where not(\n -- THE FOLLOWING SHOULD BE TRUE --\n lower_bound_{{ allow_zero_length_operator_in_words }}_upper_bound\n and upper_bound_{{ allow_gaps_operator_in_words }}_next_lower_bound\n )\n)\n\nselect * from validation_errors\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.952363, "supported_languages": null}, "macro.dbt_utils.pretty_log_format": {"name": "pretty_log_format", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_log_format.sql", "original_file_path": "macros/jinja_helpers/pretty_log_format.sql", "unique_id": "macro.dbt_utils.pretty_log_format", "macro_sql": "{% macro pretty_log_format(message) %}\n {{ return(adapter.dispatch('pretty_log_format', 'dbt_utils')(message)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pretty_log_format"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.952679, "supported_languages": null}, "macro.dbt_utils.default__pretty_log_format": {"name": "default__pretty_log_format", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_log_format.sql", "original_file_path": "macros/jinja_helpers/pretty_log_format.sql", "unique_id": "macro.dbt_utils.default__pretty_log_format", "macro_sql": "{% macro default__pretty_log_format(message) %}\n {{ return( dbt_utils.pretty_time() ~ ' + ' ~ message) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.pretty_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9528651, "supported_languages": null}, "macro.dbt_utils._is_relation": {"name": "_is_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/_is_relation.sql", "original_file_path": "macros/jinja_helpers/_is_relation.sql", "unique_id": "macro.dbt_utils._is_relation", "macro_sql": "{% macro _is_relation(obj, macro) %}\n {%- if not (obj is mapping and obj.get('metadata', {}).get('type', '').endswith('Relation')) -%}\n {%- do exceptions.raise_compiler_error(\"Macro \" ~ macro ~ \" expected a Relation but received the value: \" ~ obj) -%}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.953345, "supported_languages": null}, "macro.dbt_utils.pretty_time": {"name": "pretty_time", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_time.sql", "original_file_path": "macros/jinja_helpers/pretty_time.sql", "unique_id": "macro.dbt_utils.pretty_time", "macro_sql": "{% macro pretty_time(format='%H:%M:%S') %}\n {{ return(adapter.dispatch('pretty_time', 'dbt_utils')(format)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pretty_time"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.95364, "supported_languages": null}, "macro.dbt_utils.default__pretty_time": {"name": "default__pretty_time", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/pretty_time.sql", "original_file_path": "macros/jinja_helpers/pretty_time.sql", "unique_id": "macro.dbt_utils.default__pretty_time", "macro_sql": "{% macro default__pretty_time(format='%H:%M:%S') %}\n {{ return(modules.datetime.datetime.now().strftime(format)) }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.953855, "supported_languages": null}, "macro.dbt_utils.log_info": {"name": "log_info", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/log_info.sql", "original_file_path": "macros/jinja_helpers/log_info.sql", "unique_id": "macro.dbt_utils.log_info", "macro_sql": "{% macro log_info(message) %}\n {{ return(adapter.dispatch('log_info', 'dbt_utils')(message)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__log_info"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.954124, "supported_languages": null}, "macro.dbt_utils.default__log_info": {"name": "default__log_info", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/log_info.sql", "original_file_path": "macros/jinja_helpers/log_info.sql", "unique_id": "macro.dbt_utils.default__log_info", "macro_sql": "{% macro default__log_info(message) %}\n {{ log(dbt_utils.pretty_log_format(message), info=True) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.pretty_log_format"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9543092, "supported_languages": null}, "macro.dbt_utils.slugify": {"name": "slugify", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/slugify.sql", "original_file_path": "macros/jinja_helpers/slugify.sql", "unique_id": "macro.dbt_utils.slugify", "macro_sql": "{% macro slugify(string) %}\n\n{#- Lower case the string -#}\n{% set string = string | lower %}\n{#- Replace spaces and dashes with underscores -#}\n{% set string = modules.re.sub('[ -]+', '_', string) %}\n{#- Only take letters, numbers, and underscores -#}\n{% set string = modules.re.sub('[^a-z0-9_]+', '', string) %}\n{#- Prepends \"_\" if string begins with a number -#}\n{% set string = modules.re.sub('^[0-9]', '_' + string[0], string) %}\n\n{{ return(string) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9549482, "supported_languages": null}, "macro.dbt_utils._is_ephemeral": {"name": "_is_ephemeral", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/jinja_helpers/_is_ephemeral.sql", "original_file_path": "macros/jinja_helpers/_is_ephemeral.sql", "unique_id": "macro.dbt_utils._is_ephemeral", "macro_sql": "{% macro _is_ephemeral(obj, macro) %}\n {%- if obj.is_cte -%}\n {% set ephemeral_prefix = api.Relation.add_ephemeral_prefix('') %}\n {% if obj.name.startswith(ephemeral_prefix) %}\n {% set model_name = obj.name[(ephemeral_prefix|length):] %}\n {% else %}\n {% set model_name = obj.name %}\n {%- endif -%}\n {% set error_message %}\nThe `{{ macro }}` macro cannot be used with ephemeral models, as it relies on the information schema.\n\n`{{ model_name }}` is an ephemeral model. Consider making it a view or table instead.\n {% endset %}\n {%- do exceptions.raise_compiler_error(error_message) -%}\n {%- endif -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.955822, "supported_languages": null}, "macro.dbt_utils.get_intervals_between": {"name": "get_intervals_between", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.get_intervals_between", "macro_sql": "{% macro get_intervals_between(start_date, end_date, datepart) -%}\n {{ return(adapter.dispatch('get_intervals_between', 'dbt_utils')(start_date, end_date, datepart)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_intervals_between"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.956545, "supported_languages": null}, "macro.dbt_utils.default__get_intervals_between": {"name": "default__get_intervals_between", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.default__get_intervals_between", "macro_sql": "{% macro default__get_intervals_between(start_date, end_date, datepart) -%}\n {%- call statement('get_intervals_between', fetch_result=True) %}\n\n select {{ dbt.datediff(start_date, end_date, datepart) }}\n\n {%- endcall -%}\n\n {%- set value_list = load_result('get_intervals_between') -%}\n\n {%- if value_list and value_list['data'] -%}\n {%- set values = value_list['data'] | map(attribute=0) | list %}\n {{ return(values[0]) }}\n {%- else -%}\n {{ return(1) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.957171, "supported_languages": null}, "macro.dbt_utils.date_spine": {"name": "date_spine", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.date_spine", "macro_sql": "{% macro date_spine(datepart, start_date, end_date) %}\n {{ return(adapter.dispatch('date_spine', 'dbt_utils')(datepart, start_date, end_date)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__date_spine"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.957417, "supported_languages": null}, "macro.dbt_utils.default__date_spine": {"name": "default__date_spine", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/date_spine.sql", "original_file_path": "macros/sql/date_spine.sql", "unique_id": "macro.dbt_utils.default__date_spine", "macro_sql": "{% macro default__date_spine(datepart, start_date, end_date) %}\n\n\n{# call as follows:\n\ndate_spine(\n \"day\",\n \"to_date('01/01/2016', 'mm/dd/yyyy')\",\n \"dbt.dateadd(week, 1, current_date)\"\n) #}\n\n\nwith rawdata as (\n\n {{dbt_utils.generate_series(\n dbt_utils.get_intervals_between(start_date, end_date, datepart)\n )}}\n\n),\n\nall_periods as (\n\n select (\n {{\n dbt.dateadd(\n datepart,\n \"row_number() over (order by 1) - 1\",\n start_date\n )\n }}\n ) as date_{{datepart}}\n from rawdata\n\n),\n\nfiltered as (\n\n select *\n from all_periods\n where date_{{datepart}} <= {{ end_date }}\n\n)\n\nselect * from filtered\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.generate_series", "macro.dbt_utils.get_intervals_between", "macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9578009, "supported_languages": null}, "macro.dbt_utils.safe_subtract": {"name": "safe_subtract", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_subtract.sql", "original_file_path": "macros/sql/safe_subtract.sql", "unique_id": "macro.dbt_utils.safe_subtract", "macro_sql": "{%- macro safe_subtract(field_list) -%}\n {{ return(adapter.dispatch('safe_subtract', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_subtract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.958198, "supported_languages": null}, "macro.dbt_utils.default__safe_subtract": {"name": "default__safe_subtract", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_subtract.sql", "original_file_path": "macros/sql/safe_subtract.sql", "unique_id": "macro.dbt_utils.default__safe_subtract", "macro_sql": "\n\n{%- macro default__safe_subtract(field_list) -%}\n\n{%- if field_list is not iterable or field_list is string or field_list is mapping -%}\n\n{%- set error_message = '\nWarning: the `safe_subtract` macro takes a single list argument instead of \\\nstring arguments. The {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.raise_compiler_error(error_message) -%}\n\n{%- endif -%}\n\n{% set fields = [] %}\n\n{%- for field in field_list -%}\n\n {% do fields.append(\"coalesce(\" ~ field ~ \", 0)\") %}\n\n{%- endfor -%}\n\n{{ fields|join(' -\\n ') }}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.958766, "supported_languages": null}, "macro.dbt_utils.nullcheck_table": {"name": "nullcheck_table", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck_table.sql", "original_file_path": "macros/sql/nullcheck_table.sql", "unique_id": "macro.dbt_utils.nullcheck_table", "macro_sql": "{% macro nullcheck_table(relation) %}\n {{ return(adapter.dispatch('nullcheck_table', 'dbt_utils')(relation)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__nullcheck_table"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.959092, "supported_languages": null}, "macro.dbt_utils.default__nullcheck_table": {"name": "default__nullcheck_table", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck_table.sql", "original_file_path": "macros/sql/nullcheck_table.sql", "unique_id": "macro.dbt_utils.default__nullcheck_table", "macro_sql": "{% macro default__nullcheck_table(relation) %}\n\n {%- do dbt_utils._is_relation(relation, 'nullcheck_table') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'nullcheck_table') -%}\n {% set cols = adapter.get_columns_in_relation(relation) %}\n\n select {{ dbt_utils.nullcheck(cols) }}\n from {{relation}}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt_utils.nullcheck"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.959451, "supported_languages": null}, "macro.dbt_utils.get_relations_by_pattern": {"name": "get_relations_by_pattern", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_pattern.sql", "original_file_path": "macros/sql/get_relations_by_pattern.sql", "unique_id": "macro.dbt_utils.get_relations_by_pattern", "macro_sql": "{% macro get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_relations_by_pattern', 'dbt_utils')(schema_pattern, table_pattern, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.960185, "supported_languages": null}, "macro.dbt_utils.default__get_relations_by_pattern": {"name": "default__get_relations_by_pattern", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_pattern.sql", "original_file_path": "macros/sql/get_relations_by_pattern.sql", "unique_id": "macro.dbt_utils.default__get_relations_by_pattern", "macro_sql": "{% macro default__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n {{ dbt_utils.get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude, database) }}\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=database,\n schema=row.table_schema,\n identifier=row.table_name,\n type=row.table_type\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_utils.get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.961154, "supported_languages": null}, "macro.dbt_utils.get_powers_of_two": {"name": "get_powers_of_two", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.get_powers_of_two", "macro_sql": "{% macro get_powers_of_two(upper_bound) %}\n {{ return(adapter.dispatch('get_powers_of_two', 'dbt_utils')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.962027, "supported_languages": null}, "macro.dbt_utils.default__get_powers_of_two": {"name": "default__get_powers_of_two", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.default__get_powers_of_two", "macro_sql": "{% macro default__get_powers_of_two(upper_bound) %}\n\n {% if upper_bound <= 0 %}\n {{ exceptions.raise_compiler_error(\"upper bound must be positive\") }}\n {% endif %}\n\n {% for _ in range(1, 100) %}\n {% if upper_bound <= 2 ** loop.index %}{{ return(loop.index) }}{% endif %}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.962467, "supported_languages": null}, "macro.dbt_utils.generate_series": {"name": "generate_series", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.generate_series", "macro_sql": "{% macro generate_series(upper_bound) %}\n {{ return(adapter.dispatch('generate_series', 'dbt_utils')(upper_bound)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__generate_series"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.962667, "supported_languages": null}, "macro.dbt_utils.default__generate_series": {"name": "default__generate_series", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_series.sql", "original_file_path": "macros/sql/generate_series.sql", "unique_id": "macro.dbt_utils.default__generate_series", "macro_sql": "{% macro default__generate_series(upper_bound) %}\n\n {% set n = dbt_utils.get_powers_of_two(upper_bound) %}\n\n with p as (\n select 0 as generated_number union all select 1\n ), unioned as (\n\n select\n\n {% for i in range(n) %}\n p{{i}}.generated_number * power(2, {{i}})\n {% if not loop.last %} + {% endif %}\n {% endfor %}\n + 1\n as generated_number\n\n from\n\n {% for i in range(n) %}\n p as p{{i}}\n {% if not loop.last %} cross join {% endif %}\n {% endfor %}\n\n )\n\n select *\n from unioned\n where generated_number <= {{upper_bound}}\n order by generated_number\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_powers_of_two"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9632168, "supported_languages": null}, "macro.dbt_utils.get_relations_by_prefix": {"name": "get_relations_by_prefix", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_prefix.sql", "original_file_path": "macros/sql/get_relations_by_prefix.sql", "unique_id": "macro.dbt_utils.get_relations_by_prefix", "macro_sql": "{% macro get_relations_by_prefix(schema, prefix, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_relations_by_prefix', 'dbt_utils')(schema, prefix, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_relations_by_prefix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.963943, "supported_languages": null}, "macro.dbt_utils.default__get_relations_by_prefix": {"name": "default__get_relations_by_prefix", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_relations_by_prefix.sql", "original_file_path": "macros/sql/get_relations_by_prefix.sql", "unique_id": "macro.dbt_utils.default__get_relations_by_prefix", "macro_sql": "{% macro default__get_relations_by_prefix(schema, prefix, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n {{ dbt_utils.get_tables_by_prefix_sql(schema, prefix, exclude, database) }}\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=database,\n schema=row.table_schema,\n identifier=row.table_name,\n type=row.table_type\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt_utils.get_tables_by_prefix_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9648361, "supported_languages": null}, "macro.dbt_utils.get_tables_by_prefix_sql": {"name": "get_tables_by_prefix_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_prefix_sql.sql", "original_file_path": "macros/sql/get_tables_by_prefix_sql.sql", "unique_id": "macro.dbt_utils.get_tables_by_prefix_sql", "macro_sql": "{% macro get_tables_by_prefix_sql(schema, prefix, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_tables_by_prefix_sql', 'dbt_utils')(schema, prefix, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_tables_by_prefix_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.965255, "supported_languages": null}, "macro.dbt_utils.default__get_tables_by_prefix_sql": {"name": "default__get_tables_by_prefix_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_prefix_sql.sql", "original_file_path": "macros/sql/get_tables_by_prefix_sql.sql", "unique_id": "macro.dbt_utils.default__get_tables_by_prefix_sql", "macro_sql": "{% macro default__get_tables_by_prefix_sql(schema, prefix, exclude='', database=target.database) %}\n\n {{ dbt_utils.get_tables_by_pattern_sql(\n schema_pattern = schema,\n table_pattern = prefix ~ '%',\n exclude = exclude,\n database = database\n ) }}\n \n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.965557, "supported_languages": null}, "macro.dbt_utils.star": {"name": "star", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/star.sql", "original_file_path": "macros/sql/star.sql", "unique_id": "macro.dbt_utils.star", "macro_sql": "{% macro star(from, relation_alias=False, except=[], prefix='', suffix='', quote_identifiers=True) -%}\r\n {{ return(adapter.dispatch('star', 'dbt_utils')(from, relation_alias, except, prefix, suffix, quote_identifiers)) }}\r\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__star"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9669209, "supported_languages": null}, "macro.dbt_utils.default__star": {"name": "default__star", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/star.sql", "original_file_path": "macros/sql/star.sql", "unique_id": "macro.dbt_utils.default__star", "macro_sql": "{% macro default__star(from, relation_alias=False, except=[], prefix='', suffix='', quote_identifiers=True) -%}\r\n {%- do dbt_utils._is_relation(from, 'star') -%}\r\n {%- do dbt_utils._is_ephemeral(from, 'star') -%}\r\n\r\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\r\n {%- if not execute -%}\r\n {% do return('*') %}\r\n {%- endif -%}\r\n\r\n {% set cols = dbt_utils.get_filtered_columns_in_relation(from, except) %}\r\n\r\n {%- if cols|length <= 0 -%}\r\n {% if flags.WHICH == 'compile' %}\r\n {% set response %}\r\n*\r\n/* No columns were returned. Maybe the relation doesn't exist yet \r\nor all columns were excluded. This star is only output during \r\ndbt compile, and exists to keep SQLFluff happy. */\r\n {% endset %}\r\n {% do return(response) %}\r\n {% else %}\r\n {% do return(\"/* no columns returned from star() macro */\") %}\r\n {% endif %}\r\n {%- else -%}\r\n {%- for col in cols %}\r\n {%- if relation_alias %}{{ relation_alias }}.{% else %}{%- endif -%}\r\n {%- if quote_identifiers -%}\r\n {{ adapter.quote(col)|trim }} {%- if prefix!='' or suffix!='' %} as {{ adapter.quote(prefix ~ col ~ suffix)|trim }} {%- endif -%}\r\n {%- else -%}\r\n {{ col|trim }} {%- if prefix!='' or suffix!='' %} as {{ (prefix ~ col ~ suffix)|trim }} {%- endif -%}\r\n {% endif %}\r\n {%- if not loop.last %},{{ '\\n ' }}{%- endif -%}\r\n {%- endfor -%}\r\n {% endif %}\r\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt_utils.get_filtered_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.968399, "supported_languages": null}, "macro.dbt_utils.unpivot": {"name": "unpivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/unpivot.sql", "original_file_path": "macros/sql/unpivot.sql", "unique_id": "macro.dbt_utils.unpivot", "macro_sql": "{% macro unpivot(relation=none, cast_to='varchar', exclude=none, remove=none, field_name='field_name', value_name='value') -%}\n {{ return(adapter.dispatch('unpivot', 'dbt_utils')(relation, cast_to, exclude, remove, field_name, value_name)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__unpivot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.969813, "supported_languages": null}, "macro.dbt_utils.default__unpivot": {"name": "default__unpivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/unpivot.sql", "original_file_path": "macros/sql/unpivot.sql", "unique_id": "macro.dbt_utils.default__unpivot", "macro_sql": "{% macro default__unpivot(relation=none, cast_to='varchar', exclude=none, remove=none, field_name='field_name', value_name='value') -%}\n\n {% if not relation %}\n {{ exceptions.raise_compiler_error(\"Error: argument `relation` is required for `unpivot` macro.\") }}\n {% endif %}\n\n {%- set exclude = exclude if exclude is not none else [] %}\n {%- set remove = remove if remove is not none else [] %}\n\n {%- set include_cols = [] %}\n\n {%- set table_columns = {} %}\n\n {%- do table_columns.update({relation: []}) %}\n\n {%- do dbt_utils._is_relation(relation, 'unpivot') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'unpivot') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) %}\n\n {%- for col in cols -%}\n {%- if col.column.lower() not in remove|map('lower') and col.column.lower() not in exclude|map('lower') -%}\n {% do include_cols.append(col) %}\n {%- endif %}\n {%- endfor %}\n\n\n {%- for col in include_cols -%}\n select\n {%- for exclude_col in exclude %}\n {{ exclude_col }},\n {%- endfor %}\n\n cast('{{ col.column }}' as {{ dbt.type_string() }}) as {{ field_name }},\n cast( {% if col.data_type == 'boolean' %}\n {{ dbt.cast_bool_to_text(col.column) }}\n {% else %}\n {{ col.column }}\n {% endif %}\n as {{ cast_to }}) as {{ value_name }}\n\n from {{ relation }}\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n {%- endfor -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.type_string", "macro.dbt.cast_bool_to_text"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.971547, "supported_languages": null}, "macro.dbt_utils.safe_divide": {"name": "safe_divide", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_divide.sql", "original_file_path": "macros/sql/safe_divide.sql", "unique_id": "macro.dbt_utils.safe_divide", "macro_sql": "{% macro safe_divide(numerator, denominator) -%}\n {{ return(adapter.dispatch('safe_divide', 'dbt_utils')(numerator, denominator)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_divide"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.971859, "supported_languages": null}, "macro.dbt_utils.default__safe_divide": {"name": "default__safe_divide", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_divide.sql", "original_file_path": "macros/sql/safe_divide.sql", "unique_id": "macro.dbt_utils.default__safe_divide", "macro_sql": "{% macro default__safe_divide(numerator, denominator) %}\n ( {{ numerator }} ) / nullif( ( {{ denominator }} ), 0)\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.972, "supported_languages": null}, "macro.dbt_utils.union_relations": {"name": "union_relations", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/union.sql", "original_file_path": "macros/sql/union.sql", "unique_id": "macro.dbt_utils.union_relations", "macro_sql": "{%- macro union_relations(relations, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_relation', where=none) -%}\n {{ return(adapter.dispatch('union_relations', 'dbt_utils')(relations, column_override, include, exclude, source_column_name, where)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__union_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9754748, "supported_languages": null}, "macro.dbt_utils.default__union_relations": {"name": "default__union_relations", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/union.sql", "original_file_path": "macros/sql/union.sql", "unique_id": "macro.dbt_utils.default__union_relations", "macro_sql": "\n\n{%- macro default__union_relations(relations, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_relation', where=none) -%}\n\n {%- if exclude and include -%}\n {{ exceptions.raise_compiler_error(\"Both an exclude and include list were provided to the `union` macro. Only one is allowed\") }}\n {%- endif -%}\n\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. -#}\n {%- if not execute %}\n {{ return('') }}\n {% endif -%}\n\n {%- set column_override = column_override if column_override is not none else {} -%}\n\n {%- set relation_columns = {} -%}\n {%- set column_superset = {} -%}\n {%- set all_excludes = [] -%}\n {%- set all_includes = [] -%}\n\n {%- if exclude -%}\n {%- for exc in exclude -%}\n {%- do all_excludes.append(exc | lower) -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- if include -%}\n {%- for inc in include -%}\n {%- do all_includes.append(inc | lower) -%}\n {%- endfor -%}\n {%- endif -%}\n\n {%- for relation in relations -%}\n\n {%- do relation_columns.update({relation: []}) -%}\n\n {%- do dbt_utils._is_relation(relation, 'union_relations') -%}\n {%- do dbt_utils._is_ephemeral(relation, 'union_relations') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) -%}\n {%- for col in cols -%}\n\n {#- If an exclude list was provided and the column is in the list, do nothing -#}\n {%- if exclude and col.column | lower in all_excludes -%}\n\n {#- If an include list was provided and the column is not in the list, do nothing -#}\n {%- elif include and col.column | lower not in all_includes -%}\n\n {#- Otherwise add the column to the column superset -#}\n {%- else -%}\n\n {#- update the list of columns in this relation -#}\n {%- do relation_columns[relation].append(col.column) -%}\n\n {%- if col.column in column_superset -%}\n\n {%- set stored = column_superset[col.column] -%}\n {%- if col.is_string() and stored.is_string() and col.string_size() > stored.string_size() -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif %}\n\n {%- else -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif -%}\n\n {%- endif -%}\n\n {%- endfor -%}\n {%- endfor -%}\n\n {%- set ordered_column_names = column_superset.keys() -%}\n {%- set dbt_command = flags.WHICH -%}\n\n\n {% if dbt_command in ['run', 'build'] %}\n {% if (include | length > 0 or exclude | length > 0) and not column_superset.keys() %}\n {%- set relations_string -%}\n {%- for relation in relations -%}\n {{ relation.name }}\n {%- if not loop.last %}, {% endif -%}\n {%- endfor -%}\n {%- endset -%}\n\n {%- set error_message -%}\n There were no columns found to union for relations {{ relations_string }}\n {%- endset -%}\n\n {{ exceptions.raise_compiler_error(error_message) }}\n {%- endif -%}\n {%- endif -%}\n\n {%- for relation in relations %}\n\n (\n select\n\n {%- if source_column_name is not none %}\n cast({{ dbt.string_literal(relation) }} as {{ dbt.type_string() }}) as {{ source_column_name }},\n {%- endif %}\n\n {% for col_name in ordered_column_names -%}\n\n {%- set col = column_superset[col_name] %}\n {%- set col_type = column_override.get(col.column, col.data_type) %}\n {%- set col_name = adapter.quote(col_name) if col_name in relation_columns[relation] else 'null' %}\n cast({{ col_name }} as {{ col_type }}) as {{ col.quoted }} {% if not loop.last %},{% endif -%}\n\n {%- endfor %}\n\n from {{ relation }}\n\n {% if where -%}\n where {{ where }}\n {%- endif %}\n )\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n\n {%- endfor -%}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral", "macro.dbt.string_literal", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9790988, "supported_languages": null}, "macro.dbt_utils.group_by": {"name": "group_by", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/groupby.sql", "original_file_path": "macros/sql/groupby.sql", "unique_id": "macro.dbt_utils.group_by", "macro_sql": "{%- macro group_by(n) -%}\n {{ return(adapter.dispatch('group_by', 'dbt_utils')(n)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__group_by"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.979412, "supported_languages": null}, "macro.dbt_utils.default__group_by": {"name": "default__group_by", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/groupby.sql", "original_file_path": "macros/sql/groupby.sql", "unique_id": "macro.dbt_utils.default__group_by", "macro_sql": "\n\n{%- macro default__group_by(n) -%}\n\n group by {% for i in range(1, n + 1) -%}\n {{ i }}{{ ',' if not loop.last }} \n {%- endfor -%}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9796789, "supported_languages": null}, "macro.dbt_utils.deduplicate": {"name": "deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.deduplicate", "macro_sql": "{%- macro deduplicate(relation, partition_by, order_by) -%}\n {{ return(adapter.dispatch('deduplicate', 'dbt_utils')(relation, partition_by, order_by)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.bigquery__deduplicate"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.980438, "supported_languages": null}, "macro.dbt_utils.default__deduplicate": {"name": "default__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.default__deduplicate", "macro_sql": "\n\n{%- macro default__deduplicate(relation, partition_by, order_by) -%}\n\n with row_numbered as (\n select\n _inner.*,\n row_number() over (\n partition by {{ partition_by }}\n order by {{ order_by }}\n ) as rn\n from {{ relation }} as _inner\n )\n\n select\n distinct data.*\n from {{ relation }} as data\n {#\n -- Not all DBs will support natural joins but the ones that do include:\n -- Oracle, MySQL, SQLite, Redshift, Teradata, Materialize, Databricks\n -- Apache Spark, SingleStore, Vertica\n -- Those that do not appear to support natural joins include:\n -- SQLServer, Trino, Presto, Rockset, Athena\n #}\n natural join row_numbered\n where row_numbered.rn = 1\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.980663, "supported_languages": null}, "macro.dbt_utils.redshift__deduplicate": {"name": "redshift__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.redshift__deduplicate", "macro_sql": "{% macro redshift__deduplicate(relation, partition_by, order_by) -%}\n\n {{ return(dbt_utils.default__deduplicate(relation, partition_by, order_by=order_by)) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__deduplicate"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.980875, "supported_languages": null}, "macro.dbt_utils.postgres__deduplicate": {"name": "postgres__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.postgres__deduplicate", "macro_sql": "\n{%- macro postgres__deduplicate(relation, partition_by, order_by) -%}\n\n select\n distinct on ({{ partition_by }}) *\n from {{ relation }}\n order by {{ partition_by }}{{ ',' ~ order_by }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.981076, "supported_languages": null}, "macro.dbt_utils.snowflake__deduplicate": {"name": "snowflake__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.snowflake__deduplicate", "macro_sql": "\n{%- macro snowflake__deduplicate(relation, partition_by, order_by) -%}\n\n select *\n from {{ relation }}\n qualify\n row_number() over (\n partition by {{ partition_by }}\n order by {{ order_by }}\n ) = 1\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.981248, "supported_languages": null}, "macro.dbt_utils.bigquery__deduplicate": {"name": "bigquery__deduplicate", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/deduplicate.sql", "original_file_path": "macros/sql/deduplicate.sql", "unique_id": "macro.dbt_utils.bigquery__deduplicate", "macro_sql": "\n{%- macro bigquery__deduplicate(relation, partition_by, order_by) -%}\n\n select unique.*\n from (\n select\n array_agg (\n original\n order by {{ order_by }}\n limit 1\n )[offset(0)] unique\n from {{ relation }} original\n group by {{ partition_by }}\n )\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.981431, "supported_languages": null}, "macro.dbt_utils.surrogate_key": {"name": "surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/surrogate_key.sql", "original_file_path": "macros/sql/surrogate_key.sql", "unique_id": "macro.dbt_utils.surrogate_key", "macro_sql": "{%- macro surrogate_key(field_list) -%}\n {% set frustrating_jinja_feature = varargs %}\n {{ return(adapter.dispatch('surrogate_key', 'dbt_utils')(field_list, *varargs)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__surrogate_key"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.981827, "supported_languages": null}, "macro.dbt_utils.default__surrogate_key": {"name": "default__surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/surrogate_key.sql", "original_file_path": "macros/sql/surrogate_key.sql", "unique_id": "macro.dbt_utils.default__surrogate_key", "macro_sql": "\n\n{%- macro default__surrogate_key(field_list) -%}\n\n{%- set error_message = '\nWarning: `dbt_utils.surrogate_key` has been replaced by \\\n`dbt_utils.generate_surrogate_key`. The new macro treats null values \\\ndifferently to empty strings. To restore the behaviour of the original \\\nmacro, add a global variable in dbt_project.yml called \\\n`surrogate_key_treat_nulls_as_empty_strings` to your \\\ndbt_project.yml file with a value of True. \\\nThe {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.raise_compiler_error(error_message) -%}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.982073, "supported_languages": null}, "macro.dbt_utils.safe_add": {"name": "safe_add", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_add.sql", "original_file_path": "macros/sql/safe_add.sql", "unique_id": "macro.dbt_utils.safe_add", "macro_sql": "{%- macro safe_add(field_list) -%}\n {{ return(adapter.dispatch('safe_add', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__safe_add"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9824588, "supported_languages": null}, "macro.dbt_utils.default__safe_add": {"name": "default__safe_add", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/safe_add.sql", "original_file_path": "macros/sql/safe_add.sql", "unique_id": "macro.dbt_utils.default__safe_add", "macro_sql": "\n\n{%- macro default__safe_add(field_list) -%}\n\n{%- if field_list is not iterable or field_list is string or field_list is mapping -%}\n\n{%- set error_message = '\nWarning: the `safe_add` macro now takes a single list argument instead of \\\nstring arguments. The {}.{} model triggered this warning. \\\n'.format(model.package_name, model.name) -%}\n\n{%- do exceptions.warn(error_message) -%}\n\n{%- endif -%}\n\n{% set fields = [] %}\n\n{%- for field in field_list -%}\n\n {% do fields.append(\"coalesce(\" ~ field ~ \", 0)\") %}\n\n{%- endfor -%}\n\n{{ fields|join(' +\\n ') }}\n\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9830232, "supported_languages": null}, "macro.dbt_utils.nullcheck": {"name": "nullcheck", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck.sql", "original_file_path": "macros/sql/nullcheck.sql", "unique_id": "macro.dbt_utils.nullcheck", "macro_sql": "{% macro nullcheck(cols) %}\n {{ return(adapter.dispatch('nullcheck', 'dbt_utils')(cols)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__nullcheck"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.983372, "supported_languages": null}, "macro.dbt_utils.default__nullcheck": {"name": "default__nullcheck", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/nullcheck.sql", "original_file_path": "macros/sql/nullcheck.sql", "unique_id": "macro.dbt_utils.default__nullcheck", "macro_sql": "{% macro default__nullcheck(cols) %}\n{%- for col in cols %}\n\n {% if col.is_string() -%}\n\n nullif({{col.name}},'') as {{col.name}}\n\n {%- else -%}\n\n {{col.name}}\n\n {%- endif -%}\n\n{%- if not loop.last -%} , {%- endif -%}\n\n{%- endfor -%}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.983721, "supported_languages": null}, "macro.dbt_utils.get_tables_by_pattern_sql": {"name": "get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.get_tables_by_pattern_sql", "macro_sql": "{% macro get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(adapter.dispatch('get_tables_by_pattern_sql', 'dbt_utils')\n (schema_pattern, table_pattern, exclude, database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.bigquery__get_tables_by_pattern_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.985545, "supported_languages": null}, "macro.dbt_utils.default__get_tables_by_pattern_sql": {"name": "default__get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.default__get_tables_by_pattern_sql", "macro_sql": "{% macro default__get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n select distinct\n table_schema as {{ adapter.quote('table_schema') }},\n table_name as {{ adapter.quote('table_name') }},\n {{ dbt_utils.get_table_types_sql() }}\n from {{ database }}.information_schema.tables\n where table_schema ilike '{{ schema_pattern }}'\n and table_name ilike '{{ table_pattern }}'\n and table_name not ilike '{{ exclude }}'\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.985922, "supported_languages": null}, "macro.dbt_utils.bigquery__get_tables_by_pattern_sql": {"name": "bigquery__get_tables_by_pattern_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils.bigquery__get_tables_by_pattern_sql", "macro_sql": "{% macro bigquery__get_tables_by_pattern_sql(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {% if '%' in schema_pattern %}\n {% set schemata=dbt_utils._bigquery__get_matching_schemata(schema_pattern, database) %}\n {% else %}\n {% set schemata=[schema_pattern] %}\n {% endif %}\n\n {% set sql %}\n {% for schema in schemata %}\n select distinct\n table_schema,\n table_name,\n {{ dbt_utils.get_table_types_sql() }}\n\n from {{ adapter.quote(database) }}.{{ schema }}.INFORMATION_SCHEMA.TABLES\n where lower(table_name) like lower ('{{ table_pattern }}')\n and lower(table_name) not like lower ('{{ exclude }}')\n\n {% if not loop.last %} union all {% endif %}\n\n {% endfor %}\n {% endset %}\n\n {{ return(sql) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._bigquery__get_matching_schemata", "macro.dbt_utils.get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9867342, "supported_languages": null}, "macro.dbt_utils._bigquery__get_matching_schemata": {"name": "_bigquery__get_matching_schemata", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_tables_by_pattern_sql.sql", "original_file_path": "macros/sql/get_tables_by_pattern_sql.sql", "unique_id": "macro.dbt_utils._bigquery__get_matching_schemata", "macro_sql": "{% macro _bigquery__get_matching_schemata(schema_pattern, database) %}\n {% if execute %}\n\n {% set sql %}\n select schema_name from {{ adapter.quote(database) }}.INFORMATION_SCHEMA.SCHEMATA\n where lower(schema_name) like lower('{{ schema_pattern }}')\n {% endset %}\n\n {% set results=run_query(sql) %}\n\n {% set schemata=results.columns['schema_name'].values() %}\n\n {{ return(schemata) }}\n\n {% else %}\n\n {{ return([]) }}\n\n {% endif %}\n\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.987264, "supported_languages": null}, "macro.dbt_utils.get_column_values": {"name": "get_column_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_column_values.sql", "original_file_path": "macros/sql/get_column_values.sql", "unique_id": "macro.dbt_utils.get_column_values", "macro_sql": "{% macro get_column_values(table, column, order_by='count(*) desc', max_records=none, default=none, where=none) -%}\n {{ return(adapter.dispatch('get_column_values', 'dbt_utils')(table, column, order_by, max_records, default, where)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_column_values"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.988491, "supported_languages": null}, "macro.dbt_utils.default__get_column_values": {"name": "default__get_column_values", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_column_values.sql", "original_file_path": "macros/sql/get_column_values.sql", "unique_id": "macro.dbt_utils.default__get_column_values", "macro_sql": "{% macro default__get_column_values(table, column, order_by='count(*) desc', max_records=none, default=none, where=none) -%}\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n {%- if not execute -%}\n {% set default = [] if not default %}\n {{ return(default) }}\n {% endif %}\n\n {%- do dbt_utils._is_ephemeral(table, 'get_column_values') -%}\n\n {# Not all relations are tables. Renaming for internal clarity without breaking functionality for anyone using named arguments #}\n {# TODO: Change the method signature in a future 0.x.0 release #}\n {%- set target_relation = table -%}\n\n {# adapter.load_relation is a convenience wrapper to avoid building a Relation when we already have one #}\n {% set relation_exists = (load_relation(target_relation)) is not none %}\n\n {%- call statement('get_column_values', fetch_result=true) %}\n\n {%- if not relation_exists and default is none -%}\n\n {{ exceptions.raise_compiler_error(\"In get_column_values(): relation \" ~ target_relation ~ \" does not exist and no default value was provided.\") }}\n\n {%- elif not relation_exists and default is not none -%}\n\n {{ log(\"Relation \" ~ target_relation ~ \" does not exist. Returning the default value: \" ~ default) }}\n\n {{ return(default) }}\n\n {%- else -%}\n\n\n select\n {{ column }} as value\n\n from {{ target_relation }}\n\n {% if where is not none %}\n where {{ where }}\n {% endif %}\n\n group by {{ column }}\n order by {{ order_by }}\n\n {% if max_records is not none %}\n limit {{ max_records }}\n {% endif %}\n\n {% endif %}\n\n {%- endcall -%}\n\n {%- set value_list = load_result('get_column_values') -%}\n\n {%- if value_list and value_list['data'] -%}\n {%- set values = value_list['data'] | map(attribute=0) | list %}\n {{ return(values) }}\n {%- else -%}\n {{ return(default) }}\n {%- endif -%}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_ephemeral", "macro.dbt.load_relation", "macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.990164, "supported_languages": null}, "macro.dbt_utils.pivot": {"name": "pivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/pivot.sql", "original_file_path": "macros/sql/pivot.sql", "unique_id": "macro.dbt_utils.pivot", "macro_sql": "{% macro pivot(column,\n values,\n alias=True,\n agg='sum',\n cmp='=',\n prefix='',\n suffix='',\n then_value=1,\n else_value=0,\n quote_identifiers=True,\n distinct=False) %}\n {{ return(adapter.dispatch('pivot', 'dbt_utils')(column, values, alias, agg, cmp, prefix, suffix, then_value, else_value, quote_identifiers, distinct)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__pivot"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.991412, "supported_languages": null}, "macro.dbt_utils.default__pivot": {"name": "default__pivot", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/pivot.sql", "original_file_path": "macros/sql/pivot.sql", "unique_id": "macro.dbt_utils.default__pivot", "macro_sql": "{% macro default__pivot(column,\n values,\n alias=True,\n agg='sum',\n cmp='=',\n prefix='',\n suffix='',\n then_value=1,\n else_value=0,\n quote_identifiers=True,\n distinct=False) %}\n {% for value in values %}\n {{ agg }}(\n {% if distinct %} distinct {% endif %}\n case\n when {{ column }} {{ cmp }} '{{ dbt.escape_single_quotes(value) }}'\n then {{ then_value }}\n else {{ else_value }}\n end\n )\n {% if alias %}\n {% if quote_identifiers %}\n as {{ adapter.quote(prefix ~ value ~ suffix) }}\n {% else %}\n as {{ dbt_utils.slugify(prefix ~ value ~ suffix) }}\n {% endif %}\n {% endif %}\n {% if not loop.last %},{% endif %}\n {% endfor %}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.escape_single_quotes", "macro.dbt_utils.slugify"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.992304, "supported_languages": null}, "macro.dbt_utils.get_filtered_columns_in_relation": {"name": "get_filtered_columns_in_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_filtered_columns_in_relation.sql", "original_file_path": "macros/sql/get_filtered_columns_in_relation.sql", "unique_id": "macro.dbt_utils.get_filtered_columns_in_relation", "macro_sql": "{% macro get_filtered_columns_in_relation(from, except=[]) -%}\n {{ return(adapter.dispatch('get_filtered_columns_in_relation', 'dbt_utils')(from, except)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_filtered_columns_in_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.992793, "supported_languages": null}, "macro.dbt_utils.default__get_filtered_columns_in_relation": {"name": "default__get_filtered_columns_in_relation", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_filtered_columns_in_relation.sql", "original_file_path": "macros/sql/get_filtered_columns_in_relation.sql", "unique_id": "macro.dbt_utils.default__get_filtered_columns_in_relation", "macro_sql": "{% macro default__get_filtered_columns_in_relation(from, except=[]) -%}\n {%- do dbt_utils._is_relation(from, 'get_filtered_columns_in_relation') -%}\n {%- do dbt_utils._is_ephemeral(from, 'get_filtered_columns_in_relation') -%}\n\n {# -- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. #}\n {%- if not execute -%}\n {{ return('') }}\n {% endif %}\n\n {%- set include_cols = [] %}\n {%- set cols = adapter.get_columns_in_relation(from) -%}\n {%- set except = except | map(\"lower\") | list %}\n {%- for col in cols -%}\n {%- if col.column|lower not in except -%}\n {% do include_cols.append(col.column) %}\n {%- endif %}\n {%- endfor %}\n\n {{ return(include_cols) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt_utils._is_ephemeral"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9935648, "supported_languages": null}, "macro.dbt_utils.width_bucket": {"name": "width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.width_bucket", "macro_sql": "{% macro width_bucket(expr, min_value, max_value, num_buckets) %}\n {{ return(adapter.dispatch('width_bucket', 'dbt_utils') (expr, min_value, max_value, num_buckets)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__width_bucket"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.99437, "supported_languages": null}, "macro.dbt_utils.default__width_bucket": {"name": "default__width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.default__width_bucket", "macro_sql": "{% macro default__width_bucket(expr, min_value, max_value, num_buckets) -%}\n\n {% set bin_size -%}\n (( {{ max_value }} - {{ min_value }} ) / {{ num_buckets }} )\n {%- endset %}\n (\n -- to break ties when the amount is eaxtly at the bucket egde\n case\n when\n mod(\n {{ dbt.safe_cast(expr, dbt.type_numeric() ) }},\n {{ dbt.safe_cast(bin_size, dbt.type_numeric() ) }}\n ) = 0\n then 1\n else 0\n end\n ) +\n -- Anything over max_value goes the N+1 bucket\n least(\n ceil(\n ({{ expr }} - {{ min_value }})/{{ bin_size }}\n ),\n {{ num_buckets }} + 1\n )\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt.safe_cast", "macro.dbt.type_numeric"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.994858, "supported_languages": null}, "macro.dbt_utils.snowflake__width_bucket": {"name": "snowflake__width_bucket", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/width_bucket.sql", "original_file_path": "macros/sql/width_bucket.sql", "unique_id": "macro.dbt_utils.snowflake__width_bucket", "macro_sql": "{% macro snowflake__width_bucket(expr, min_value, max_value, num_buckets) %}\n width_bucket({{ expr }}, {{ min_value }}, {{ max_value }}, {{ num_buckets }} )\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9950552, "supported_languages": null}, "macro.dbt_utils.get_query_results_as_dict": {"name": "get_query_results_as_dict", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_query_results_as_dict.sql", "original_file_path": "macros/sql/get_query_results_as_dict.sql", "unique_id": "macro.dbt_utils.get_query_results_as_dict", "macro_sql": "{% macro get_query_results_as_dict(query) %}\n {{ return(adapter.dispatch('get_query_results_as_dict', 'dbt_utils')(query)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_query_results_as_dict"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.995465, "supported_languages": null}, "macro.dbt_utils.default__get_query_results_as_dict": {"name": "default__get_query_results_as_dict", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_query_results_as_dict.sql", "original_file_path": "macros/sql/get_query_results_as_dict.sql", "unique_id": "macro.dbt_utils.default__get_query_results_as_dict", "macro_sql": "{% macro default__get_query_results_as_dict(query) %}\n\n{# This macro returns a dictionary of the form {column_name: (tuple_of_results)} #}\n\n {%- call statement('get_query_results', fetch_result=True,auto_begin=false) -%}\n\n {{ query }}\n\n {%- endcall -%}\n\n {% set sql_results={} %}\n\n {%- if execute -%}\n {% set sql_results_table = load_result('get_query_results').table.columns %}\n {% for column_name, column in sql_results_table.items() %}\n {% do sql_results.update({column_name: column.values()}) %}\n {% endfor %}\n {%- endif -%}\n\n {{ return(sql_results) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.996145, "supported_languages": null}, "macro.dbt_utils.generate_surrogate_key": {"name": "generate_surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_surrogate_key.sql", "original_file_path": "macros/sql/generate_surrogate_key.sql", "unique_id": "macro.dbt_utils.generate_surrogate_key", "macro_sql": "{%- macro generate_surrogate_key(field_list) -%}\n {{ return(adapter.dispatch('generate_surrogate_key', 'dbt_utils')(field_list)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__generate_surrogate_key"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.99664, "supported_languages": null}, "macro.dbt_utils.default__generate_surrogate_key": {"name": "default__generate_surrogate_key", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/generate_surrogate_key.sql", "original_file_path": "macros/sql/generate_surrogate_key.sql", "unique_id": "macro.dbt_utils.default__generate_surrogate_key", "macro_sql": "\n\n{%- macro default__generate_surrogate_key(field_list) -%}\n\n{%- if var('surrogate_key_treat_nulls_as_empty_strings', False) -%}\n {%- set default_null_value = \"\" -%}\n{%- else -%}\n {%- set default_null_value = '_dbt_utils_surrogate_key_null_' -%}\n{%- endif -%}\n\n{%- set fields = [] -%}\n\n{%- for field in field_list -%}\n\n {%- do fields.append(\n \"coalesce(cast(\" ~ field ~ \" as \" ~ dbt.type_string() ~ \"), '\" ~ default_null_value ~\"')\"\n ) -%}\n\n {%- if not loop.last %}\n {%- do fields.append(\"'-'\") -%}\n {%- endif -%}\n\n{%- endfor -%}\n\n{{ dbt.hash(dbt.concat(fields)) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt.type_string", "macro.dbt.hash", "macro.dbt.concat"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.997308, "supported_languages": null}, "macro.dbt_utils.get_table_types_sql": {"name": "get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.get_table_types_sql", "macro_sql": "{%- macro get_table_types_sql() -%}\n {{ return(adapter.dispatch('get_table_types_sql', 'dbt_utils')()) }}\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_utils.default__get_table_types_sql"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.997874, "supported_languages": null}, "macro.dbt_utils.default__get_table_types_sql": {"name": "default__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.default__get_table_types_sql", "macro_sql": "{% macro default__get_table_types_sql() %}\n case table_type\n when 'BASE TABLE' then 'table'\n when 'EXTERNAL TABLE' then 'external'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.998029, "supported_languages": null}, "macro.dbt_utils.postgres__get_table_types_sql": {"name": "postgres__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.postgres__get_table_types_sql", "macro_sql": "{% macro postgres__get_table_types_sql() %}\n case table_type\n when 'BASE TABLE' then 'table'\n when 'FOREIGN' then 'external'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.998176, "supported_languages": null}, "macro.dbt_utils.databricks__get_table_types_sql": {"name": "databricks__get_table_types_sql", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_table_types_sql.sql", "original_file_path": "macros/sql/get_table_types_sql.sql", "unique_id": "macro.dbt_utils.databricks__get_table_types_sql", "macro_sql": "{% macro databricks__get_table_types_sql() %}\n case table_type\n when 'MANAGED' then 'table'\n when 'BASE TABLE' then 'table'\n when 'MATERIALIZED VIEW' then 'materializedview'\n else lower(table_type)\n end as {{ adapter.quote('table_type') }}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9983191, "supported_languages": null}, "macro.dbt_utils.get_single_value": {"name": "get_single_value", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_single_value.sql", "original_file_path": "macros/sql/get_single_value.sql", "unique_id": "macro.dbt_utils.get_single_value", "macro_sql": "{% macro get_single_value(query, default=none) %}\n {{ return(adapter.dispatch('get_single_value', 'dbt_utils')(query, default)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.default__get_single_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.998862, "supported_languages": null}, "macro.dbt_utils.default__get_single_value": {"name": "default__get_single_value", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/get_single_value.sql", "original_file_path": "macros/sql/get_single_value.sql", "unique_id": "macro.dbt_utils.default__get_single_value", "macro_sql": "{% macro default__get_single_value(query, default) %}\n\n{# This macro returns the (0, 0) record in a query, i.e. the first row of the first column #}\n\n {%- call statement('get_query_result', fetch_result=True, auto_begin=false) -%}\n\n {{ query }}\n\n {%- endcall -%}\n\n {%- if execute -%}\n\n {% set r = load_result('get_query_result').table.columns[0].values() %}\n {% if r | length == 0 %}\n {% do print('Query `' ~ query ~ '` returned no rows. Using the default value: ' ~ default) %}\n {% set sql_result = default %}\n {% else %}\n {% set sql_result = r[0] %}\n {% endif %}\n \n {%- else -%}\n \n {% set sql_result = default %}\n \n {%- endif -%}\n\n {% do return(sql_result) %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220402.9997308, "supported_languages": null}, "macro.dbt_utils.degrees_to_radians": {"name": "degrees_to_radians", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.degrees_to_radians", "macro_sql": "{% macro degrees_to_radians(degrees) -%}\n acos(-1) * {{degrees}} / 180\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.00083, "supported_languages": null}, "macro.dbt_utils.haversine_distance": {"name": "haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.haversine_distance", "macro_sql": "{% macro haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n {{ return(adapter.dispatch('haversine_distance', 'dbt_utils')(lat1,lon1,lat2,lon2,unit)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.bigquery__haversine_distance"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.001125, "supported_languages": null}, "macro.dbt_utils.default__haversine_distance": {"name": "default__haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.default__haversine_distance", "macro_sql": "{% macro default__haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n{%- if unit == 'mi' %}\n {% set conversion_rate = 1 %}\n{% elif unit == 'km' %}\n {% set conversion_rate = 1.60934 %}\n{% else %}\n {{ exceptions.raise_compiler_error(\"unit input must be one of 'mi' or 'km'. Got \" ~ unit) }}\n{% endif %}\n\n 2 * 3961 * asin(sqrt(power((sin(radians(({{ lat2 }} - {{ lat1 }}) / 2))), 2) +\n cos(radians({{lat1}})) * cos(radians({{lat2}})) *\n power((sin(radians(({{ lon2 }} - {{ lon1 }}) / 2))), 2))) * {{ conversion_rate }}\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0017228, "supported_languages": null}, "macro.dbt_utils.bigquery__haversine_distance": {"name": "bigquery__haversine_distance", "resource_type": "macro", "package_name": "dbt_utils", "path": "macros/sql/haversine_distance.sql", "original_file_path": "macros/sql/haversine_distance.sql", "unique_id": "macro.dbt_utils.bigquery__haversine_distance", "macro_sql": "{% macro bigquery__haversine_distance(lat1, lon1, lat2, lon2, unit='mi') -%}\n{% set radians_lat1 = dbt_utils.degrees_to_radians(lat1) %}\n{% set radians_lat2 = dbt_utils.degrees_to_radians(lat2) %}\n{% set radians_lon1 = dbt_utils.degrees_to_radians(lon1) %}\n{% set radians_lon2 = dbt_utils.degrees_to_radians(lon2) %}\n{%- if unit == 'mi' %}\n {% set conversion_rate = 1 %}\n{% elif unit == 'km' %}\n {% set conversion_rate = 1.60934 %}\n{% else %}\n {{ exceptions.raise_compiler_error(\"unit input must be one of 'mi' or 'km'. Got \" ~ unit) }}\n{% endif %}\n 2 * 3961 * asin(sqrt(power(sin(({{ radians_lat2 }} - {{ radians_lat1 }}) / 2), 2) +\n cos({{ radians_lat1 }}) * cos({{ radians_lat2 }}) *\n power(sin(({{ radians_lon2 }} - {{ radians_lon1 }}) / 2), 2))) * {{ conversion_rate }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.degrees_to_radians"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.002562, "supported_languages": null}, "macro.spark_utils.get_tables": {"name": "get_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_tables", "macro_sql": "{% macro get_tables(table_regex_pattern='.*') %}\n\n {% set tables = [] %}\n {% for database in spark__list_schemas('not_used') %}\n {% for table in spark__list_relations_without_caching(database[0]) %}\n {% set db_tablename = database[0] ~ \".\" ~ table[1] %}\n {% set is_match = modules.re.match(table_regex_pattern, db_tablename) %}\n {% if is_match %}\n {% call statement('table_detail', fetch_result=True) -%}\n describe extended {{ db_tablename }}\n {% endcall %}\n\n {% set table_type = load_result('table_detail').table|reverse|selectattr(0, 'in', ('type', 'TYPE', 'Type'))|first %}\n {% if table_type[1]|lower != 'view' %}\n {{ tables.append(db_tablename) }}\n {% endif %}\n {% endif %}\n {% endfor %}\n {% endfor %}\n {{ return(tables) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.008245, "supported_languages": null}, "macro.spark_utils.get_delta_tables": {"name": "get_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_delta_tables", "macro_sql": "{% macro get_delta_tables(table_regex_pattern='.*') %}\n\n {% set delta_tables = [] %}\n {% for db_tablename in get_tables(table_regex_pattern) %}\n {% call statement('table_detail', fetch_result=True) -%}\n describe extended {{ db_tablename }}\n {% endcall %}\n\n {% set table_type = load_result('table_detail').table|reverse|selectattr(0, 'in', ('provider', 'PROVIDER', 'Provider'))|first %}\n {% if table_type[1]|lower == 'delta' %}\n {{ delta_tables.append(db_tablename) }}\n {% endif %}\n {% endfor %}\n {{ return(delta_tables) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_tables", "macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.008987, "supported_languages": null}, "macro.spark_utils.get_statistic_columns": {"name": "get_statistic_columns", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.get_statistic_columns", "macro_sql": "{% macro get_statistic_columns(table) %}\n\n {% call statement('input_columns', fetch_result=True) %}\n SHOW COLUMNS IN {{ table }}\n {% endcall %}\n {% set input_columns = load_result('input_columns').table %}\n\n {% set output_columns = [] %}\n {% for column in input_columns %}\n {% call statement('column_information', fetch_result=True) %}\n DESCRIBE TABLE {{ table }} `{{ column[0] }}`\n {% endcall %}\n {% if not load_result('column_information').table[1][1].startswith('struct') and not load_result('column_information').table[1][1].startswith('array') %}\n {{ output_columns.append('`' ~ column[0] ~ '`') }}\n {% endif %}\n {% endfor %}\n {{ return(output_columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.009928, "supported_languages": null}, "macro.spark_utils.spark_optimize_delta_tables": {"name": "spark_optimize_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_optimize_delta_tables", "macro_sql": "{% macro spark_optimize_delta_tables(table_regex_pattern='.*') %}\n\n {% for table in get_delta_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Optimizing \" ~ table) }}\n {% do run_query(\"optimize \" ~ table) %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_delta_tables", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.010703, "supported_languages": null}, "macro.spark_utils.spark_vacuum_delta_tables": {"name": "spark_vacuum_delta_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_vacuum_delta_tables", "macro_sql": "{% macro spark_vacuum_delta_tables(table_regex_pattern='.*') %}\n\n {% for table in get_delta_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Vacuuming \" ~ table) }}\n {% do run_query(\"vacuum \" ~ table) %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_delta_tables", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.011477, "supported_languages": null}, "macro.spark_utils.spark_analyze_tables": {"name": "spark_analyze_tables", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/maintenance_operation.sql", "original_file_path": "macros/maintenance_operation.sql", "unique_id": "macro.spark_utils.spark_analyze_tables", "macro_sql": "{% macro spark_analyze_tables(table_regex_pattern='.*') %}\n\n {% for table in get_tables(table_regex_pattern) %}\n {% set start=modules.datetime.datetime.now() %}\n {% set columns = get_statistic_columns(table) | join(',') %}\n {% set message_prefix=loop.index ~ \" of \" ~ loop.length %}\n {{ dbt_utils.log_info(message_prefix ~ \" Analyzing \" ~ table) }}\n {% if columns != '' %}\n {% do run_query(\"analyze table \" ~ table ~ \" compute statistics for columns \" ~ columns) %}\n {% endif %}\n {% set end=modules.datetime.datetime.now() %}\n {% set total_seconds = (end - start).total_seconds() | round(2) %}\n {{ dbt_utils.log_info(message_prefix ~ \" Finished \" ~ table ~ \" in \" ~ total_seconds ~ \"s\") }}\n {% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.get_tables", "macro.spark_utils.get_statistic_columns", "macro.dbt_utils.log_info", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.012492, "supported_languages": null}, "macro.spark_utils.spark__concat": {"name": "spark__concat", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/concat.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/concat.sql", "unique_id": "macro.spark_utils.spark__concat", "macro_sql": "{% macro spark__concat(fields) -%}\n concat({{ fields|join(', ') }})\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.012685, "supported_languages": null}, "macro.spark_utils.spark__type_numeric": {"name": "spark__type_numeric", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/datatypes.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/datatypes.sql", "unique_id": "macro.spark_utils.spark__type_numeric", "macro_sql": "{% macro spark__type_numeric() %}\n decimal(28, 6)\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.012799, "supported_languages": null}, "macro.spark_utils.spark__dateadd": {"name": "spark__dateadd", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/dateadd.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/dateadd.sql", "unique_id": "macro.spark_utils.spark__dateadd", "macro_sql": "{% macro spark__dateadd(datepart, interval, from_date_or_timestamp) %}\n\n {%- set clock_component -%}\n {# make sure the dates + timestamps are real, otherwise raise an error asap #}\n to_unix_timestamp({{ spark_utils.assert_not_null('to_timestamp', from_date_or_timestamp) }})\n - to_unix_timestamp({{ spark_utils.assert_not_null('date', from_date_or_timestamp) }})\n {%- endset -%}\n\n {%- if datepart in ['day', 'week'] -%}\n \n {%- set multiplier = 7 if datepart == 'week' else 1 -%}\n\n to_timestamp(\n to_unix_timestamp(\n date_add(\n {{ spark_utils.assert_not_null('date', from_date_or_timestamp) }},\n cast({{interval}} * {{multiplier}} as int)\n )\n ) + {{clock_component}}\n )\n\n {%- elif datepart in ['month', 'quarter', 'year'] -%}\n \n {%- set multiplier -%} \n {%- if datepart == 'month' -%} 1\n {%- elif datepart == 'quarter' -%} 3\n {%- elif datepart == 'year' -%} 12\n {%- endif -%}\n {%- endset -%}\n\n to_timestamp(\n to_unix_timestamp(\n add_months(\n {{ spark_utils.assert_not_null('date', from_date_or_timestamp) }},\n cast({{interval}} * {{multiplier}} as int)\n )\n ) + {{clock_component}}\n )\n\n {%- elif datepart in ('hour', 'minute', 'second', 'millisecond', 'microsecond') -%}\n \n {%- set multiplier -%} \n {%- if datepart == 'hour' -%} 3600\n {%- elif datepart == 'minute' -%} 60\n {%- elif datepart == 'second' -%} 1\n {%- elif datepart == 'millisecond' -%} (1/1000000)\n {%- elif datepart == 'microsecond' -%} (1/1000000)\n {%- endif -%}\n {%- endset -%}\n\n to_timestamp(\n {{ spark_utils.assert_not_null('to_unix_timestamp', from_date_or_timestamp) }}\n + cast({{interval}} * {{multiplier}} as int)\n )\n\n {%- else -%}\n\n {{ exceptions.raise_compiler_error(\"macro dateadd not implemented for datepart ~ '\" ~ datepart ~ \"' ~ on Spark\") }}\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.015887, "supported_languages": null}, "macro.spark_utils.spark__datediff": {"name": "spark__datediff", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/datediff.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/datediff.sql", "unique_id": "macro.spark_utils.spark__datediff", "macro_sql": "{% macro spark__datediff(first_date, second_date, datepart) %}\n\n {%- if datepart in ['day', 'week', 'month', 'quarter', 'year'] -%}\n \n {# make sure the dates are real, otherwise raise an error asap #}\n {% set first_date = spark_utils.assert_not_null('date', first_date) %}\n {% set second_date = spark_utils.assert_not_null('date', second_date) %}\n \n {%- endif -%}\n \n {%- if datepart == 'day' -%}\n \n datediff({{second_date}}, {{first_date}})\n \n {%- elif datepart == 'week' -%}\n \n case when {{first_date}} < {{second_date}}\n then floor(datediff({{second_date}}, {{first_date}})/7)\n else ceil(datediff({{second_date}}, {{first_date}})/7)\n end\n \n -- did we cross a week boundary (Sunday)?\n + case\n when {{first_date}} < {{second_date}} and dayofweek({{second_date}}) < dayofweek({{first_date}}) then 1\n when {{first_date}} > {{second_date}} and dayofweek({{second_date}}) > dayofweek({{first_date}}) then -1\n else 0 end\n\n {%- elif datepart == 'month' -%}\n\n case when {{first_date}} < {{second_date}}\n then floor(months_between(date({{second_date}}), date({{first_date}})))\n else ceil(months_between(date({{second_date}}), date({{first_date}})))\n end\n \n -- did we cross a month boundary?\n + case\n when {{first_date}} < {{second_date}} and dayofmonth({{second_date}}) < dayofmonth({{first_date}}) then 1\n when {{first_date}} > {{second_date}} and dayofmonth({{second_date}}) > dayofmonth({{first_date}}) then -1\n else 0 end\n \n {%- elif datepart == 'quarter' -%}\n \n case when {{first_date}} < {{second_date}}\n then floor(months_between(date({{second_date}}), date({{first_date}}))/3)\n else ceil(months_between(date({{second_date}}), date({{first_date}}))/3)\n end\n \n -- did we cross a quarter boundary?\n + case\n when {{first_date}} < {{second_date}} and (\n (dayofyear({{second_date}}) - (quarter({{second_date}}) * 365/4))\n < (dayofyear({{first_date}}) - (quarter({{first_date}}) * 365/4))\n ) then 1\n when {{first_date}} > {{second_date}} and (\n (dayofyear({{second_date}}) - (quarter({{second_date}}) * 365/4))\n > (dayofyear({{first_date}}) - (quarter({{first_date}}) * 365/4))\n ) then -1\n else 0 end\n\n {%- elif datepart == 'year' -%}\n \n year({{second_date}}) - year({{first_date}})\n\n {%- elif datepart in ('hour', 'minute', 'second', 'millisecond', 'microsecond') -%}\n \n {%- set divisor -%} \n {%- if datepart == 'hour' -%} 3600\n {%- elif datepart == 'minute' -%} 60\n {%- elif datepart == 'second' -%} 1\n {%- elif datepart == 'millisecond' -%} (1/1000)\n {%- elif datepart == 'microsecond' -%} (1/1000000)\n {%- endif -%}\n {%- endset -%}\n\n case when {{first_date}} < {{second_date}}\n then ceil((\n {# make sure the timestamps are real, otherwise raise an error asap #}\n {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', second_date)) }}\n - {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', first_date)) }}\n ) / {{divisor}})\n else floor((\n {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', second_date)) }}\n - {{ spark_utils.assert_not_null('to_unix_timestamp', spark_utils.assert_not_null('to_timestamp', first_date)) }}\n ) / {{divisor}})\n end\n \n {% if datepart == 'millisecond' %}\n + cast(date_format({{second_date}}, 'SSS') as int)\n - cast(date_format({{first_date}}, 'SSS') as int)\n {% endif %}\n \n {% if datepart == 'microsecond' %} \n {% set capture_str = '[0-9]{4}-[0-9]{2}-[0-9]{2}.[0-9]{2}:[0-9]{2}:[0-9]{2}.([0-9]{6})' %}\n -- Spark doesn't really support microseconds, so this is a massive hack!\n -- It will only work if the timestamp-string is of the format\n -- 'yyyy-MM-dd-HH mm.ss.SSSSSS'\n + cast(regexp_extract({{second_date}}, '{{capture_str}}', 1) as int)\n - cast(regexp_extract({{first_date}}, '{{capture_str}}', 1) as int) \n {% endif %}\n\n {%- else -%}\n\n {{ exceptions.raise_compiler_error(\"macro datediff not implemented for datepart ~ '\" ~ datepart ~ \"' ~ on Spark\") }}\n\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.024101, "supported_languages": null}, "macro.spark_utils.spark__current_timestamp": {"name": "spark__current_timestamp", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "unique_id": "macro.spark_utils.spark__current_timestamp", "macro_sql": "{% macro spark__current_timestamp() %}\n current_timestamp()\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0242481, "supported_languages": null}, "macro.spark_utils.spark__current_timestamp_in_utc": {"name": "spark__current_timestamp_in_utc", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/current_timestamp.sql", "unique_id": "macro.spark_utils.spark__current_timestamp_in_utc", "macro_sql": "{% macro spark__current_timestamp_in_utc() %}\n unix_timestamp()\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0243258, "supported_languages": null}, "macro.spark_utils.spark__split_part": {"name": "spark__split_part", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/cross_db_utils/split_part.sql", "original_file_path": "macros/dbt_utils/cross_db_utils/split_part.sql", "unique_id": "macro.spark_utils.spark__split_part", "macro_sql": "{% macro spark__split_part(string_text, delimiter_text, part_number) %}\n\n {% set delimiter_expr %}\n \n -- escape if starts with a special character\n case when regexp_extract({{ delimiter_text }}, '([^A-Za-z0-9])(.*)', 1) != '_'\n then concat('\\\\', {{ delimiter_text }})\n else {{ delimiter_text }} end\n \n {% endset %}\n\n {% set split_part_expr %}\n \n split(\n {{ string_text }},\n {{ delimiter_expr }}\n )[({{ part_number - 1 }})]\n \n {% endset %}\n \n {{ return(split_part_expr) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.024926, "supported_languages": null}, "macro.spark_utils.spark__get_relations_by_pattern": {"name": "spark__get_relations_by_pattern", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_relations_by_pattern", "macro_sql": "{% macro spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n\n {%- call statement('get_tables', fetch_result=True) %}\n\n show table extended in {{ schema_pattern }} like '{{ table_pattern }}'\n\n {%- endcall -%}\n\n {%- set table_list = load_result('get_tables') -%}\n\n {%- if table_list and table_list['table'] -%}\n {%- set tbl_relations = [] -%}\n {%- for row in table_list['table'] -%}\n {%- set tbl_relation = api.Relation.create(\n database=None,\n schema=row[0],\n identifier=row[1],\n type=('view' if 'Type: VIEW' in row[3] else 'table')\n ) -%}\n {%- do tbl_relations.append(tbl_relation) -%}\n {%- endfor -%}\n\n {{ return(tbl_relations) }}\n {%- else -%}\n {{ return([]) }}\n {%- endif -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.026578, "supported_languages": null}, "macro.spark_utils.spark__get_relations_by_prefix": {"name": "spark__get_relations_by_prefix", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_relations_by_prefix", "macro_sql": "{% macro spark__get_relations_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {% set table_pattern = table_pattern ~ '*' %}\n {{ return(spark_utils.spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.026935, "supported_languages": null}, "macro.spark_utils.spark__get_tables_by_pattern": {"name": "spark__get_tables_by_pattern", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_tables_by_pattern", "macro_sql": "{% macro spark__get_tables_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(spark_utils.spark__get_relations_by_pattern(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_pattern"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.027224, "supported_languages": null}, "macro.spark_utils.spark__get_tables_by_prefix": {"name": "spark__get_tables_by_prefix", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "original_file_path": "macros/dbt_utils/sql/get_relations_by_prefix.sql", "unique_id": "macro.spark_utils.spark__get_tables_by_prefix", "macro_sql": "{% macro spark__get_tables_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database) %}\n {{ return(spark_utils.spark__get_relations_by_prefix(schema_pattern, table_pattern, exclude='', database=target.database)) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.spark_utils.spark__get_relations_by_prefix"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0275111, "supported_languages": null}, "macro.spark_utils.assert_not_null": {"name": "assert_not_null", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/etc/assert_not_null.sql", "original_file_path": "macros/etc/assert_not_null.sql", "unique_id": "macro.spark_utils.assert_not_null", "macro_sql": "{% macro assert_not_null(function, arg) -%}\n {{ return(adapter.dispatch('assert_not_null', 'spark_utils')(function, arg)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.spark_utils.default__assert_not_null"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0278559, "supported_languages": null}, "macro.spark_utils.default__assert_not_null": {"name": "default__assert_not_null", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/etc/assert_not_null.sql", "original_file_path": "macros/etc/assert_not_null.sql", "unique_id": "macro.spark_utils.default__assert_not_null", "macro_sql": "{% macro default__assert_not_null(function, arg) %}\n\n coalesce({{function}}({{arg}}), nvl2({{function}}({{arg}}), assert_true({{function}}({{arg}}) is not null), null))\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.028064, "supported_languages": null}, "macro.spark_utils.spark__convert_timezone": {"name": "spark__convert_timezone", "resource_type": "macro", "package_name": "spark_utils", "path": "macros/snowplow/convert_timezone.sql", "original_file_path": "macros/snowplow/convert_timezone.sql", "unique_id": "macro.spark_utils.spark__convert_timezone", "macro_sql": "{% macro spark__convert_timezone(in_tz, out_tz, in_timestamp) %}\n from_utc_timestamp(to_utc_timestamp({{in_timestamp}}, {{in_tz}}), {{out_tz}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0282722, "supported_languages": null}, "macro.fivetran_utils.enabled_vars": {"name": "enabled_vars", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/enabled_vars.sql", "original_file_path": "macros/enabled_vars.sql", "unique_id": "macro.fivetran_utils.enabled_vars", "macro_sql": "{% macro enabled_vars(vars) %}\n\n{% for v in vars %}\n \n {% if var(v, True) == False %}\n {{ return(False) }}\n {% endif %}\n\n{% endfor %}\n\n{{ return(True) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.028688, "supported_languages": null}, "macro.fivetran_utils.percentile": {"name": "percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.percentile", "macro_sql": "{% macro percentile(percentile_field, partition_field, percent) -%}\n\n{{ adapter.dispatch('percentile', 'fivetran_utils') (percentile_field, partition_field, percent) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__percentile"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.029666, "supported_languages": null}, "macro.fivetran_utils.default__percentile": {"name": "default__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.default__percentile", "macro_sql": "{% macro default__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n over ( partition by {{ partition_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.029842, "supported_languages": null}, "macro.fivetran_utils.redshift__percentile": {"name": "redshift__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.redshift__percentile", "macro_sql": "{% macro redshift__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n over ( partition by {{ partition_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.030012, "supported_languages": null}, "macro.fivetran_utils.bigquery__percentile": {"name": "bigquery__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.bigquery__percentile", "macro_sql": "{% macro bigquery__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percentile_field }}, \n {{ percent }}) \n over (partition by {{ partition_field }} \n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.030182, "supported_languages": null}, "macro.fivetran_utils.postgres__percentile": {"name": "postgres__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.postgres__percentile", "macro_sql": "{% macro postgres__percentile(percentile_field, partition_field, percent) %}\n\n percentile_cont( \n {{ percent }} )\n within group ( order by {{ percentile_field }} )\n /* have to group by partition field */\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0303319, "supported_languages": null}, "macro.fivetran_utils.spark__percentile": {"name": "spark__percentile", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/percentile.sql", "original_file_path": "macros/percentile.sql", "unique_id": "macro.fivetran_utils.spark__percentile", "macro_sql": "{% macro spark__percentile(percentile_field, partition_field, percent) %}\n\n percentile( \n {{ percentile_field }}, \n {{ percent }}) \n over (partition by {{ partition_field }} \n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0305011, "supported_languages": null}, "macro.fivetran_utils.pivot_json_extract": {"name": "pivot_json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/pivot_json_extract.sql", "original_file_path": "macros/pivot_json_extract.sql", "unique_id": "macro.fivetran_utils.pivot_json_extract", "macro_sql": "{% macro pivot_json_extract(string, list_of_properties) %}\n\n{%- for property in list_of_properties -%}\n{%- if property is mapping -%}\nreplace( {{ fivetran_utils.json_extract(string, property.name) }}, '\"', '') as {{ property.alias if property.alias else property.name | replace(' ', '_') | replace('.', '_') | lower }}\n\n{%- else -%}\nreplace( {{ fivetran_utils.json_extract(string, property) }}, '\"', '') as {{ property | replace(' ', '_') | lower }}\n\n{%- endif -%}\n{%- if not loop.last -%},{%- endif %}\n{% endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.json_extract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.031549, "supported_languages": null}, "macro.fivetran_utils.persist_pass_through_columns": {"name": "persist_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/persist_pass_through_columns.sql", "original_file_path": "macros/persist_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.persist_pass_through_columns", "macro_sql": "{% macro persist_pass_through_columns(pass_through_variable, identifier=none, transform='') %}\n\n{% if var(pass_through_variable, none) %}\n {% for field in var(pass_through_variable) %}\n , {{ transform ~ '(' ~ (identifier ~ '.' if identifier else '') ~ (field.alias if field.alias else field.name) ~ ')' }} as {{ field.alias if field.alias else field.name }}\n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.032219, "supported_languages": null}, "macro.fivetran_utils.json_parse": {"name": "json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.json_parse", "macro_sql": "{% macro json_parse(string, string_path) -%}\n\n{{ adapter.dispatch('json_parse', 'fivetran_utils') (string, string_path) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__json_parse"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.033622, "supported_languages": null}, "macro.fivetran_utils.default__json_parse": {"name": "default__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.default__json_parse", "macro_sql": "{% macro default__json_parse(string, string_path) %}\n\n json_extract_path_text({{string}}, {%- for s in string_path -%}'{{ s }}'{%- if not loop.last -%},{%- endif -%}{%- endfor -%} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.033878, "supported_languages": null}, "macro.fivetran_utils.redshift__json_parse": {"name": "redshift__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.redshift__json_parse", "macro_sql": "{% macro redshift__json_parse(string, string_path) %}\n\n json_extract_path_text({{string}}, {%- for s in string_path -%}'{{ s }}'{%- if not loop.last -%},{%- endif -%}{%- endfor -%} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.034137, "supported_languages": null}, "macro.fivetran_utils.bigquery__json_parse": {"name": "bigquery__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.bigquery__json_parse", "macro_sql": "{% macro bigquery__json_parse(string, string_path) %}\n\n \n json_extract_scalar({{string}}, '$.{%- for s in string_path -%}{{ s }}{%- if not loop.last -%}.{%- endif -%}{%- endfor -%} ')\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.034385, "supported_languages": null}, "macro.fivetran_utils.postgres__json_parse": {"name": "postgres__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.postgres__json_parse", "macro_sql": "{% macro postgres__json_parse(string, string_path) %}\n\n {{string}}::json #>> '{ {%- for s in string_path -%}{{ s }}{%- if not loop.last -%},{%- endif -%}{%- endfor -%} }'\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.034637, "supported_languages": null}, "macro.fivetran_utils.snowflake__json_parse": {"name": "snowflake__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.snowflake__json_parse", "macro_sql": "{% macro snowflake__json_parse(string, string_path) %}\n\n parse_json( {{string}} ) {%- for s in string_path -%}{% if s is number %}[{{ s }}]{% else %}['{{ s }}']{% endif %}{%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.034909, "supported_languages": null}, "macro.fivetran_utils.spark__json_parse": {"name": "spark__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.spark__json_parse", "macro_sql": "{% macro spark__json_parse(string, string_path) %}\n\n {{string}} : {%- for s in string_path -%}{% if s is number %}[{{ s }}]{% else %}['{{ s }}']{% endif %}{%- endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0351849, "supported_languages": null}, "macro.fivetran_utils.sqlserver__json_parse": {"name": "sqlserver__json_parse", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_parse.sql", "original_file_path": "macros/json_parse.sql", "unique_id": "macro.fivetran_utils.sqlserver__json_parse", "macro_sql": "{% macro sqlserver__json_parse(string, string_path) %}\n\n json_value({{string}}, '$.{%- for s in string_path -%}{{ s }}{%- if not loop.last -%}.{%- endif -%}{%- endfor -%} ')\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.035431, "supported_languages": null}, "macro.fivetran_utils.max_bool": {"name": "max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.max_bool", "macro_sql": "{% macro max_bool(boolean_field) -%}\n\n{{ adapter.dispatch('max_bool', 'fivetran_utils') (boolean_field) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__max_bool"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0357609, "supported_languages": null}, "macro.fivetran_utils.default__max_bool": {"name": "default__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.default__max_bool", "macro_sql": "{% macro default__max_bool(boolean_field) %}\n\n bool_or( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.035867, "supported_languages": null}, "macro.fivetran_utils.snowflake__max_bool": {"name": "snowflake__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.snowflake__max_bool", "macro_sql": "{% macro snowflake__max_bool(boolean_field) %}\n\n max( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.03597, "supported_languages": null}, "macro.fivetran_utils.bigquery__max_bool": {"name": "bigquery__max_bool", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/max_bool.sql", "original_file_path": "macros/max_bool.sql", "unique_id": "macro.fivetran_utils.bigquery__max_bool", "macro_sql": "{% macro bigquery__max_bool(boolean_field) %}\n\n max( {{ boolean_field }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0360708, "supported_languages": null}, "macro.fivetran_utils.calculated_fields": {"name": "calculated_fields", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/calculated_fields.sql", "original_file_path": "macros/calculated_fields.sql", "unique_id": "macro.fivetran_utils.calculated_fields", "macro_sql": "{% macro calculated_fields(variable) -%}\n\n{% if var(variable, none) %}\n {% for field in var(variable) %}\n , {{ field.transform_sql }} as {{ field.name }} \n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.036452, "supported_languages": null}, "macro.fivetran_utils.drop_schemas_automation": {"name": "drop_schemas_automation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/drop_schemas_automation.sql", "original_file_path": "macros/drop_schemas_automation.sql", "unique_id": "macro.fivetran_utils.drop_schemas_automation", "macro_sql": "{% macro drop_schemas_automation(drop_target_schema=true) %}\n {{ return(adapter.dispatch('drop_schemas_automation', 'fivetran_utils')(drop_target_schema)) }}\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__drop_schemas_automation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.037157, "supported_languages": null}, "macro.fivetran_utils.default__drop_schemas_automation": {"name": "default__drop_schemas_automation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/drop_schemas_automation.sql", "original_file_path": "macros/drop_schemas_automation.sql", "unique_id": "macro.fivetran_utils.default__drop_schemas_automation", "macro_sql": "{% macro default__drop_schemas_automation(drop_target_schema=true) %}\n\n{% set fetch_list_sql %}\n {% if target.type not in ('databricks', 'spark') %}\n select schema_name\n from \n {{ wrap_in_quotes(target.database) }}.INFORMATION_SCHEMA.SCHEMATA\n where lower(schema_name) like '{{ target.schema | lower }}{%- if not drop_target_schema -%}_{%- endif -%}%'\n {% else %}\n SHOW SCHEMAS LIKE '{{ target.schema }}{%- if not drop_target_schema -%}_{%- endif -%}*'\n {% endif %}\n{% endset %}\n\n{% set results = run_query(fetch_list_sql) %}\n\n{% if execute %}\n {% set results_list = results.columns[0].values() %}\n{% else %}\n {% set results_list = [] %}\n{% endif %}\n\n{% for schema_to_drop in results_list %}\n {% do adapter.drop_schema(api.Relation.create(database=target.database, schema=schema_to_drop)) %}\n {{ print('Schema ' ~ schema_to_drop ~ ' successfully dropped from the ' ~ target.database ~ ' database.\\n')}}\n{% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.wrap_in_quotes", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.038274, "supported_languages": null}, "macro.fivetran_utils.seed_data_helper": {"name": "seed_data_helper", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/seed_data_helper.sql", "original_file_path": "macros/seed_data_helper.sql", "unique_id": "macro.fivetran_utils.seed_data_helper", "macro_sql": "{% macro seed_data_helper(seed_name, warehouses) %}\n\n{% if target.type in warehouses %}\n {% for w in warehouses %}\n {% if target.type == w %}\n {{ return(ref(seed_name ~ \"_\" ~ w ~ \"\")) }}\n {% endif %}\n {% endfor %}\n{% else %}\n{{ return(ref(seed_name)) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.038892, "supported_languages": null}, "macro.fivetran_utils.fill_pass_through_columns": {"name": "fill_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_pass_through_columns.sql", "original_file_path": "macros/fill_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.fill_pass_through_columns", "macro_sql": "{% macro fill_pass_through_columns(pass_through_variable) %}\n\n{% if var(pass_through_variable) %}\n {% for field in var(pass_through_variable) %}\n {% if field is mapping %}\n {% if field.transform_sql %}\n , {{ field.transform_sql }} as {{ field.alias if field.alias else field.name }}\n {% else %}\n , {{ field.alias if field.alias else field.name }}\n {% endif %}\n {% else %}\n , {{ field }}\n {% endif %}\n {% endfor %}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.039726, "supported_languages": null}, "macro.fivetran_utils.string_agg": {"name": "string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.string_agg", "macro_sql": "{% macro string_agg(field_to_agg, delimiter) -%}\n\n{{ adapter.dispatch('string_agg', 'fivetran_utils') (field_to_agg, delimiter) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__string_agg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.040212, "supported_languages": null}, "macro.fivetran_utils.default__string_agg": {"name": "default__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.default__string_agg", "macro_sql": "{% macro default__string_agg(field_to_agg, delimiter) %}\n string_agg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.040349, "supported_languages": null}, "macro.fivetran_utils.snowflake__string_agg": {"name": "snowflake__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.snowflake__string_agg", "macro_sql": "{% macro snowflake__string_agg(field_to_agg, delimiter) %}\n listagg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.040488, "supported_languages": null}, "macro.fivetran_utils.redshift__string_agg": {"name": "redshift__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.redshift__string_agg", "macro_sql": "{% macro redshift__string_agg(field_to_agg, delimiter) %}\n listagg({{ field_to_agg }}, {{ delimiter }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.040628, "supported_languages": null}, "macro.fivetran_utils.spark__string_agg": {"name": "spark__string_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/string_agg.sql", "original_file_path": "macros/string_agg.sql", "unique_id": "macro.fivetran_utils.spark__string_agg", "macro_sql": "{% macro spark__string_agg(field_to_agg, delimiter) %}\n -- collect set will remove duplicates\n replace(replace(replace(cast( collect_set({{ field_to_agg }}) as string), '[', ''), ']', ''), ', ', {{ delimiter }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.040768, "supported_languages": null}, "macro.fivetran_utils.timestamp_diff": {"name": "timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.timestamp_diff", "macro_sql": "{% macro timestamp_diff(first_date, second_date, datepart) %}\n {{ adapter.dispatch('timestamp_diff', 'fivetran_utils')(first_date, second_date, datepart) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__timestamp_diff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.043811, "supported_languages": null}, "macro.fivetran_utils.default__timestamp_diff": {"name": "default__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.default__timestamp_diff", "macro_sql": "{% macro default__timestamp_diff(first_date, second_date, datepart) %}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0439801, "supported_languages": null}, "macro.fivetran_utils.redshift__timestamp_diff": {"name": "redshift__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.redshift__timestamp_diff", "macro_sql": "{% macro redshift__timestamp_diff(first_date, second_date, datepart) %}\n\n datediff(\n {{ datepart }},\n {{ first_date }},\n {{ second_date }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.044147, "supported_languages": null}, "macro.fivetran_utils.bigquery__timestamp_diff": {"name": "bigquery__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.bigquery__timestamp_diff", "macro_sql": "{% macro bigquery__timestamp_diff(first_date, second_date, datepart) %}\n\n timestamp_diff(\n {{second_date}},\n {{first_date}},\n {{datepart}}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.044308, "supported_languages": null}, "macro.fivetran_utils.postgres__timestamp_diff": {"name": "postgres__timestamp_diff", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_diff.sql", "original_file_path": "macros/timestamp_diff.sql", "unique_id": "macro.fivetran_utils.postgres__timestamp_diff", "macro_sql": "{% macro postgres__timestamp_diff(first_date, second_date, datepart) %}\n\n {% if datepart == 'year' %}\n (date_part('year', ({{second_date}})::date) - date_part('year', ({{first_date}})::date))\n {% elif datepart == 'quarter' %}\n ({{ dbt.datediff(first_date, second_date, 'year') }} * 4 + date_part('quarter', ({{second_date}})::date) - date_part('quarter', ({{first_date}})::date))\n {% elif datepart == 'month' %}\n ({{ dbt.datediff(first_date, second_date, 'year') }} * 12 + date_part('month', ({{second_date}})::date) - date_part('month', ({{first_date}})::date))\n {% elif datepart == 'day' %}\n (({{second_date}})::date - ({{first_date}})::date)\n {% elif datepart == 'week' %}\n ({{ dbt.datediff(first_date, second_date, 'day') }} / 7 + case\n when date_part('dow', ({{first_date}})::timestamp) <= date_part('dow', ({{second_date}})::timestamp) then\n case when {{first_date}} <= {{second_date}} then 0 else -1 end\n else\n case when {{first_date}} <= {{second_date}} then 1 else 0 end\n end)\n {% elif datepart == 'hour' %}\n ({{ dbt.datediff(first_date, second_date, 'day') }} * 24 + date_part('hour', ({{second_date}})::timestamp) - date_part('hour', ({{first_date}})::timestamp))\n {% elif datepart == 'minute' %}\n ({{ dbt.datediff(first_date, second_date, 'hour') }} * 60 + date_part('minute', ({{second_date}})::timestamp) - date_part('minute', ({{first_date}})::timestamp))\n {% elif datepart == 'second' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60 + floor(date_part('second', ({{second_date}})::timestamp)) - floor(date_part('second', ({{first_date}})::timestamp)))\n {% elif datepart == 'millisecond' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60000 + floor(date_part('millisecond', ({{second_date}})::timestamp)) - floor(date_part('millisecond', ({{first_date}})::timestamp)))\n {% elif datepart == 'microsecond' %}\n ({{ dbt.datediff(first_date, second_date, 'minute') }} * 60000000 + floor(date_part('microsecond', ({{second_date}})::timestamp)) - floor(date_part('microsecond', ({{first_date}})::timestamp)))\n {% else %}\n {{ exceptions.raise_compiler_error(\"Unsupported datepart for macro datediff in postgres: {!r}\".format(datepart)) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.datediff"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.046143, "supported_languages": null}, "macro.fivetran_utils.try_cast": {"name": "try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.try_cast", "macro_sql": "{% macro try_cast(field, type) %}\n {{ adapter.dispatch('try_cast', 'fivetran_utils') (field, type) }}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__try_cast"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0471191, "supported_languages": null}, "macro.fivetran_utils.default__try_cast": {"name": "default__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.default__try_cast", "macro_sql": "{% macro default__try_cast(field, type) %}\n {# most databases don't support this function yet\n so we just need to use cast #}\n cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.047261, "supported_languages": null}, "macro.fivetran_utils.redshift__try_cast": {"name": "redshift__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.redshift__try_cast", "macro_sql": "{% macro redshift__try_cast(field, type) %}\n{%- if type == 'numeric' -%}\n\n case\n when trim({{field}}) ~ '^(0|[1-9][0-9]*)$' then trim({{field}})\n else null\n end::{{type}}\n\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"non-numeric datatypes are not currently supported\") }}\n\n{% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0475578, "supported_languages": null}, "macro.fivetran_utils.postgres__try_cast": {"name": "postgres__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.postgres__try_cast", "macro_sql": "{% macro postgres__try_cast(field, type) %}\n{%- if type == 'numeric' -%}\n\n case\n when replace(cast({{field}} as varchar),cast(' ' as varchar),cast('' as varchar)) ~ '^(0|[1-9][0-9]*)$' \n then replace(cast({{field}} as varchar),cast(' ' as varchar),cast('' as varchar))\n else null\n end::{{type}}\n\n{% else %}\n {{ exceptions.raise_compiler_error(\n \"non-numeric datatypes are not currently supported\") }}\n\n{% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.047853, "supported_languages": null}, "macro.fivetran_utils.snowflake__try_cast": {"name": "snowflake__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.snowflake__try_cast", "macro_sql": "{% macro snowflake__try_cast(field, type) %}\n try_cast(cast({{field}} as varchar) as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0479958, "supported_languages": null}, "macro.fivetran_utils.bigquery__try_cast": {"name": "bigquery__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.bigquery__try_cast", "macro_sql": "{% macro bigquery__try_cast(field, type) %}\n safe_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.048127, "supported_languages": null}, "macro.fivetran_utils.spark__try_cast": {"name": "spark__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.spark__try_cast", "macro_sql": "{% macro spark__try_cast(field, type) %}\n try_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.048258, "supported_languages": null}, "macro.fivetran_utils.sqlserver__try_cast": {"name": "sqlserver__try_cast", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/try_cast.sql", "original_file_path": "macros/try_cast.sql", "unique_id": "macro.fivetran_utils.sqlserver__try_cast", "macro_sql": "{% macro sqlserver__try_cast(field, type) %}\n try_cast({{field}} as {{type}})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0483918, "supported_languages": null}, "macro.fivetran_utils.source_relation": {"name": "source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/source_relation.sql", "original_file_path": "macros/source_relation.sql", "unique_id": "macro.fivetran_utils.source_relation", "macro_sql": "{% macro source_relation(union_schema_variable='union_schemas', union_database_variable='union_databases') -%}\n\n{{ adapter.dispatch('source_relation', 'fivetran_utils') (union_schema_variable, union_database_variable) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__source_relation"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.048917, "supported_languages": null}, "macro.fivetran_utils.default__source_relation": {"name": "default__source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/source_relation.sql", "original_file_path": "macros/source_relation.sql", "unique_id": "macro.fivetran_utils.default__source_relation", "macro_sql": "{% macro default__source_relation(union_schema_variable, union_database_variable) %}\n\n{% if var(union_schema_variable, none) %}\n, case\n {% for schema in var(union_schema_variable) %}\n when lower(replace(replace(_dbt_source_relation,'\"',''),'`','')) like '%.{{ schema|lower }}.%' then '{{ schema|lower }}'\n {% endfor %}\n end as source_relation\n{% elif var(union_database_variable, none) %}\n, case\n {% for database in var(union_database_variable) %}\n when lower(replace(replace(_dbt_source_relation,'\"',''),'`','')) like '%{{ database|lower }}.%' then '{{ database|lower }}'\n {% endfor %}\n end as source_relation\n{% else %}\n, cast('' as {{ dbt.type_string() }}) as source_relation\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.049535, "supported_languages": null}, "macro.fivetran_utils.first_value": {"name": "first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.first_value", "macro_sql": "{% macro first_value(first_value_field, partition_field, order_by_field, order=\"asc\") -%}\n\n{{ adapter.dispatch('first_value', 'fivetran_utils') (first_value_field, partition_field, order_by_field, order) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__first_value"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0500429, "supported_languages": null}, "macro.fivetran_utils.default__first_value": {"name": "default__first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.default__first_value", "macro_sql": "{% macro default__first_value(first_value_field, partition_field, order_by_field, order=\"asc\") %}\n\n first_value( {{ first_value_field }} ignore nulls ) over (partition by {{ partition_field }} order by {{ order_by_field }} {{ order }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0502558, "supported_languages": null}, "macro.fivetran_utils.redshift__first_value": {"name": "redshift__first_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/first_value.sql", "original_file_path": "macros/first_value.sql", "unique_id": "macro.fivetran_utils.redshift__first_value", "macro_sql": "{% macro redshift__first_value(first_value_field, partition_field, order_by_field, order=\"asc\") %}\n\n first_value( {{ first_value_field }} ignore nulls ) over (partition by {{ partition_field }} order by {{ order_by_field }} {{ order }} , {{ partition_field }} rows unbounded preceding )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.050495, "supported_languages": null}, "macro.fivetran_utils.add_dbt_source_relation": {"name": "add_dbt_source_relation", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/add_dbt_source_relation.sql", "original_file_path": "macros/add_dbt_source_relation.sql", "unique_id": "macro.fivetran_utils.add_dbt_source_relation", "macro_sql": "{% macro add_dbt_source_relation() %}\n\n{% if var('union_schemas', none) or var('union_databases', none) %}\n, _dbt_source_relation\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.05076, "supported_languages": null}, "macro.fivetran_utils.add_pass_through_columns": {"name": "add_pass_through_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/add_pass_through_columns.sql", "original_file_path": "macros/add_pass_through_columns.sql", "unique_id": "macro.fivetran_utils.add_pass_through_columns", "macro_sql": "{% macro add_pass_through_columns(base_columns, pass_through_var) %}\n\n {% if pass_through_var %}\n\n {% for column in pass_through_var %}\n\n {% if column is mapping %}\n\n {% if column.alias %}\n\n {% do base_columns.append({ \"name\": column.name, \"alias\": column.alias, \"datatype\": column.datatype if column.datatype else dbt.type_string()}) %}\n\n {% else %}\n\n {% do base_columns.append({ \"name\": column.name, \"datatype\": column.datatype if column.datatype else dbt.type_string()}) %}\n \n {% endif %}\n\n {% else %}\n\n {% do base_columns.append({ \"name\": column, \"datatype\": dbt.type_string()}) %}\n\n {% endif %}\n\n {% endfor %}\n\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.051968, "supported_languages": null}, "macro.fivetran_utils.union_relations": {"name": "union_relations", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_relations.sql", "original_file_path": "macros/union_relations.sql", "unique_id": "macro.fivetran_utils.union_relations", "macro_sql": "{%- macro union_relations(relations, aliases=none, column_override=none, include=[], exclude=[], source_column_name=none) -%}\n\n {%- if exclude and include -%}\n {{ exceptions.raise_compiler_error(\"Both an exclude and include list were provided to the `union` macro. Only one is allowed\") }}\n {%- endif -%}\n\n {#-- Prevent querying of db in parsing mode. This works because this macro does not create any new refs. -#}\n {%- if not execute %}\n {{ return('') }}\n {% endif -%}\n\n {%- set column_override = column_override if column_override is not none else {} -%}\n {%- set source_column_name = source_column_name if source_column_name is not none else '_dbt_source_relation' -%}\n\n {%- set relation_columns = {} -%}\n {%- set column_superset = {} -%}\n\n {%- for relation in relations -%}\n\n {%- do relation_columns.update({relation: []}) -%}\n\n {%- do dbt_utils._is_relation(relation, 'union_relations') -%}\n {%- set cols = adapter.get_columns_in_relation(relation) -%}\n {%- for col in cols -%}\n\n {#- If an exclude list was provided and the column is in the list, do nothing -#}\n {%- if exclude and col.column in exclude -%}\n\n {#- If an include list was provided and the column is not in the list, do nothing -#}\n {%- elif include and col.column not in include -%}\n\n {#- Otherwise add the column to the column superset -#}\n {%- else -%}\n\n {#- update the list of columns in this relation -#}\n {%- do relation_columns[relation].append(col.column) -%}\n\n {%- if col.column in column_superset -%}\n\n {%- set stored = column_superset[col.column] -%}\n {%- if col.is_string() and stored.is_string() and col.string_size() > stored.string_size() -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif %}\n\n {%- else -%}\n\n {%- do column_superset.update({col.column: col}) -%}\n\n {%- endif -%}\n\n {%- endif -%}\n\n {%- endfor -%}\n {%- endfor -%}\n\n {%- set ordered_column_names = column_superset.keys() -%}\n\n {%- for relation in relations %}\n\n (\n select\n\n cast({{ dbt.string_literal(relation) }} as {{ dbt.type_string() }}) as {{ source_column_name }},\n {% for col_name in ordered_column_names -%}\n\n {%- set col = column_superset[col_name] %}\n {%- set col_type = column_override.get(col.column, col.data_type) %}\n {%- set col_name = adapter.quote(col_name) if col_name in relation_columns[relation] else 'null' %}\n cast({{ col_name }} as {{ col_type }}) as {{ col.quoted }} {% if not loop.last %},{% endif -%}\n\n {%- endfor %}\n\n from {{ aliases[loop.index0] if aliases else relation }}\n )\n\n {% if not loop.last -%}\n union all\n {% endif -%}\n\n {%- endfor -%}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.dbt_utils._is_relation", "macro.dbt.string_literal", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0561469, "supported_languages": null}, "macro.fivetran_utils.union_tables": {"name": "union_tables", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_relations.sql", "original_file_path": "macros/union_relations.sql", "unique_id": "macro.fivetran_utils.union_tables", "macro_sql": "{%- macro union_tables(tables, column_override=none, include=[], exclude=[], source_column_name='_dbt_source_table') -%}\n\n {%- do exceptions.warn(\"Warning: the `union_tables` macro is no longer supported and will be deprecated in a future release of dbt-utils. Use the `union_relations` macro instead\") -%}\n\n {{ return(dbt_utils.union_relations(tables, column_override, include, exclude, source_column_name)) }}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils.union_relations"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0565288, "supported_languages": null}, "macro.fivetran_utils.snowflake_seed_data": {"name": "snowflake_seed_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/snowflake_seed_data.sql", "original_file_path": "macros/snowflake_seed_data.sql", "unique_id": "macro.fivetran_utils.snowflake_seed_data", "macro_sql": "{% macro snowflake_seed_data(seed_name) %}\n\n{% if target.type == 'snowflake' %}\n{{ return(ref(seed_name ~ '_snowflake')) }}\n{% else %}\n{{ return(ref(seed_name)) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.056917, "supported_languages": null}, "macro.fivetran_utils.fill_staging_columns": {"name": "fill_staging_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_staging_columns.sql", "original_file_path": "macros/fill_staging_columns.sql", "unique_id": "macro.fivetran_utils.fill_staging_columns", "macro_sql": "{% macro fill_staging_columns(source_columns, staging_columns) -%}\n\n{%- set source_column_names = source_columns|map(attribute='name')|map('lower')|list -%}\n\n{%- for column in staging_columns %}\n {% if column.name|lower in source_column_names -%}\n {{ fivetran_utils.quote_column(column) }} as \n {%- if 'alias' in column %} {{ column.alias }} {% else %} {{ fivetran_utils.quote_column(column) }} {%- endif -%}\n {%- else -%}\n cast(null as {{ column.datatype }})\n {%- if 'alias' in column %} as {{ column.alias }} {% else %} as {{ fivetran_utils.quote_column(column) }} {% endif -%}\n {%- endif -%}\n {%- if not loop.last -%} , {% endif -%}\n{% endfor %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.quote_column"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.058602, "supported_languages": null}, "macro.fivetran_utils.quote_column": {"name": "quote_column", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fill_staging_columns.sql", "original_file_path": "macros/fill_staging_columns.sql", "unique_id": "macro.fivetran_utils.quote_column", "macro_sql": "{% macro quote_column(column) %}\n {% if 'quote' in column %}\n {% if column.quote %}\n {% if target.type in ('bigquery', 'spark', 'databricks') %}\n `{{ column.name }}`\n {% elif target.type == 'snowflake' %}\n \"{{ column.name | upper }}\"\n {% else %}\n \"{{ column.name }}\"\n {% endif %}\n {% else %}\n {{ column.name }}\n {% endif %}\n {% else %}\n {{ column.name }}\n {% endif %}\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0591922, "supported_languages": null}, "macro.fivetran_utils.json_extract": {"name": "json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.json_extract", "macro_sql": "{% macro json_extract(string, string_path) -%}\n\n{{ adapter.dispatch('json_extract', 'fivetran_utils') (string, string_path) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__json_extract"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.05977, "supported_languages": null}, "macro.fivetran_utils.default__json_extract": {"name": "default__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.default__json_extract", "macro_sql": "{% macro default__json_extract(string, string_path) %}\n\n json_extract_path_text({{string}}, {{ \"'\" ~ string_path ~ \"'\" }} )\n \n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.059932, "supported_languages": null}, "macro.fivetran_utils.snowflake__json_extract": {"name": "snowflake__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.snowflake__json_extract", "macro_sql": "{% macro snowflake__json_extract(string, string_path) %}\n\n json_extract_path_text(try_parse_json( {{string}} ), {{ \"'\" ~ string_path ~ \"'\" }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0600939, "supported_languages": null}, "macro.fivetran_utils.redshift__json_extract": {"name": "redshift__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.redshift__json_extract", "macro_sql": "{% macro redshift__json_extract(string, string_path) %}\n\n case when is_valid_json( {{string}} ) then json_extract_path_text({{string}}, {{ \"'\" ~ string_path ~ \"'\" }} ) else null end\n \n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0602748, "supported_languages": null}, "macro.fivetran_utils.bigquery__json_extract": {"name": "bigquery__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.bigquery__json_extract", "macro_sql": "{% macro bigquery__json_extract(string, string_path) %}\n\n json_extract_scalar({{string}}, {{ \"'$.\" ~ string_path ~ \"'\" }} )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.060437, "supported_languages": null}, "macro.fivetran_utils.postgres__json_extract": {"name": "postgres__json_extract", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/json_extract.sql", "original_file_path": "macros/json_extract.sql", "unique_id": "macro.fivetran_utils.postgres__json_extract", "macro_sql": "{% macro postgres__json_extract(string, string_path) %}\n\n {{string}}::json->>{{\"'\" ~ string_path ~ \"'\" }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.060599, "supported_languages": null}, "macro.fivetran_utils.collect_freshness": {"name": "collect_freshness", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/collect_freshness.sql", "original_file_path": "macros/collect_freshness.sql", "unique_id": "macro.fivetran_utils.collect_freshness", "macro_sql": "{% macro collect_freshness(source, loaded_at_field, filter) %}\n {{ return(adapter.dispatch('collect_freshness')(source, loaded_at_field, filter))}}\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__collect_freshness"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0614731, "supported_languages": null}, "macro.fivetran_utils.default__collect_freshness": {"name": "default__collect_freshness", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/collect_freshness.sql", "original_file_path": "macros/collect_freshness.sql", "unique_id": "macro.fivetran_utils.default__collect_freshness", "macro_sql": "{% macro default__collect_freshness(source, loaded_at_field, filter) %}\n {% call statement('collect_freshness', fetch_result=True, auto_begin=False) -%}\n\n {%- set enabled_array = [] -%}\n {% for node in graph.sources.values() %}\n {% if node.identifier == source.identifier %}\n {% if (node.meta['is_enabled'] | default(true)) %}\n {%- do enabled_array.append(1) -%}\n {% endif %}\n {% endif %}\n {% endfor %}\n {% set is_enabled = (enabled_array != []) %}\n\n select\n {% if is_enabled %}\n max({{ loaded_at_field }})\n {% else %} \n {{ current_timestamp() }} {% endif %} as max_loaded_at,\n {{ current_timestamp() }} as snapshotted_at\n\n {% if is_enabled %}\n from {{ source }}\n {% if filter %}\n where {{ filter }}\n {% endif %}\n {% endif %}\n\n {% endcall %}\n\n {% if dbt_version.split('.') | map('int') | list >= [1, 5, 0] %}\n {{ return(load_result('collect_freshness')) }}\n {% else %}\n {{ return(load_result('collect_freshness').table) }}\n {% endif %}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.statement", "macro.dbt.current_timestamp"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.062798, "supported_languages": null}, "macro.fivetran_utils.timestamp_add": {"name": "timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.timestamp_add", "macro_sql": "{% macro timestamp_add(datepart, interval, from_timestamp) -%}\n\n{{ adapter.dispatch('timestamp_add', 'fivetran_utils') (datepart, interval, from_timestamp) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.bigquery__timestamp_add"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.063539, "supported_languages": null}, "macro.fivetran_utils.default__timestamp_add": {"name": "default__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.default__timestamp_add", "macro_sql": "{% macro default__timestamp_add(datepart, interval, from_timestamp) %}\n\n timestampadd(\n {{ datepart }},\n {{ interval }},\n {{ from_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.063712, "supported_languages": null}, "macro.fivetran_utils.bigquery__timestamp_add": {"name": "bigquery__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.bigquery__timestamp_add", "macro_sql": "{% macro bigquery__timestamp_add(datepart, interval, from_timestamp) %}\n\n timestamp_add({{ from_timestamp }}, interval {{ interval }} {{ datepart }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.063877, "supported_languages": null}, "macro.fivetran_utils.redshift__timestamp_add": {"name": "redshift__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.redshift__timestamp_add", "macro_sql": "{% macro redshift__timestamp_add(datepart, interval, from_timestamp) %}\n\n dateadd(\n {{ datepart }},\n {{ interval }},\n {{ from_timestamp }}\n )\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0640461, "supported_languages": null}, "macro.fivetran_utils.postgres__timestamp_add": {"name": "postgres__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.postgres__timestamp_add", "macro_sql": "{% macro postgres__timestamp_add(datepart, interval, from_timestamp) %}\n\n {{ from_timestamp }} + ((interval '1 {{ datepart }}') * ({{ interval }}))\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.064217, "supported_languages": null}, "macro.fivetran_utils.spark__timestamp_add": {"name": "spark__timestamp_add", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/timestamp_add.sql", "original_file_path": "macros/timestamp_add.sql", "unique_id": "macro.fivetran_utils.spark__timestamp_add", "macro_sql": "{% macro spark__timestamp_add(datepart, interval, from_timestamp) %}\n\n {{ dbt.dateadd(datepart, interval, from_timestamp) }}\n \n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.dateadd"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.064401, "supported_languages": null}, "macro.fivetran_utils.ceiling": {"name": "ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.ceiling", "macro_sql": "{% macro ceiling(num) -%}\n\n{{ adapter.dispatch('ceiling', 'fivetran_utils') (num) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__ceiling"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.064663, "supported_languages": null}, "macro.fivetran_utils.default__ceiling": {"name": "default__ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.default__ceiling", "macro_sql": "{% macro default__ceiling(num) %}\n ceiling({{ num }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0647721, "supported_languages": null}, "macro.fivetran_utils.snowflake__ceiling": {"name": "snowflake__ceiling", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/ceiling.sql", "original_file_path": "macros/ceiling.sql", "unique_id": "macro.fivetran_utils.snowflake__ceiling", "macro_sql": "{% macro snowflake__ceiling(num) %}\n ceil({{ num }})\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.064876, "supported_languages": null}, "macro.fivetran_utils.remove_prefix_from_columns": {"name": "remove_prefix_from_columns", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/remove_prefix_from_columns.sql", "original_file_path": "macros/remove_prefix_from_columns.sql", "unique_id": "macro.fivetran_utils.remove_prefix_from_columns", "macro_sql": "{% macro remove_prefix_from_columns(columns, prefix='', exclude=[]) %}\n\n {%- for col in columns if col.name not in exclude -%}\n {%- if col.name[:prefix|length]|lower == prefix -%}\n {{ col.name }} as {{ col.name[prefix|length:] }}\n {%- else -%}\n {{ col.name }}\n {%- endif -%}\n {%- if not loop.last -%},{%- endif %}\n {% endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.065542, "supported_languages": null}, "macro.fivetran_utils.fivetran_date_spine": {"name": "fivetran_date_spine", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fivetran_date_spine.sql", "original_file_path": "macros/fivetran_date_spine.sql", "unique_id": "macro.fivetran_utils.fivetran_date_spine", "macro_sql": "{% macro fivetran_date_spine(datepart, start_date, end_date) -%}\n\n{{ return(adapter.dispatch('fivetran_date_spine', 'fivetran_utils') (datepart, start_date, end_date)) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__fivetran_date_spine"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.066988, "supported_languages": null}, "macro.fivetran_utils.default__fivetran_date_spine": {"name": "default__fivetran_date_spine", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fivetran_date_spine.sql", "original_file_path": "macros/fivetran_date_spine.sql", "unique_id": "macro.fivetran_utils.default__fivetran_date_spine", "macro_sql": "{% macro default__fivetran_date_spine(datepart, start_date, end_date) %}\n\n {{ dbt_utils.date_spine(datepart, start_date, end_date) }}\n \n{% endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.date_spine"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.067175, "supported_languages": null}, "macro.fivetran_utils.sqlserver__fivetran_date_spine": {"name": "sqlserver__fivetran_date_spine", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/fivetran_date_spine.sql", "original_file_path": "macros/fivetran_date_spine.sql", "unique_id": "macro.fivetran_utils.sqlserver__fivetran_date_spine", "macro_sql": "{% macro sqlserver__fivetran_date_spine(datepart, start_date, end_date) -%}\n\n {% set date_spine_query %}\n with\n\n l0 as (\n\n select c\n from (select 1 union all select 1) as d(c)\n\n ),\n l1 as (\n\n select\n 1 as c\n from l0 as a\n cross join l0 as b\n\n ),\n\n l2 as (\n\n select 1 as c\n from l1 as a\n cross join l1 as b\n ),\n\n l3 as (\n\n select 1 as c\n from l2 as a\n cross join l2 as b\n ),\n\n l4 as (\n\n select 1 as c\n from l3 as a\n cross join l3 as b\n ),\n\n l5 as (\n\n select 1 as c\n from l4 as a\n cross join l4 as b\n ),\n\n nums as (\n\n select row_number() over (order by (select null)) as rownum\n from l5\n ),\n\n rawdata as (\n\n select top ({{dbt.datediff(start_date, end_date, datepart)}}) rownum -1 as n\n from nums\n order by rownum\n ),\n\n all_periods as (\n\n select (\n {{\n dbt.dateadd(\n datepart,\n 'n',\n start_date\n )\n }}\n ) as date_{{datepart}}\n from rawdata\n ),\n\n filtered as (\n\n select *\n from all_periods\n where date_{{datepart}} <= {{ end_date }}\n\n )\n\n select * from filtered\n order by 1\n\n {% endset %}\n\n {% set results = run_query(date_spine_query) %}\n\n {% if execute %}\n\n {% set results_list = results.columns[0].values() %}\n \n {% else %}\n\n {% set results_list = [] %}\n\n {% endif %}\n\n {%- for date_field in results_list %}\n select cast('{{ date_field }}' as date) as date_{{datepart}} {{ 'union all ' if not loop.last else '' }}\n {% endfor -%}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.datediff", "macro.dbt.dateadd", "macro.dbt.run_query"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.068042, "supported_languages": null}, "macro.fivetran_utils.union_data": {"name": "union_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_data.sql", "original_file_path": "macros/union_data.sql", "unique_id": "macro.fivetran_utils.union_data", "macro_sql": "{%- macro union_data(table_identifier, database_variable, schema_variable, default_database, default_schema, default_variable, union_schema_variable='union_schemas', union_database_variable='union_databases') -%}\n\n{{ adapter.dispatch('union_data', 'fivetran_utils') (\n table_identifier, \n database_variable, \n schema_variable, \n default_database, \n default_schema, \n default_variable,\n union_schema_variable,\n union_database_variable\n ) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.fivetran_utils.default__union_data"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.071695, "supported_languages": null}, "macro.fivetran_utils.default__union_data": {"name": "default__union_data", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/union_data.sql", "original_file_path": "macros/union_data.sql", "unique_id": "macro.fivetran_utils.default__union_data", "macro_sql": "{%- macro default__union_data(\n table_identifier, \n database_variable, \n schema_variable, \n default_database, \n default_schema, \n default_variable,\n union_schema_variable,\n union_database_variable\n ) -%}\n\n{%- if var(union_schema_variable, none) -%}\n\n {%- set relations = [] -%}\n \n {%- if var(union_schema_variable) is string -%}\n {%- set trimmed = var(union_schema_variable)|trim('[')|trim(']') -%}\n {%- set schemas = trimmed.split(',')|map('trim',\" \")|map('trim','\"')|map('trim',\"'\") -%}\n {%- else -%}\n {%- set schemas = var(union_schema_variable) -%}\n {%- endif -%}\n\n {%- for schema in var(union_schema_variable) -%}\n {%- set relation=adapter.get_relation(\n database=source(schema, table_identifier).database if var('has_defined_sources', false) else var(database_variable, default_database),\n schema=source(schema, table_identifier).schema if var('has_defined_sources', false) else schema,\n identifier=source(schema, table_identifier).identifier if var('has_defined_sources', false) else table_identifier\n ) -%}\n \n {%- set relation_exists=relation is not none -%}\n\n {%- if relation_exists -%}\n {%- do relations.append(relation) -%}\n {%- endif -%}\n\n {%- endfor -%}\n \n {%- if relations != [] -%}\n {{ dbt_utils.union_relations(relations) }}\n {%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n {%- endif -%}\n\n{%- elif var(union_database_variable, none) -%}\n\n {%- set relations = [] -%}\n\n {%- for database in var(union_database_variable) -%}\n {%- set relation=adapter.get_relation(\n database=source(schema, table_identifier).database if var('has_defined_sources', false) else database,\n schema=source(schema, table_identifier).schema if var('has_defined_sources', false) else var(schema_variable, default_schema),\n identifier=source(schema, table_identifier).identifier if var('has_defined_sources', false) else table_identifier\n ) -%}\n\n {%- set relation_exists=relation is not none -%}\n\n {%- if relation_exists -%}\n {%- do relations.append(relation) -%}\n {%- endif -%}\n\n {%- endfor -%}\n\n {%- if relations != [] -%}\n {{ dbt_utils.union_relations(relations) }}\n {%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n {%- endif -%}\n\n{%- else -%}\n {% set exception_schemas = {\"linkedin_company_pages\": \"linkedin_pages\", \"instagram_business_pages\": \"instagram_business\"} %}\n {% set relation = namespace(value=\"\") %}\n {% if default_schema in exception_schemas.keys() %}\n {% for corrected_schema_name in exception_schemas.items() %} \n {% if default_schema in corrected_schema_name %}\n {# In order for this macro to effectively work within upstream integration tests (mainly used by the Fivetran dbt package maintainers), this identifier variable selection is required to use the macro with different identifier names. #}\n {% set identifier_var = corrected_schema_name[1] + \"_\" + table_identifier + \"_identifier\" %}\n {%- set relation.value=adapter.get_relation(\n database=source(corrected_schema_name[1], table_identifier).database,\n schema=source(corrected_schema_name[1], table_identifier).schema,\n identifier=var(identifier_var, table_identifier)\n ) -%}\n {% endif %}\n {% endfor %}\n {% else %}\n {# In order for this macro to effectively work within upstream integration tests (mainly used by the Fivetran dbt package maintainers), this identifier variable selection is required to use the macro with different identifier names. #}\n {% set identifier_var = default_schema + \"_\" + table_identifier + \"_identifier\" %}\n {# Unfortunately the Twitter Organic identifiers were misspelled. As such, we will need to account for this in the model. This will be adjusted in the Twitter Organic package, but to ensure backwards compatibility, this needs to be included. #}\n {% if var(identifier_var, none) is none %} \n {% set identifier_var = default_schema + \"_\" + table_identifier + \"_identifer\" %}\n {% endif %}\n {%- set relation.value=adapter.get_relation(\n database=source(default_schema, table_identifier).database,\n schema=source(default_schema, table_identifier).schema,\n identifier=var(identifier_var, table_identifier)\n ) -%}\n {% endif %}\n{%- set table_exists=relation.value is not none -%}\n\n{%- if table_exists -%}\n select * \n from {{ relation.value }}\n{%- else -%}\n {% if execute and not var('fivetran__remove_empty_table_warnings', false) -%}\n {{ exceptions.warn(\"\\n\\nPlease be aware: The \" ~ table_identifier|upper ~ \" table was not found in your \" ~ default_schema|upper ~ \" schema(s). The Fivetran dbt package will create a completely empty \" ~ table_identifier|upper ~ \" staging model as to not break downstream transformations. To turn off these warnings, set the `fivetran__remove_empty_table_warnings` variable to TRUE (see https://github.com/fivetran/dbt_fivetran_utils/tree/releases/v0.4.latest#union_data-source for details).\\n\") }}\n {% endif -%}\n select \n cast(null as {{ dbt.type_string() }}) as _dbt_source_relation\n limit 0\n{%- endif -%}\n{%- endif -%}\n\n{%- endmacro -%}", "depends_on": {"macros": ["macro.dbt_utils.union_relations", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0766551, "supported_languages": null}, "macro.fivetran_utils.dummy_coalesce_value": {"name": "dummy_coalesce_value", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/dummy_coalesce_value.sql", "original_file_path": "macros/dummy_coalesce_value.sql", "unique_id": "macro.fivetran_utils.dummy_coalesce_value", "macro_sql": "{% macro dummy_coalesce_value(column) %}\n\n{% set coalesce_value = {\n 'STRING': \"'DUMMY_STRING'\",\n 'BOOLEAN': 'null',\n 'INT': 999999999,\n 'FLOAT': 999999999.99,\n 'TIMESTAMP': 'cast(\"2099-12-31\" as timestamp)',\n 'DATE': 'cast(\"2099-12-31\" as date)',\n} %}\n\n{% if column.is_float() %}\n{{ return(coalesce_value['FLOAT']) }}\n\n{% elif column.is_numeric() %}\n{{ return(coalesce_value['INT']) }}\n\n{% elif column.is_string() %}\n{{ return(coalesce_value['STRING']) }}\n\n{% elif column.data_type|lower == 'boolean' %}\n{{ return(coalesce_value['BOOLEAN']) }}\n\n{% elif 'timestamp' in column.data_type|lower %}\n{{ return(coalesce_value['TIMESTAMP']) }}\n\n{% elif 'date' in column.data_type|lower %}\n{{ return(coalesce_value['DATE']) }}\n\n{% elif 'int' in column.data_type|lower %}\n{{ return(coalesce_value['INT']) }}\n\n{% endif %}\n\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.07814, "supported_languages": null}, "macro.fivetran_utils.extract_url_parameter": {"name": "extract_url_parameter", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/extract_url_parameter.sql", "original_file_path": "macros/extract_url_parameter.sql", "unique_id": "macro.fivetran_utils.extract_url_parameter", "macro_sql": "{% macro extract_url_parameter(field, url_parameter) -%}\n\n{{ adapter.dispatch('extract_url_parameter', 'fivetran_utils') (field, url_parameter) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__extract_url_parameter"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.078492, "supported_languages": null}, "macro.fivetran_utils.default__extract_url_parameter": {"name": "default__extract_url_parameter", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/extract_url_parameter.sql", "original_file_path": "macros/extract_url_parameter.sql", "unique_id": "macro.fivetran_utils.default__extract_url_parameter", "macro_sql": "{% macro default__extract_url_parameter(field, url_parameter) -%}\n\n{{ dbt_utils.get_url_parameter(field, url_parameter) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.dbt_utils.get_url_parameter"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.078649, "supported_languages": null}, "macro.fivetran_utils.spark__extract_url_parameter": {"name": "spark__extract_url_parameter", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/extract_url_parameter.sql", "original_file_path": "macros/extract_url_parameter.sql", "unique_id": "macro.fivetran_utils.spark__extract_url_parameter", "macro_sql": "{% macro spark__extract_url_parameter(field, url_parameter) -%}\n\n{%- set formatted_url_parameter = \"'\" + url_parameter + \"=([^&]+)'\" -%}\nnullif(regexp_extract({{ field }}, {{ formatted_url_parameter }}, 1), '')\n\n{%- endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.078856, "supported_languages": null}, "macro.fivetran_utils.wrap_in_quotes": {"name": "wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.wrap_in_quotes", "macro_sql": "{%- macro wrap_in_quotes(object_to_quote) -%}\n\n{{ return(adapter.dispatch('wrap_in_quotes', 'fivetran_utils')(object_to_quote)) }}\n\n{%- endmacro -%}\n\n", "depends_on": {"macros": ["macro.fivetran_utils.default__wrap_in_quotes"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.079204, "supported_languages": null}, "macro.fivetran_utils.default__wrap_in_quotes": {"name": "default__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.default__wrap_in_quotes", "macro_sql": "{%- macro default__wrap_in_quotes(object_to_quote) -%}\n{# bigquery, spark, databricks #}\n `{{ object_to_quote }}`\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0793211, "supported_languages": null}, "macro.fivetran_utils.snowflake__wrap_in_quotes": {"name": "snowflake__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.snowflake__wrap_in_quotes", "macro_sql": "{%- macro snowflake__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote | upper }}\"\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0794392, "supported_languages": null}, "macro.fivetran_utils.redshift__wrap_in_quotes": {"name": "redshift__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.redshift__wrap_in_quotes", "macro_sql": "{%- macro redshift__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote }}\"\n{%- endmacro -%}\n\n", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.079545, "supported_languages": null}, "macro.fivetran_utils.postgres__wrap_in_quotes": {"name": "postgres__wrap_in_quotes", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/wrap_in_quotes.sql", "original_file_path": "macros/wrap_in_quotes.sql", "unique_id": "macro.fivetran_utils.postgres__wrap_in_quotes", "macro_sql": "{%- macro postgres__wrap_in_quotes(object_to_quote) -%}\n \"{{ object_to_quote }}\"\n{%- endmacro -%}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.079649, "supported_languages": null}, "macro.fivetran_utils.array_agg": {"name": "array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.array_agg", "macro_sql": "{% macro array_agg(field_to_agg) -%}\n\n{{ adapter.dispatch('array_agg', 'fivetran_utils') (field_to_agg) }}\n\n{%- endmacro %}", "depends_on": {"macros": ["macro.fivetran_utils.default__array_agg"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.079921, "supported_languages": null}, "macro.fivetran_utils.default__array_agg": {"name": "default__array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.default__array_agg", "macro_sql": "{% macro default__array_agg(field_to_agg) %}\n array_agg({{ field_to_agg }})\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.08003, "supported_languages": null}, "macro.fivetran_utils.redshift__array_agg": {"name": "redshift__array_agg", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/array_agg.sql", "original_file_path": "macros/array_agg.sql", "unique_id": "macro.fivetran_utils.redshift__array_agg", "macro_sql": "{% macro redshift__array_agg(field_to_agg) %}\n listagg({{ field_to_agg }}, ',')\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0801332, "supported_languages": null}, "macro.fivetran_utils.empty_variable_warning": {"name": "empty_variable_warning", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/empty_variable_warning.sql", "original_file_path": "macros/empty_variable_warning.sql", "unique_id": "macro.fivetran_utils.empty_variable_warning", "macro_sql": "{% macro empty_variable_warning(variable, downstream_model) %}\n\n{% if not var(variable) %}\n{{ log(\n \"\"\"\n Warning: You have passed an empty list to the \"\"\" ~ variable ~ \"\"\".\n As a result, you won't see the history of any columns in the \"\"\" ~ downstream_model ~ \"\"\" model.\n \"\"\",\n info=True\n) }}\n{% endif %}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0805418, "supported_languages": null}, "macro.fivetran_utils.enabled_vars_one_true": {"name": "enabled_vars_one_true", "resource_type": "macro", "package_name": "fivetran_utils", "path": "macros/enabled_vars_one_true.sql", "original_file_path": "macros/enabled_vars_one_true.sql", "unique_id": "macro.fivetran_utils.enabled_vars_one_true", "macro_sql": "{% macro enabled_vars_one_true(vars) %}\n\n{% for v in vars %}\n \n {% if var(v, False) == True %}\n {{ return(True) }}\n {% endif %}\n\n{% endfor %}\n\n{{ return(False) }}\n\n{% endmacro %}", "depends_on": {"macros": []}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.08095, "supported_languages": null}, "macro.marketo_source.get_activity_merge_leads_columns": {"name": "get_activity_merge_leads_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_merge_leads_columns.sql", "original_file_path": "macros/get_activity_merge_leads_columns.sql", "unique_id": "macro.marketo_source.get_activity_merge_leads_columns", "macro_sql": "{% macro get_activity_merge_leads_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"master_updated\", \"datatype\": \"boolean\"},\n {\"name\": \"merge_ids\", \"datatype\": dbt.type_string()},\n {\"name\": \"merge_source\", \"datatype\": dbt.type_string()},\n {\"name\": \"merged_in_sales\", \"datatype\": \"boolean\"},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.082416, "supported_languages": null}, "macro.marketo_source.get_activity_open_email_columns": {"name": "get_activity_open_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_open_email_columns.sql", "original_file_path": "macros/get_activity_open_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_open_email_columns", "macro_sql": "{% macro get_activity_open_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"device\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_mobile_device\", \"datatype\": \"boolean\"},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"platform\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.0843809, "supported_languages": null}, "macro.marketo_source.get_email_template_history_columns": {"name": "get_email_template_history_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_email_template_history_columns.sql", "original_file_path": "macros/get_email_template_history_columns.sql", "unique_id": "macro.marketo_source.get_email_template_history_columns", "macro_sql": "{% macro get_email_template_history_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_folder_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"folder_value\", \"datatype\": dbt.type_int()},\n {\"name\": \"from_email\", \"datatype\": dbt.type_string()},\n {\"name\": \"from_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"operational\", \"datatype\": \"boolean\"},\n {\"name\": \"program_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"publish_to_msi\", \"datatype\": \"boolean\"},\n {\"name\": \"reply_email\", \"datatype\": dbt.type_string()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()},\n {\"name\": \"subject\", \"datatype\": dbt.type_string()},\n {\"name\": \"template\", \"datatype\": dbt.type_int()},\n {\"name\": \"text_only\", \"datatype\": \"boolean\"},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"url\", \"datatype\": dbt.type_string()},\n {\"name\": \"version\", \"datatype\": dbt.type_int()},\n {\"name\": \"web_view\", \"datatype\": \"boolean\"},\n {\"name\": \"workspace\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.087074, "supported_languages": null}, "macro.marketo_source.get_lead_describe_columns": {"name": "get_lead_describe_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_lead_describe_columns.sql", "original_file_path": "macros/get_lead_describe_columns.sql", "unique_id": "macro.marketo_source.get_lead_describe_columns", "macro_sql": "{% macro get_lead_describe_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"data_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"display_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"length\", \"datatype\": dbt.type_int()},\n {\"name\": \"restname\", \"datatype\": dbt.type_string()},\n {\"name\": \"restread_only\", \"datatype\": \"boolean\"},\n {\"name\": \"soapname\", \"datatype\": dbt.type_string()},\n {\"name\": \"soapread_only\", \"datatype\": \"boolean\"}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.088174, "supported_languages": null}, "macro.marketo_source.get_activity_send_email_columns": {"name": "get_activity_send_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_send_email_columns.sql", "original_file_path": "macros/get_activity_send_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_send_email_columns", "macro_sql": "{% macro get_activity_send_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ fivetran_utils.add_pass_through_columns(columns, var('marketo__activity_send_email_passthrough_columns')) }}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string", "macro.fivetran_utils.add_pass_through_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.089706, "supported_languages": null}, "macro.marketo_source.get_campaign_columns": {"name": "get_campaign_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_campaign_columns.sql", "original_file_path": "macros/get_campaign_columns.sql", "unique_id": "macro.marketo_source.get_campaign_columns", "macro_sql": "{% macro get_campaign_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"_fivetran_deleted\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"active\", \"datatype\": \"boolean\"},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"program_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"type\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"workspace_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"computed_url\", \"datatype\": dbt.type_string()},\n {\"name\": \"flow_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"folder_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_communication_limit_enabled\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"is_requestable\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"is_system\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"max_members\", \"datatype\": dbt.type_int()},\n {\"name\": \"qualification_rule_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"qualification_rule_interval\", \"datatype\": dbt.type_int()},\n {\"name\": \"qualification_rule_unit\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_start_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"recurrence_end_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"recurrence_interval_type\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_interval\", \"datatype\": dbt.type_int()},\n {\"name\": \"recurrence_weekday_only\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"recurrence_day_of_month\", \"datatype\": dbt.type_int()},\n {\"name\": \"recurrence_day_of_week\", \"datatype\": dbt.type_string()},\n {\"name\": \"recurrence_week_of_month\", \"datatype\": dbt.type_int()},\n {\"name\": \"smart_list_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_boolean", "macro.dbt.type_string", "macro.dbt.type_int"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.09345, "supported_languages": null}, "macro.marketo_source.get_activity_delete_lead_columns": {"name": "get_activity_delete_lead_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_delete_lead_columns.sql", "original_file_path": "macros/get_activity_delete_lead_columns.sql", "unique_id": "macro.marketo_source.get_activity_delete_lead_columns", "macro_sql": "{% macro get_activity_delete_lead_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign\", \"datatype\": dbt.type_string()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.094582, "supported_languages": null}, "macro.marketo_source.get_activity_unsubscribe_email_columns": {"name": "get_activity_unsubscribe_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_unsubscribe_email_columns.sql", "original_file_path": "macros/get_activity_unsubscribe_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_unsubscribe_email_columns", "macro_sql": "{% macro get_activity_unsubscribe_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"client_ip_address\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"form_fields\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"query_parameters\", \"datatype\": dbt.type_string()},\n {\"name\": \"referrer_url\", \"datatype\": dbt.type_string()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()},\n {\"name\": \"webform_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"webpage_id\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.096737, "supported_languages": null}, "macro.marketo_source.get_program_columns": {"name": "get_program_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_program_columns.sql", "original_file_path": "macros/get_program_columns.sql", "unique_id": "macro.marketo_source.get_program_columns", "macro_sql": "{% macro get_program_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"_fivetran_deleted\", \"datatype\": dbt.type_boolean()},\n {\"name\": \"channel\", \"datatype\": dbt.type_string()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"description\", \"datatype\": dbt.type_string()},\n {\"name\": \"end_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"id\", \"datatype\": dbt.type_int()},\n {\"name\": \"name\", \"datatype\": dbt.type_string()},\n {\"name\": \"sfdc_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"sfdc_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"start_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"status\", \"datatype\": dbt.type_string()},\n {\"name\": \"type\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"url\", \"datatype\": dbt.type_string()},\n {\"name\": \"workspace\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ fivetran_utils.add_pass_through_columns(columns, var('marketo__program_passthrough_columns')) }}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_boolean", "macro.dbt.type_string", "macro.dbt.type_int", "macro.fivetran_utils.add_pass_through_columns"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.098718, "supported_languages": null}, "macro.marketo_source.get_activity_email_bounced_columns": {"name": "get_activity_email_bounced_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_email_bounced_columns.sql", "original_file_path": "macros/get_activity_email_bounced_columns.sql", "unique_id": "macro.marketo_source.get_activity_email_bounced_columns", "macro_sql": "{% macro get_activity_email_bounced_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"category\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"details\", \"datatype\": dbt.type_string()},\n {\"name\": \"email\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"subcategory\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.100689, "supported_languages": null}, "macro.marketo_source.get_lead_columns": {"name": "get_lead_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_lead_columns.sql", "original_file_path": "macros/get_lead_columns.sql", "unique_id": "macro.marketo_source.get_lead_columns", "macro_sql": "{% macro get_lead_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"created_at\", \"datatype\": dbt.type_timestamp(), \"alias\": \"created_timestamp\"},\n {\"name\": \"email\", \"datatype\": dbt.type_string()},\n {\"name\": \"first_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"id\", \"datatype\": dbt.type_int(), \"alias\": \"lead_id\"},\n {\"name\": \"last_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"updated_at\", \"datatype\": dbt.type_timestamp(), \"alias\": \"updated_timestamp\"},\n {\"name\": \"phone\", \"datatype\": dbt.type_string()},\n {\"name\": \"main_phone\", \"datatype\": dbt.type_string()},\n {\"name\": \"mobile_phone\", \"datatype\": dbt.type_string()},\n {\"name\": \"company\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_company\", \"datatype\": dbt.type_string()},\n {\"name\": \"address_lead\", \"datatype\": dbt.type_string()},\n {\"name\": \"address\", \"datatype\": dbt.type_string()},\n {\"name\": \"city\", \"datatype\": dbt.type_string()},\n {\"name\": \"state\", \"datatype\": dbt.type_string()},\n {\"name\": \"state_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"country\", \"datatype\": dbt.type_string()},\n {\"name\": \"country_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"postal_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_street\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_city\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_state\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_state_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_country\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_country_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"billing_postal_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_city\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_state_region\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_country\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_postal_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"inferred_phone_area_code\", \"datatype\": dbt.type_string()},\n {\"name\": \"anonymous_ip\", \"datatype\": dbt.type_string()},\n {\"name\": \"unsubscribed\", \"datatype\": dbt.type_boolean(), \"alias\": \"is_unsubscribed\"},\n {\"name\": \"email_invalid\", \"datatype\": dbt.type_boolean(), \"alias\": \"is_email_invalid\"},\n {\"name\": \"do_not_call\", \"datatype\": dbt.type_boolean()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_string", "macro.dbt.type_int", "macro.dbt.type_boolean"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.105197, "supported_languages": null}, "macro.marketo_source.get_activity_email_delivered_columns": {"name": "get_activity_email_delivered_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_email_delivered_columns.sql", "original_file_path": "macros/get_activity_email_delivered_columns.sql", "unique_id": "macro.marketo_source.get_activity_email_delivered_columns", "macro_sql": "{% macro get_activity_email_delivered_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.106775, "supported_languages": null}, "macro.marketo_source.get_activity_click_email_columns": {"name": "get_activity_click_email_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_click_email_columns.sql", "original_file_path": "macros/get_activity_click_email_columns.sql", "unique_id": "macro.marketo_source.get_activity_click_email_columns", "macro_sql": "{% macro get_activity_click_email_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"campaign_run_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"choice_number\", \"datatype\": dbt.type_int()},\n {\"name\": \"device\", \"datatype\": dbt.type_string()},\n {\"name\": \"email_template_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"is_mobile_device\", \"datatype\": \"boolean\"},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"link\", \"datatype\": dbt.type_string()},\n {\"name\": \"link_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"platform\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"step_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"test_variant\", \"datatype\": dbt.type_int()},\n {\"name\": \"user_agent\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.108953, "supported_languages": null}, "macro.marketo_source.get_activity_change_data_value_columns": {"name": "get_activity_change_data_value_columns", "resource_type": "macro", "package_name": "marketo_source", "path": "macros/get_activity_change_data_value_columns.sql", "original_file_path": "macros/get_activity_change_data_value_columns.sql", "unique_id": "macro.marketo_source.get_activity_change_data_value_columns", "macro_sql": "{% macro get_activity_change_data_value_columns() %}\n\n{% set columns = [\n {\"name\": \"_fivetran_synced\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_date\", \"datatype\": dbt.type_timestamp()},\n {\"name\": \"activity_type_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"api_method_name\", \"datatype\": dbt.type_string()},\n {\"name\": \"campaign_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"id\", \"datatype\": dbt.type_string()},\n {\"name\": \"lead_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"modifying_user\", \"datatype\": dbt.type_string()},\n {\"name\": \"new_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"old_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value\", \"datatype\": dbt.type_string()},\n {\"name\": \"primary_attribute_value_id\", \"datatype\": dbt.type_int()},\n {\"name\": \"reason\", \"datatype\": dbt.type_string()},\n {\"name\": \"request_id\", \"datatype\": dbt.type_string()},\n {\"name\": \"source\", \"datatype\": dbt.type_string()}\n] %}\n\n{{ return(columns) }}\n\n{% endmacro %}", "depends_on": {"macros": ["macro.dbt.type_timestamp", "macro.dbt.type_int", "macro.dbt.type_string"]}, "description": "", "meta": {}, "docs": {"show": true, "node_color": null}, "patch_path": null, "arguments": [], "created_at": 1709220403.110709, "supported_languages": null}}, "docs": {"doc.dbt.__overview__": {"name": "__overview__", "resource_type": "doc", "package_name": "dbt", "path": "overview.md", "original_file_path": "docs/overview.md", "unique_id": "doc.dbt.__overview__", "block_contents": "### Welcome!\n\nWelcome to the auto-generated documentation for your dbt project!\n\n### Navigation\n\nYou can use the `Project` and `Database` navigation tabs on the left side of the window to explore the models\nin your project.\n\n#### Project Tab\nThe `Project` tab mirrors the directory structure of your dbt project. In this tab, you can see all of the\nmodels defined in your dbt project, as well as models imported from dbt packages.\n\n#### Database Tab\nThe `Database` tab also exposes your models, but in a format that looks more like a database explorer. This view\nshows relations (tables and views) grouped into database schemas. Note that ephemeral models are _not_ shown\nin this interface, as they do not exist in the database.\n\n### Graph Exploration\nYou can click the blue icon on the bottom-right corner of the page to view the lineage graph of your models.\n\nOn model pages, you'll see the immediate parents and children of the model you're exploring. By clicking the `Expand`\nbutton at the top-right of this lineage pane, you'll be able to see all of the models that are used to build,\nor are built from, the model you're exploring.\n\nOnce expanded, you'll be able to use the `--select` and `--exclude` model selection syntax to filter the\nmodels in the graph. For more information on model selection, check out the [dbt docs](https://docs.getdbt.com/docs/model-selection-syntax).\n\nNote that you can also right-click on models to interactively filter and explore the graph.\n\n---\n\n### More information\n\n- [What is dbt](https://docs.getdbt.com/docs/introduction)?\n- Read the [dbt viewpoint](https://docs.getdbt.com/docs/viewpoint)\n- [Installation](https://docs.getdbt.com/docs/installation)\n- Join the [dbt Community](https://www.getdbt.com/community/) for questions and discussion"}}, "exposures": {}, "metrics": {}, "groups": {}, "selectors": {}, "disabled": {"model.marketo_source.stg_marketo__campaigns": [{"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__campaigns", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__campaigns.sql", "original_file_path": "models/stg_marketo__campaigns.sql", "unique_id": "model.marketo_source.stg_marketo__campaigns", "fqn": ["marketo_source", "stg_marketo__campaigns"], "alias": "stg_marketo__campaigns", "checksum": {"name": "sha256", "checksum": "030c8c6c4498ff51d6833da7ba521ff5693f7c537caeb62202b9fd4b648ce245"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"campaign_id": {"name": "campaign_id", "description": "ID of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_name": {"name": "campaign_name", "description": "Name of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "campaign_type": {"name": "campaign_type", "description": "Type of campaign, either 'batch' or 'trigger'.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp when the campaign was created.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the campaign", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_active": {"name": "is_active", "description": "Whether the campaign is active. Only applicable to trigger campaigns.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_id": {"name": "program_id", "description": "ID of the parent program, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp when the campaign was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace_name": {"name": "workspace_name", "description": "Name of the parent workspace, if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "computed_url": {"name": "computed_url", "description": "The URL of the campaign in Marketo.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "flow_id": {"name": "flow_id", "description": "The ID of the flow that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_id": {"name": "folder_id", "description": "The ID of the folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "folder_type": {"name": "folder_type", "description": "The type of folder that the campaign is stored in.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_communication_limit_enabled": {"name": "is_communication_limit_enabled", "description": "Whether or not the campaign has a communication limit.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_requestable": {"name": "is_requestable", "description": "Whether or not the campaign can be requested by leads.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "is_system": {"name": "is_system", "description": "Whether or not the campaign is a system campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "max_members": {"name": "max_members", "description": "The maximum number of members that the campaign can have.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_type": {"name": "qualification_rule_type", "description": "The type of qualification rule that the campaign uses.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_interval": {"name": "qualification_rule_interval", "description": "The interval for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "qualification_rule_unit": {"name": "qualification_rule_unit", "description": "The unit for the qualification rule.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_start_at": {"name": "recurrence_start_at", "description": "The start date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_end_at": {"name": "recurrence_end_at", "description": "The end date and time for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval_type": {"name": "recurrence_interval_type", "description": "The type of recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_interval": {"name": "recurrence_interval", "description": "The value of the recurrence interval.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_weekday_only": {"name": "recurrence_weekday_only", "description": "Whether or not the recurrence is limited to weekdays.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_month": {"name": "recurrence_day_of_month", "description": "The day of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_day_of_week": {"name": "recurrence_day_of_week", "description": "The day of the week for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "recurrence_week_of_month": {"name": "recurrence_week_of_month", "description": "The week of the month for the recurrence.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "smart_list_id": {"name": "smart_list_id", "description": "The ID of the smart list that the campaign is associated with.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "status": {"name": "status", "description": "The status of the campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": false}, "created_at": 1709220403.985583, "config_call_dict": {"enabled": false}, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__campaigns`", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__campaign_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__campaign_tmp')),\n staging_columns=get_campaign_columns()\n )\n }}\n from base\n\n), fields as (\n\n select \n active as is_active,\n created_at as created_timestamp,\n description,\n id as campaign_id,\n name as campaign_name,\n program_id,\n type as campaign_type,\n updated_at as updated_timestamp,\n workspace_name,\n computed_url,\n flow_id,\n folder_id,\n folder_type,\n is_communication_limit_enabled,\n is_requestable,\n is_system,\n max_members,\n qualification_rule_type,\n qualification_rule_interval,\n qualification_rule_unit,\n recurrence_start_at,\n recurrence_end_at,\n recurrence_interval_type,\n recurrence_interval,\n recurrence_weekday_only,\n recurrence_day_of_month,\n recurrence_day_of_week,\n recurrence_week_of_month,\n smart_list_id,\n status\n from macro\n where not coalesce(_fivetran_deleted, false)\n\n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__campaign_tmp", "package": null, "version": null}, {"name": "stg_marketo__campaign_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_campaign_columns", "macro.fivetran_utils.fill_staging_columns"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null, "defer_relation": null}], "model.marketo_source.stg_marketo__program": [{"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__program", "resource_type": "model", "package_name": "marketo_source", "path": "stg_marketo__program.sql", "original_file_path": "models/stg_marketo__program.sql", "unique_id": "model.marketo_source.stg_marketo__program", "fqn": ["marketo_source", "stg_marketo__program"], "alias": "stg_marketo__program", "checksum": {"name": "sha256", "checksum": "0bb50c66626098d0b654bda8eb1ce87421e8c5e3b9a4b583016c67dbd79753cf"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "table", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {"program_id": {"name": "program_id", "description": "ID of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "channel": {"name": "channel", "description": "Channel of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "created_timestamp": {"name": "created_timestamp", "description": "Timestamp the program was created at", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "description": {"name": "description", "description": "Description of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "end_timestamp": {"name": "end_timestamp", "description": "End date of the program. Applicable to event, email, and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_name": {"name": "program_name", "description": "Name of the program.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_status": {"name": "program_status", "description": "Status of the program. Only valid for Email and engagement program types.\nAllowed values: locked, unlocked, on, off\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "program_type": {"name": "program_type", "description": "Type of the program. Allowed values: program, event, webinar, nurture\n", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_id": {"name": "sfdc_id", "description": "SFDC id of the program if linked to an SFDC campaign.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "sfdc_name": {"name": "sfdc_name", "description": "Name of the linked SFDC campaign if applicable.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "start_timestamp": {"name": "start_timestamp", "description": "Start date of program. Applicable to event, email and webinar type programs.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "updated_timestamp": {"name": "updated_timestamp", "description": "Timestamp the program was most recently updated.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "url": {"name": "url", "description": "URL of the program in the Marketo UI.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}, "workspace": {"name": "workspace", "description": "Name of the workspace.", "meta": {}, "data_type": null, "constraints": [], "quote": null, "tags": []}}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": "marketo_source://models/stg_marketo.yml", "build_path": null, "deferred": false, "unrendered_config": {"materialized": "table", "schema": "marketo_source", "enabled": false}, "created_at": 1709220403.992913, "config_call_dict": {"enabled": false}, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__program`", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False) and var('marketo__enable_programs', False)) }}\n\nwith base as (\n\n select *\n from {{ ref('stg_marketo__program_tmp') }}\n\n), macro as (\n\n select\n {{\n fivetran_utils.fill_staging_columns(\n source_columns=adapter.get_columns_in_relation(ref('stg_marketo__program_tmp')),\n staging_columns=get_program_columns()\n )\n }}\n from base\n\n), fields as (\n\n select\n id as program_id,\n channel,\n created_at as created_timestamp,\n description,\n end_date as end_timestamp,\n name as program_name,\n sfdc_id,\n sfdc_name,\n start_date as start_timestamp,\n status as program_status,\n type as program_type,\n updated_at as updated_timestamp,\n url,\n workspace\n\n {{ fivetran_utils.fill_pass_through_columns('marketo__program_passthrough_columns') }}\n\n from macro\n where not coalesce(_fivetran_deleted, false)\n \n)\n\nselect *\nfrom fields", "language": "sql", "refs": [{"name": "stg_marketo__program_tmp", "package": null, "version": null}, {"name": "stg_marketo__program_tmp", "package": null, "version": null}], "sources": [], "metrics": [], "depends_on": {"macros": ["macro.marketo_source.get_program_columns", "macro.fivetran_utils.fill_staging_columns", "macro.fivetran_utils.fill_pass_through_columns"], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null, "defer_relation": null}], "model.marketo_source.stg_marketo__campaign_tmp": [{"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__campaign_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__campaign_tmp.sql", "original_file_path": "models/tmp/stg_marketo__campaign_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__campaign_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__campaign_tmp"], "alias": "stg_marketo__campaign_tmp", "checksum": {"name": "sha256", "checksum": "b2cf4d02eab92151ffe1f387bdefeb8e195d49360e44876afa09f204900a08f0"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": false}, "created_at": 1709220403.835252, "config_call_dict": {"enabled": false}, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__campaign_tmp`", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False)) }}\n\nselect *\nfrom {{ var('campaign') }}", "language": "sql", "refs": [], "sources": [["marketo", "campaign"]], "metrics": [], "depends_on": {"macros": [], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null, "defer_relation": null}], "model.marketo_source.stg_marketo__program_tmp": [{"database": "dbt-package-testing", "schema": "marketo_source_marketo_source", "name": "stg_marketo__program_tmp", "resource_type": "model", "package_name": "marketo_source", "path": "tmp/stg_marketo__program_tmp.sql", "original_file_path": "models/tmp/stg_marketo__program_tmp.sql", "unique_id": "model.marketo_source.stg_marketo__program_tmp", "fqn": ["marketo_source", "tmp", "stg_marketo__program_tmp"], "alias": "stg_marketo__program_tmp", "checksum": {"name": "sha256", "checksum": "939b7102425fcac3e35b676d6f4cbf2d04fbcbfde99ca3953e4c8a1e1a89e401"}, "config": {"enabled": false, "alias": null, "schema": "marketo_source", "database": null, "tags": [], "meta": {}, "group": null, "materialized": "view", "incremental_strategy": null, "persist_docs": {}, "post-hook": [], "pre-hook": [], "quoting": {}, "column_types": {}, "full_refresh": null, "unique_key": null, "on_schema_change": "ignore", "on_configuration_change": "apply", "grants": {}, "packages": [], "docs": {"show": true, "node_color": null}, "contract": {"enforced": false, "alias_types": true}, "access": "protected"}, "tags": [], "description": "", "columns": {}, "meta": {}, "group": null, "docs": {"show": true, "node_color": null}, "patch_path": null, "build_path": null, "deferred": false, "unrendered_config": {"materialized": "view", "schema": "marketo_source", "enabled": false}, "created_at": 1709220403.861173, "config_call_dict": {"enabled": false}, "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__program_tmp`", "raw_code": "{{ config(enabled=var('marketo__enable_campaigns', False) and var('marketo__enable_programs', False)) }}\n\nselect *\nfrom {{ var('program') }}", "language": "sql", "refs": [], "sources": [["marketo", "program"]], "metrics": [], "depends_on": {"macros": [], "nodes": []}, "compiled_path": null, "contract": {"enforced": false, "alias_types": true, "checksum": null}, "access": "protected", "constraints": [], "version": null, "latest_version": null, "deprecation_date": null, "defer_relation": null}]}, "parent_map": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": [], "seed.marketo_source_integration_tests.marketo_email_template_history_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": [], "seed.marketo_source_integration_tests.marketo_lead_describe_data": [], "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": [], "seed.marketo_source_integration_tests.marketo_campaign_data": [], "seed.marketo_source_integration_tests.marketo_program_data": [], "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": [], "seed.marketo_source_integration_tests.marketo_activity_click_email_data": [], "seed.marketo_source_integration_tests.marketo_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_open_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": [], "model.marketo_source.stg_marketo__activity_merge_leads": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp"], "model.marketo_source.stg_marketo__activity_open_email": ["model.marketo_source.stg_marketo__activity_open_email_tmp"], "model.marketo_source.stg_marketo__activity_send_email": ["model.marketo_source.stg_marketo__activity_send_email_tmp"], "model.marketo_source.stg_marketo__email_template_history": ["model.marketo_source.stg_marketo__email_template_history_tmp"], "model.marketo_source.stg_marketo__activity_email_bounced": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp"], "model.marketo_source.stg_marketo__activity_change_data_value": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp"], "model.marketo_source.stg_marketo__activity_delete_lead": ["model.marketo_source.stg_marketo__activity_delete_lead_tmp"], "model.marketo_source.stg_marketo__lead": ["model.marketo_source.stg_marketo__lead_tmp"], "model.marketo_source.stg_marketo__activity_email_delivered": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp"], "model.marketo_source.stg_marketo__activity_click_email": ["model.marketo_source.stg_marketo__activity_click_email_tmp"], "model.marketo_source.stg_marketo__lead_describe": ["model.marketo_source.stg_marketo__lead_describe_tmp"], "model.marketo_source.stg_marketo__activity_unsubscribe_email": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"], "model.marketo_source.stg_marketo__activity_email_delivered_tmp": ["source.marketo_source.marketo.activity_email_delivered"], "model.marketo_source.stg_marketo__activity_click_email_tmp": ["source.marketo_source.marketo.activity_click_email"], "model.marketo_source.stg_marketo__lead_describe_tmp": ["source.marketo_source.marketo.lead_describe"], "model.marketo_source.stg_marketo__activity_delete_lead_tmp": ["source.marketo_source.marketo.activity_delete_lead"], "model.marketo_source.stg_marketo__activity_change_data_value_tmp": ["source.marketo_source.marketo.activity_change_data_value"], "model.marketo_source.stg_marketo__activity_email_bounced_tmp": ["source.marketo_source.marketo.activity_email_bounced"], "model.marketo_source.stg_marketo__activity_open_email_tmp": ["source.marketo_source.marketo.activity_open_email"], "model.marketo_source.stg_marketo__activity_merge_leads_tmp": ["source.marketo_source.marketo.activity_merge_leads"], "model.marketo_source.stg_marketo__activity_send_email_tmp": ["source.marketo_source.marketo.activity_send_email"], "model.marketo_source.stg_marketo__email_template_history_tmp": ["source.marketo_source.marketo.email_template_history"], "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": ["source.marketo_source.marketo.activity_unsubscribe_email"], "model.marketo_source.stg_marketo__lead_tmp": ["source.marketo_source.marketo.lead"], "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": ["model.marketo_source.stg_marketo__activity_change_data_value"], "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": ["model.marketo_source.stg_marketo__activity_change_data_value"], "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": ["model.marketo_source.stg_marketo__activity_click_email"], "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": ["model.marketo_source.stg_marketo__activity_click_email"], "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": ["model.marketo_source.stg_marketo__activity_email_bounced"], "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": ["model.marketo_source.stg_marketo__activity_email_bounced"], "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": ["model.marketo_source.stg_marketo__activity_email_delivered"], "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": ["model.marketo_source.stg_marketo__activity_email_delivered"], "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": ["model.marketo_source.stg_marketo__activity_open_email"], "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": ["model.marketo_source.stg_marketo__activity_open_email"], "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": ["model.marketo_source.stg_marketo__activity_send_email"], "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": ["model.marketo_source.stg_marketo__activity_send_email"], "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"], "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"], "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": [], "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": [], "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": ["model.marketo_source.stg_marketo__email_template_history"], "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": ["model.marketo_source.stg_marketo__email_template_history"], "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": ["model.marketo_source.stg_marketo__lead_describe"], "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": ["model.marketo_source.stg_marketo__lead_describe"], "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": ["model.marketo_source.stg_marketo__lead"], "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": ["model.marketo_source.stg_marketo__lead"], "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": [], "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": [], "source.marketo_source.marketo.lead": [], "source.marketo_source.marketo.lead_describe": [], "source.marketo_source.marketo.activity_change_data_value": [], "source.marketo_source.marketo.campaign": [], "source.marketo_source.marketo.program": [], "source.marketo_source.marketo.email_template_history": [], "source.marketo_source.marketo.activity_click_email": [], "source.marketo_source.marketo.activity_email_delivered": [], "source.marketo_source.marketo.activity_email_bounced": [], "source.marketo_source.marketo.activity_open_email": [], "source.marketo_source.marketo.activity_unsubscribe_email": [], "source.marketo_source.marketo.activity_send_email": [], "source.marketo_source.marketo.activity_delete_lead": [], "source.marketo_source.marketo.activity_merge_leads": []}, "child_map": {"seed.marketo_source_integration_tests.marketo_activity_send_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data": [], "seed.marketo_source_integration_tests.marketo_email_template_history_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data": [], "seed.marketo_source_integration_tests.marketo_lead_describe_data": [], "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data": [], "seed.marketo_source_integration_tests.marketo_campaign_data": [], "seed.marketo_source_integration_tests.marketo_program_data": [], "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data": [], "seed.marketo_source_integration_tests.marketo_activity_click_email_data": [], "seed.marketo_source_integration_tests.marketo_lead_data": [], "seed.marketo_source_integration_tests.marketo_activity_open_email_data": [], "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data": [], "model.marketo_source.stg_marketo__activity_merge_leads": [], "model.marketo_source.stg_marketo__activity_open_email": ["test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396", "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6"], "model.marketo_source.stg_marketo__activity_send_email": ["test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8", "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1"], "model.marketo_source.stg_marketo__email_template_history": ["test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa", "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2"], "model.marketo_source.stg_marketo__activity_email_bounced": ["test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2", "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3"], "model.marketo_source.stg_marketo__activity_change_data_value": ["test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108", "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd"], "model.marketo_source.stg_marketo__activity_delete_lead": [], "model.marketo_source.stg_marketo__lead": ["test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055", "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f"], "model.marketo_source.stg_marketo__activity_email_delivered": ["test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885", "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87"], "model.marketo_source.stg_marketo__activity_click_email": ["test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd", "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0"], "model.marketo_source.stg_marketo__lead_describe": ["test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879", "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1"], "model.marketo_source.stg_marketo__activity_unsubscribe_email": ["test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0", "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06"], "model.marketo_source.stg_marketo__activity_email_delivered_tmp": ["model.marketo_source.stg_marketo__activity_email_delivered"], "model.marketo_source.stg_marketo__activity_click_email_tmp": ["model.marketo_source.stg_marketo__activity_click_email"], "model.marketo_source.stg_marketo__lead_describe_tmp": ["model.marketo_source.stg_marketo__lead_describe"], "model.marketo_source.stg_marketo__activity_delete_lead_tmp": ["model.marketo_source.stg_marketo__activity_delete_lead"], "model.marketo_source.stg_marketo__activity_change_data_value_tmp": ["model.marketo_source.stg_marketo__activity_change_data_value"], "model.marketo_source.stg_marketo__activity_email_bounced_tmp": ["model.marketo_source.stg_marketo__activity_email_bounced"], "model.marketo_source.stg_marketo__activity_open_email_tmp": ["model.marketo_source.stg_marketo__activity_open_email"], "model.marketo_source.stg_marketo__activity_merge_leads_tmp": ["model.marketo_source.stg_marketo__activity_merge_leads"], "model.marketo_source.stg_marketo__activity_send_email_tmp": ["model.marketo_source.stg_marketo__activity_send_email"], "model.marketo_source.stg_marketo__email_template_history_tmp": ["model.marketo_source.stg_marketo__email_template_history"], "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp": ["model.marketo_source.stg_marketo__activity_unsubscribe_email"], "model.marketo_source.stg_marketo__lead_tmp": ["model.marketo_source.stg_marketo__lead"], "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd": [], "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108": [], "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0": [], "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd": [], "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3": [], "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2": [], "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87": [], "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885": [], "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6": [], "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396": [], "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1": [], "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8": [], "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06": [], "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0": [], "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925": [], "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112": [], "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2": [], "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa": [], "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1": [], "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879": [], "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f": [], "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055": [], "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c": [], "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f": [], "source.marketo_source.marketo.lead": ["model.marketo_source.stg_marketo__lead_tmp"], "source.marketo_source.marketo.lead_describe": ["model.marketo_source.stg_marketo__lead_describe_tmp"], "source.marketo_source.marketo.activity_change_data_value": ["model.marketo_source.stg_marketo__activity_change_data_value_tmp"], "source.marketo_source.marketo.campaign": [], "source.marketo_source.marketo.program": [], "source.marketo_source.marketo.email_template_history": ["model.marketo_source.stg_marketo__email_template_history_tmp"], "source.marketo_source.marketo.activity_click_email": ["model.marketo_source.stg_marketo__activity_click_email_tmp"], "source.marketo_source.marketo.activity_email_delivered": ["model.marketo_source.stg_marketo__activity_email_delivered_tmp"], "source.marketo_source.marketo.activity_email_bounced": ["model.marketo_source.stg_marketo__activity_email_bounced_tmp"], "source.marketo_source.marketo.activity_open_email": ["model.marketo_source.stg_marketo__activity_open_email_tmp"], "source.marketo_source.marketo.activity_unsubscribe_email": ["model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"], "source.marketo_source.marketo.activity_send_email": ["model.marketo_source.stg_marketo__activity_send_email_tmp"], "source.marketo_source.marketo.activity_delete_lead": ["model.marketo_source.stg_marketo__activity_delete_lead_tmp"], "source.marketo_source.marketo.activity_merge_leads": ["model.marketo_source.stg_marketo__activity_merge_leads_tmp"]}, "group_map": {}, "saved_queries": {}, "semantic_models": {}} \ No newline at end of file diff --git a/docs/run_results.json b/docs/run_results.json index 994f546..e051d74 100644 --- a/docs/run_results.json +++ b/docs/run_results.json @@ -1 +1 @@ -{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/run-results/v4.json", "dbt_version": "1.5.2", "generated_at": "2023-07-10T15:59:19.057706Z", "invocation_id": "a54949a1-70a0-4ef8-9821-109da0cc584f", "env": {}}, "results": [{"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.138466Z", "completed_at": "2023-07-10T15:59:17.157677Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.164534Z", "completed_at": "2023-07-10T15:59:17.164547Z"}], "thread_id": "Thread-1", "execution_time": 0.034657955169677734, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.142425Z", "completed_at": "2023-07-10T15:59:17.160631Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.165364Z", "completed_at": "2023-07-10T15:59:17.165369Z"}], "thread_id": "Thread-2", "execution_time": 0.03471112251281738, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.144842Z", "completed_at": "2023-07-10T15:59:17.161119Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.165629Z", "completed_at": "2023-07-10T15:59:17.165637Z"}], "thread_id": "Thread-3", "execution_time": 0.034622907638549805, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.146922Z", "completed_at": "2023-07-10T15:59:17.161547Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.165960Z", "completed_at": "2023-07-10T15:59:17.165967Z"}], "thread_id": "Thread-4", "execution_time": 0.03472495079040527, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.149655Z", "completed_at": "2023-07-10T15:59:17.161876Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.166637Z", "completed_at": "2023-07-10T15:59:17.166645Z"}], "thread_id": "Thread-5", "execution_time": 0.03483986854553223, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.152846Z", "completed_at": "2023-07-10T15:59:17.162484Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.167606Z", "completed_at": "2023-07-10T15:59:17.167613Z"}], "thread_id": "Thread-6", "execution_time": 0.03540778160095215, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.155304Z", "completed_at": "2023-07-10T15:59:17.162800Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.167943Z", "completed_at": "2023-07-10T15:59:17.167950Z"}], "thread_id": "Thread-7", "execution_time": 0.035733938217163086, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.158088Z", "completed_at": "2023-07-10T15:59:17.163963Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.169983Z", "completed_at": "2023-07-10T15:59:17.169988Z"}], "thread_id": "Thread-8", "execution_time": 0.03633880615234375, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.191615Z", "completed_at": "2023-07-10T15:59:17.192575Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.201411Z", "completed_at": "2023-07-10T15:59:17.201420Z"}], "thread_id": "Thread-6", "execution_time": 0.025452136993408203, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.192906Z", "completed_at": "2023-07-10T15:59:17.193804Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.201739Z", "completed_at": "2023-07-10T15:59:17.201747Z"}], "thread_id": "Thread-7", "execution_time": 0.02548980712890625, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.179715Z", "completed_at": "2023-07-10T15:59:17.194198Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.202052Z", "completed_at": "2023-07-10T15:59:17.202056Z"}], "thread_id": "Thread-4", "execution_time": 0.027712106704711914, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.185874Z", "completed_at": "2023-07-10T15:59:17.194762Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.202438Z", "completed_at": "2023-07-10T15:59:17.202442Z"}], "thread_id": "Thread-2", "execution_time": 0.02947402000427246, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.182857Z", "completed_at": "2023-07-10T15:59:17.195029Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.202895Z", "completed_at": "2023-07-10T15:59:17.202899Z"}], "thread_id": "Thread-1", "execution_time": 0.03202414512634277, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__campaign_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.188904Z", "completed_at": "2023-07-10T15:59:17.195271Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.203149Z", "completed_at": "2023-07-10T15:59:17.203157Z"}], "thread_id": "Thread-3", "execution_time": 0.030352115631103516, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.195568Z", "completed_at": "2023-07-10T15:59:17.196568Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.203466Z", "completed_at": "2023-07-10T15:59:17.203470Z"}], "thread_id": "Thread-8", "execution_time": 0.02557992935180664, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.196876Z", "completed_at": "2023-07-10T15:59:17.202649Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.209344Z", "completed_at": "2023-07-10T15:59:17.209349Z"}], "thread_id": "Thread-5", "execution_time": 0.029721736907958984, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__program_tmp"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.217783Z", "completed_at": "2023-07-10T15:59:17.219017Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.227866Z", "completed_at": "2023-07-10T15:59:17.227873Z"}], "thread_id": "Thread-6", "execution_time": 0.02069401741027832, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.219323Z", "completed_at": "2023-07-10T15:59:17.220885Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.228076Z", "completed_at": "2023-07-10T15:59:17.228079Z"}], "thread_id": "Thread-7", "execution_time": 0.020700931549072266, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.221124Z", "completed_at": "2023-07-10T15:59:17.221919Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.228346Z", "completed_at": "2023-07-10T15:59:17.228356Z"}], "thread_id": "Thread-4", "execution_time": 0.020764827728271484, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.222142Z", "completed_at": "2023-07-10T15:59:17.222931Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.228720Z", "completed_at": "2023-07-10T15:59:17.228724Z"}], "thread_id": "Thread-2", "execution_time": 0.020772933959960938, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.223507Z", "completed_at": "2023-07-10T15:59:17.224325Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.230333Z", "completed_at": "2023-07-10T15:59:17.230338Z"}], "thread_id": "Thread-1", "execution_time": 0.02047109603881836, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.224540Z", "completed_at": "2023-07-10T15:59:17.225295Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.230562Z", "completed_at": "2023-07-10T15:59:17.230565Z"}], "thread_id": "Thread-3", "execution_time": 0.02045297622680664, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.225523Z", "completed_at": "2023-07-10T15:59:17.226345Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.230777Z", "completed_at": "2023-07-10T15:59:17.230779Z"}], "thread_id": "Thread-8", "execution_time": 0.020509958267211914, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.228972Z", "completed_at": "2023-07-10T15:59:17.230015Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.235191Z", "completed_at": "2023-07-10T15:59:17.235195Z"}], "thread_id": "Thread-5", "execution_time": 0.014700174331665039, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.241918Z", "completed_at": "2023-07-10T15:59:17.243876Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.266933Z", "completed_at": "2023-07-10T15:59:17.266941Z"}], "thread_id": "Thread-6", "execution_time": 0.05800509452819824, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.244201Z", "completed_at": "2023-07-10T15:59:17.245258Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.267204Z", "completed_at": "2023-07-10T15:59:17.267215Z"}], "thread_id": "Thread-7", "execution_time": 0.058068037033081055, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.245602Z", "completed_at": "2023-07-10T15:59:17.246451Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.267493Z", "completed_at": "2023-07-10T15:59:17.267496Z"}], "thread_id": "Thread-4", "execution_time": 0.058161258697509766, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_program_data"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.267873Z", "completed_at": "2023-07-10T15:59:17.895963Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.896407Z", "completed_at": "2023-07-10T15:59:17.896415Z"}], "thread_id": "Thread-5", "execution_time": 0.7005820274353027, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.257865Z", "completed_at": "2023-07-10T15:59:17.926871Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:17.927525Z", "completed_at": "2023-07-10T15:59:17.927532Z"}], "thread_id": "Thread-3", "execution_time": 0.7492580413818359, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.303395Z", "completed_at": "2023-07-10T15:59:18.212015Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.212473Z", "completed_at": "2023-07-10T15:59:18.212481Z"}], "thread_id": "Thread-7", "execution_time": 1.0129971504211426, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_send_email"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.307353Z", "completed_at": "2023-07-10T15:59:18.244085Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.244522Z", "completed_at": "2023-07-10T15:59:18.244528Z"}], "thread_id": "Thread-4", "execution_time": 1.013289213180542, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.246705Z", "completed_at": "2023-07-10T15:59:18.272148Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.272782Z", "completed_at": "2023-07-10T15:59:18.272789Z"}], "thread_id": "Thread-2", "execution_time": 1.0913217067718506, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.261723Z", "completed_at": "2023-07-10T15:59:18.311919Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.314743Z", "completed_at": "2023-07-10T15:59:18.314749Z"}], "thread_id": "Thread-8", "execution_time": 1.1476078033447266, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.253153Z", "completed_at": "2023-07-10T15:59:18.313304Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.319772Z", "completed_at": "2023-07-10T15:59:18.319778Z"}], "thread_id": "Thread-1", "execution_time": 1.1493699550628662, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_click_email"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.299203Z", "completed_at": "2023-07-10T15:59:18.312312Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.314985Z", "completed_at": "2023-07-10T15:59:18.314988Z"}], "thread_id": "Thread-6", "execution_time": 1.0923340320587158, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_open_email"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.390553Z", "completed_at": "2023-07-10T15:59:18.406195Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.407514Z", "completed_at": "2023-07-10T15:59:18.407521Z"}], "thread_id": "Thread-8", "execution_time": 0.019576072692871094, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.397080Z", "completed_at": "2023-07-10T15:59:18.406439Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.407771Z", "completed_at": "2023-07-10T15:59:18.407778Z"}], "thread_id": "Thread-1", "execution_time": 0.01973104476928711, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.403403Z", "completed_at": "2023-07-10T15:59:18.407298Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.409318Z", "completed_at": "2023-07-10T15:59:18.409322Z"}], "thread_id": "Thread-6", "execution_time": 0.007570743560791016, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.415684Z", "completed_at": "2023-07-10T15:59:18.421664Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.423116Z", "completed_at": "2023-07-10T15:59:18.423122Z"}], "thread_id": "Thread-1", "execution_time": 0.013148784637451172, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.412014Z", "completed_at": "2023-07-10T15:59:18.421992Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.423351Z", "completed_at": "2023-07-10T15:59:18.423354Z"}], "thread_id": "Thread-8", "execution_time": 0.014010190963745117, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.418777Z", "completed_at": "2023-07-10T15:59:18.422810Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.424846Z", "completed_at": "2023-07-10T15:59:18.424850Z"}], "thread_id": "Thread-6", "execution_time": 0.0140838623046875, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.427634Z", "completed_at": "2023-07-10T15:59:18.437926Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.438471Z", "completed_at": "2023-07-10T15:59:18.438478Z"}], "thread_id": "Thread-1", "execution_time": 0.01279592514038086, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.434170Z", "completed_at": "2023-07-10T15:59:18.439168Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.440192Z", "completed_at": "2023-07-10T15:59:18.440196Z"}], "thread_id": "Thread-6", "execution_time": 0.013682126998901367, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.430524Z", "completed_at": "2023-07-10T15:59:18.440436Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.445268Z", "completed_at": "2023-07-10T15:59:18.445277Z"}], "thread_id": "Thread-8", "execution_time": 0.019802093505859375, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.441448Z", "completed_at": "2023-07-10T15:59:18.447003Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.450666Z", "completed_at": "2023-07-10T15:59:18.450672Z"}], "thread_id": "Thread-1", "execution_time": 0.013849973678588867, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.447230Z", "completed_at": "2023-07-10T15:59:18.454014Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.455554Z", "completed_at": "2023-07-10T15:59:18.455560Z"}], "thread_id": "Thread-6", "execution_time": 0.01089620590209961, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.450908Z", "completed_at": "2023-07-10T15:59:18.455342Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.459843Z", "completed_at": "2023-07-10T15:59:18.459850Z"}], "thread_id": "Thread-8", "execution_time": 0.010658025741577148, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.456884Z", "completed_at": "2023-07-10T15:59:18.461479Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.464790Z", "completed_at": "2023-07-10T15:59:18.464796Z"}], "thread_id": "Thread-1", "execution_time": 0.010277271270751953, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.461681Z", "completed_at": "2023-07-10T15:59:18.465679Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.466197Z", "completed_at": "2023-07-10T15:59:18.466203Z"}], "thread_id": "Thread-6", "execution_time": 0.005743980407714844, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.954380Z", "completed_at": "2023-07-10T15:59:18.579039Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.579485Z", "completed_at": "2023-07-10T15:59:18.579492Z"}], "thread_id": "Thread-5", "execution_time": 0.6835579872131348, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__email_template_history"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.640083Z", "completed_at": "2023-07-10T15:59:18.646702Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.647821Z", "completed_at": "2023-07-10T15:59:18.647829Z"}], "thread_id": "Thread-8", "execution_time": 0.010185003280639648, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.643669Z", "completed_at": "2023-07-10T15:59:18.646991Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.648063Z", "completed_at": "2023-07-10T15:59:18.648065Z"}], "thread_id": "Thread-1", "execution_time": 0.009488105773925781, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:17.989500Z", "completed_at": "2023-07-10T15:59:18.630813Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.631255Z", "completed_at": "2023-07-10T15:59:18.631262Z"}], "thread_id": "Thread-3", "execution_time": 0.7085061073303223, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.699449Z", "completed_at": "2023-07-10T15:59:18.706527Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.707061Z", "completed_at": "2023-07-10T15:59:18.707070Z"}], "thread_id": "Thread-5", "execution_time": 0.009259939193725586, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.702711Z", "completed_at": "2023-07-10T15:59:18.707292Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.708314Z", "completed_at": "2023-07-10T15:59:18.708318Z"}], "thread_id": "Thread-6", "execution_time": 0.009910106658935547, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.315377Z", "completed_at": "2023-07-10T15:59:18.917813Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.918262Z", "completed_at": "2023-07-10T15:59:18.918270Z"}], "thread_id": "Thread-7", "execution_time": 0.656898021697998, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__campaigns"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.973989Z", "completed_at": "2023-07-10T15:59:18.980061Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.980838Z", "completed_at": "2023-07-10T15:59:18.980847Z"}], "thread_id": "Thread-1", "execution_time": 0.008801937103271484, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__campaigns_campaign_id.9599619112"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.977177Z", "completed_at": "2023-07-10T15:59:18.980525Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.981839Z", "completed_at": "2023-07-10T15:59:18.981843Z"}], "thread_id": "Thread-3", "execution_time": 0.008746147155761719, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__campaigns_campaign_id.58c604f925"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.329969Z", "completed_at": "2023-07-10T15:59:18.968829Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.970357Z", "completed_at": "2023-07-10T15:59:18.970361Z"}], "thread_id": "Thread-2", "execution_time": 0.7050437927246094, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__program"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:18.320416Z", "completed_at": "2023-07-10T15:59:18.970141Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:18.971330Z", "completed_at": "2023-07-10T15:59:18.971351Z"}], "thread_id": "Thread-4", "execution_time": 0.7234697341918945, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_describe"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:19.040702Z", "completed_at": "2023-07-10T15:59:19.044604Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:19.052021Z", "completed_at": "2023-07-10T15:59:19.052029Z"}], "thread_id": "Thread-6", "execution_time": 0.016443729400634766, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__program_program_id.20616f7b2c"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:19.037730Z", "completed_at": "2023-07-10T15:59:19.045007Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:19.052346Z", "completed_at": "2023-07-10T15:59:19.052350Z"}], "thread_id": "Thread-5", "execution_time": 0.017609119415283203, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__program_program_id.882bad918f"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:19.049305Z", "completed_at": "2023-07-10T15:59:19.053787Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:19.054582Z", "completed_at": "2023-07-10T15:59:19.054586Z"}], "thread_id": "Thread-1", "execution_time": 0.010947704315185547, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2023-07-10T15:59:19.045606Z", "completed_at": "2023-07-10T15:59:19.054013Z"}, {"name": "execute", "started_at": "2023-07-10T15:59:19.054797Z", "completed_at": "2023-07-10T15:59:19.054801Z"}], "thread_id": "Thread-8", "execution_time": 0.011835813522338867, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879"}], "elapsed_time": 3.7925620079040527, "args": {"select": [], "project_dir": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests", "enable_legacy_logger": false, "print": true, "profiles_dir": "/Users/catherinefritz/.dbt", "write_json": true, "version_check": true, "send_anonymous_usage_stats": true, "use_colors": true, "static_parser": true, "macro_debugging": false, "log_level_file": "debug", "log_format": "default", "vars": {"marketo__enable_campaigns": true, "marketo__enable_programs": true, "marketo__activity_delete_lead_enabled": false}, "which": "generate", "use_colors_file": true, "printer_width": 80, "exclude": [], "log_level": "info", "cache_selected_only": false, "quiet": false, "defer": false, "warn_error_options": {"include": [], "exclude": []}, "partial_parse": true, "favor_state": false, "log_format_file": "debug", "strict_mode": false, "populate_cache": true, "compile": true, "indirect_selection": "eager", "log_path": "/Users/catherinefritz/Documents/dbt_packages/marketo/dbt_marketo_source/integration_tests/logs", "introspect": true}} \ No newline at end of file +{"metadata": {"dbt_schema_version": "https://schemas.getdbt.com/dbt/run-results/v5.json", "dbt_version": "1.7.8", "generated_at": "2024-02-29T15:28:15.901659Z", "invocation_id": "9b425e78-4d62-4b80-9b3f-a4c4a37e5435", "env": {}}, "results": [{"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.492949Z", "completed_at": "2024-02-29T15:28:13.502956Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.505177Z", "completed_at": "2024-02-29T15:28:13.505198Z"}], "thread_id": "Thread-3", "execution_time": 0.027894973754882812, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead_tmp", "compiled": true, "compiled_code": "\n\nselect *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_delete_lead_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.480523Z", "completed_at": "2024-02-29T15:28:13.503317Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.505473Z", "completed_at": "2024-02-29T15:28:13.505477Z"}], "thread_id": "Thread-1", "execution_time": 0.030936717987060547, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_change_data_value_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.499928Z", "completed_at": "2024-02-29T15:28:13.503599Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.505747Z", "completed_at": "2024-02-29T15:28:13.505751Z"}], "thread_id": "Thread-4", "execution_time": 0.02820301055908203, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_email_bounced_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.488111Z", "completed_at": "2024-02-29T15:28:13.503861Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.506042Z", "completed_at": "2024-02-29T15:28:13.506046Z"}], "thread_id": "Thread-2", "execution_time": 0.030547142028808594, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_click_email_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_click_email_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.513278Z", "completed_at": "2024-02-29T15:28:13.524712Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.525268Z", "completed_at": "2024-02-29T15:28:13.525276Z"}], "thread_id": "Thread-3", "execution_time": 0.015470743179321289, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_email_delivered_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.516039Z", "completed_at": "2024-02-29T15:28:13.529507Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.531399Z", "completed_at": "2024-02-29T15:28:13.531406Z"}], "thread_id": "Thread-1", "execution_time": 0.02174091339111328, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_merge_leads_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.521267Z", "completed_at": "2024-02-29T15:28:13.529792Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.531673Z", "completed_at": "2024-02-29T15:28:13.531677Z"}], "thread_id": "Thread-2", "execution_time": 0.021174907684326172, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_send_email_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_send_email_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.518755Z", "completed_at": "2024-02-29T15:28:13.530122Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.531947Z", "completed_at": "2024-02-29T15:28:13.531950Z"}], "thread_id": "Thread-4", "execution_time": 0.022301912307739258, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_open_email_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_open_email_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.526998Z", "completed_at": "2024-02-29T15:28:13.531147Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.533995Z", "completed_at": "2024-02-29T15:28:13.533998Z"}], "thread_id": "Thread-3", "execution_time": 0.008934259414672852, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_activity_unsubscribe_email_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.545833Z", "completed_at": "2024-02-29T15:28:13.547672Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.548193Z", "completed_at": "2024-02-29T15:28:13.548198Z"}], "thread_id": "Thread-3", "execution_time": 0.01085805892944336, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_change_data_value_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.549833Z", "completed_at": "2024-02-29T15:28:13.550947Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.551426Z", "completed_at": "2024-02-29T15:28:13.551429Z"}], "thread_id": "Thread-3", "execution_time": 0.0026357173919677734, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_click_email_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.552972Z", "completed_at": "2024-02-29T15:28:13.554115Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.554585Z", "completed_at": "2024-02-29T15:28:13.554589Z"}], "thread_id": "Thread-3", "execution_time": 0.00261688232421875, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_delete_lead_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.556128Z", "completed_at": "2024-02-29T15:28:13.557217Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.557788Z", "completed_at": "2024-02-29T15:28:13.557792Z"}], "thread_id": "Thread-3", "execution_time": 0.002707958221435547, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_bounced_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.559435Z", "completed_at": "2024-02-29T15:28:13.560606Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.562344Z", "completed_at": "2024-02-29T15:28:13.562348Z"}], "thread_id": "Thread-3", "execution_time": 0.0046520233154296875, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_email_delivered_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.543163Z", "completed_at": "2024-02-29T15:28:13.560892Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.562600Z", "completed_at": "2024-02-29T15:28:13.562604Z"}], "thread_id": "Thread-4", "execution_time": 0.027584075927734375, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_lead_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.540814Z", "completed_at": "2024-02-29T15:28:13.561151Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.563078Z", "completed_at": "2024-02-29T15:28:13.563081Z"}], "thread_id": "Thread-2", "execution_time": 0.02872180938720703, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_describe_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_lead_describe_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.538194Z", "completed_at": "2024-02-29T15:28:13.561877Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.564333Z", "completed_at": "2024-02-29T15:28:13.564336Z"}], "thread_id": "Thread-1", "execution_time": 0.030192852020263672, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__email_template_history_tmp", "compiled": true, "compiled_code": "select *\nfrom `dbt-package-testing`.`marketo_source`.`marketo_email_template_history_data`", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history_tmp`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.569004Z", "completed_at": "2024-02-29T15:28:13.570892Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.576244Z", "completed_at": "2024-02-29T15:28:13.576248Z"}], "thread_id": "Thread-3", "execution_time": 0.010923147201538086, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_merge_leads_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.571196Z", "completed_at": "2024-02-29T15:28:13.572309Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.576491Z", "completed_at": "2024-02-29T15:28:13.576494Z"}], "thread_id": "Thread-4", "execution_time": 0.011003971099853516, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_open_email_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.572838Z", "completed_at": "2024-02-29T15:28:13.573941Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.576941Z", "completed_at": "2024-02-29T15:28:13.576944Z"}], "thread_id": "Thread-2", "execution_time": 0.011039972305297852, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_send_email_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.574691Z", "completed_at": "2024-02-29T15:28:13.575768Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.578142Z", "completed_at": "2024-02-29T15:28:13.578145Z"}], "thread_id": "Thread-1", "execution_time": 0.011136054992675781, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_activity_unsubscribe_email_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.582412Z", "completed_at": "2024-02-29T15:28:13.583584Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.589542Z", "completed_at": "2024-02-29T15:28:13.589547Z"}], "thread_id": "Thread-3", "execution_time": 0.010636091232299805, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_campaign_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.583844Z", "completed_at": "2024-02-29T15:28:13.584921Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.589787Z", "completed_at": "2024-02-29T15:28:13.589790Z"}], "thread_id": "Thread-4", "execution_time": 0.010746240615844727, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_email_template_history_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.586108Z", "completed_at": "2024-02-29T15:28:13.587169Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.590278Z", "completed_at": "2024-02-29T15:28:13.590282Z"}], "thread_id": "Thread-2", "execution_time": 0.010934114456176758, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.587922Z", "completed_at": "2024-02-29T15:28:13.589039Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.591550Z", "completed_at": "2024-02-29T15:28:13.591553Z"}], "thread_id": "Thread-1", "execution_time": 0.01119685173034668, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_lead_describe_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.595981Z", "completed_at": "2024-02-29T15:28:13.597220Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:13.653396Z", "completed_at": "2024-02-29T15:28:13.653404Z"}], "thread_id": "Thread-3", "execution_time": 0.061158180236816406, "adapter_response": {}, "message": null, "failures": null, "unique_id": "seed.marketo_source_integration_tests.marketo_program_data", "compiled": null, "compiled_code": null, "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.597507Z", "completed_at": "2024-02-29T15:28:14.303775Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.305931Z", "completed_at": "2024-02-29T15:28:14.305939Z"}], "thread_id": "Thread-4", "execution_time": 0.7132842540740967, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_delete_lead", "compiled": true, "compiled_code": "\n\nwith base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead_tmp`\n\n), macro as (\n\n select\n \n \n \n _fivetran_synced\n \n as \n \n _fivetran_synced\n \n, \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign\n \n as \n \n campaign\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign as campaign_name,\n campaign_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_delete_lead`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.655952Z", "completed_at": "2024-02-29T15:28:14.304086Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.306218Z", "completed_at": "2024-02-29T15:28:14.306222Z"}], "thread_id": "Thread-3", "execution_time": 0.6524388790130615, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_click_email", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n link\n \n as \n \n link\n \n, \n cast(null as string) as \n \n link_id\n \n , \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device as click_device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n link as click_link_url,\n platform as user_platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.600598Z", "completed_at": "2024-02-29T15:28:14.304397Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.306490Z", "completed_at": "2024-02-29T15:28:14.306493Z"}], "thread_id": "Thread-2", "execution_time": 0.7137241363525391, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_change_data_value", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value_tmp`\n\n), macro as (\n\n select \n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n api_method_name\n \n as \n \n api_method_name\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n modifying_user\n \n as \n \n modifying_user\n \n, \n \n \n new_value\n \n as \n \n new_value\n \n, \n \n \n old_value\n \n as \n \n old_value\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n reason\n \n as \n \n reason\n \n, \n \n \n request_id\n \n as \n \n request_id\n \n, \n \n \n source\n \n as \n \n source\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n api_method_name,\n campaign_id,\n id as activity_id,\n lead_id,\n modifying_user as modifying_user_id,\n new_value,\n old_value,\n primary_attribute_value,\n primary_attribute_value_id,\n reason as change_reason,\n request_id,\n source as change_source\n from macro\n\n)\n\nselect *\nfrom fields", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:13.603814Z", "completed_at": "2024-02-29T15:28:14.304667Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.306753Z", "completed_at": "2024-02-29T15:28:14.306756Z"}], "thread_id": "Thread-1", "execution_time": 0.7133548259735107, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_bounced", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n category\n \n as \n \n category\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n details\n \n as \n \n details\n \n, \n \n \n email\n \n as \n \n email\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n \n \n subcategory\n \n as \n \n subcategory\n \n, \n cast(null as INT64) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n category as bounce_category,\n choice_number,\n details,\n email as email_address,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n subcategory as bounce_subcategory\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.315906Z", "completed_at": "2024-02-29T15:28:14.907100Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.908636Z", "completed_at": "2024-02-29T15:28:14.908643Z"}], "thread_id": "Thread-3", "execution_time": 0.5990598201751709, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_merge_leads", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads_tmp`\n\n), macro as (\n\n select\n \n \n \n _fivetran_synced\n \n as \n \n _fivetran_synced\n \n, \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n master_updated\n \n as \n \n master_updated\n \n, \n \n \n merge_ids\n \n as \n \n merge_ids\n \n, \n \n \n merge_source\n \n as \n \n merge_source\n \n, \n \n \n merged_in_sales\n \n as \n \n merged_in_sales\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n\n\n\n from base\n\n), fields as (\n\n select\n id as activity_id,\n _fivetran_synced,\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n cast(lead_id as INT64) as lead_id,\n master_updated,\n cast(replace(trim(trim(merge_ids,']'),'['), ',', ', ') as string) as merged_lead_id,\n merge_source,\n merged_in_sales,\n primary_attribute_value,\n primary_attribute_value_id\n from macro\n\n)\n\nselect *\nfrom fields", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_merge_leads`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.321496Z", "completed_at": "2024-02-29T15:28:14.907469Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.909205Z", "completed_at": "2024-02-29T15:28:14.909209Z"}], "thread_id": "Thread-1", "execution_time": 0.599233865737915, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_open_email", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n device\n \n as \n \n device\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n is_mobile_device\n \n as \n \n is_mobile_device\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n platform\n \n as \n \n platform\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n device,\n email_template_id,\n id as activity_id,\n is_mobile_device,\n lead_id,\n platform,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id,\n user_agent\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.318648Z", "completed_at": "2024-02-29T15:28:14.908071Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.910123Z", "completed_at": "2024-02-29T15:28:14.910126Z"}], "thread_id": "Thread-2", "execution_time": 0.6004509925842285, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_send_email", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n\n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n\n \n\n\n\n\n\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.312594Z", "completed_at": "2024-02-29T15:28:14.993728Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:14.994448Z", "completed_at": "2024-02-29T15:28:14.994456Z"}], "thread_id": "Thread-4", "execution_time": 0.684736967086792, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_email_delivered", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered_tmp`\n\n), macro as (\n\n select \n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n choice_number\n \n as \n \n choice_number\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n step_id\n \n as \n \n step_id\n \n, \n cast(null as INT64) as \n \n test_variant\n \n \n\n\n from base\n\n), fields as (\n\n select \n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n choice_number,\n email_template_id,\n id as activity_id, \n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n step_id\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.914545Z", "completed_at": "2024-02-29T15:28:15.497556Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.498859Z", "completed_at": "2024-02-29T15:28:15.498866Z"}], "thread_id": "Thread-3", "execution_time": 0.5876584053039551, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__activity_unsubscribe_email", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n activity_date\n \n as \n \n activity_date\n \n, \n \n \n activity_type_id\n \n as \n \n activity_type_id\n \n, \n \n \n campaign_id\n \n as \n \n campaign_id\n \n, \n \n \n campaign_run_id\n \n as \n \n campaign_run_id\n \n, \n \n \n client_ip_address\n \n as \n \n client_ip_address\n \n, \n \n \n email_template_id\n \n as \n \n email_template_id\n \n, \n \n \n form_fields\n \n as \n \n form_fields\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n lead_id\n \n as \n \n lead_id\n \n, \n \n \n primary_attribute_value\n \n as \n \n primary_attribute_value\n \n, \n \n \n primary_attribute_value_id\n \n as \n \n primary_attribute_value_id\n \n, \n \n \n query_parameters\n \n as \n \n query_parameters\n \n, \n \n \n referrer_url\n \n as \n \n referrer_url\n \n, \n cast(null as INT64) as \n \n test_variant\n \n , \n \n \n user_agent\n \n as \n \n user_agent\n \n, \n \n \n webform_id\n \n as \n \n webform_id\n \n, \n \n \n webpage_id\n \n as \n \n webpage_id\n \n\n\n\n from base\n\n), fields as (\n\n select \t\n cast(activity_date as timestamp) as activity_timestamp,\n activity_type_id,\n campaign_id,\n campaign_run_id,\n client_ip_address,\n email_template_id,\n form_fields,\n id as activity_id,\n lead_id,\n primary_attribute_value,\n primary_attribute_value_id,\n query_parameters,\n referrer_url,\n user_agent,\n webform_id,\n webpage_id\n from macro\n\n), surrogate as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(primary_attribute_value_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(campaign_run_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(lead_id as string), '_dbt_utils_surrogate_key_null_') as string))) as email_send_id\n from fields\n\n)\n\nselect *\nfrom surrogate", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.920091Z", "completed_at": "2024-02-29T15:28:15.497919Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.499266Z", "completed_at": "2024-02-29T15:28:15.499269Z"}], "thread_id": "Thread-2", "execution_time": 0.5866570472717285, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead_describe", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n data_type\n \n as \n \n data_type\n \n, \n \n \n display_name\n \n as \n \n display_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n length\n \n as \n \n length\n \n, \n \n \n restname\n \n as \n \n restname\n \n, \n \n \n restread_only\n \n as \n \n restread_only\n \n, \n \n \n soapname\n \n as \n \n soapname\n \n, \n \n \n soapread_only\n \n as \n \n soapread_only\n \n\n\n\n from base\n\n), fields as (\n\n select\n data_type,\n display_name,\n id as lead_describe_id,\n length as field_max_length,\n restname as rest_name,\n restread_only as is_rest_readonly,\n soapname as soap_name,\n soapread_only as is_soap_readonly\n from macro\n\n), regex as (\n\n select \n *,\n case\n when rest_name like '%\\\\_\\\\_c%' then lower(rest_name)\n else ltrim(lower(regexp_replace(rest_name, '[A-Z]','_\\\\0')),'_')\n end as rest_name_xf\n from fields\n\n)\n\nselect *\nfrom regex", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.522941Z", "completed_at": "2024-02-29T15:28:15.527893Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.528470Z", "completed_at": "2024-02-29T15:28:15.528477Z"}], "thread_id": "Thread-2", "execution_time": 0.026947975158691406, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_click_email_activity_id.6c599791a0", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.502824Z", "completed_at": "2024-02-29T15:28:15.533262Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.534435Z", "completed_at": "2024-02-29T15:28:15.534441Z"}], "thread_id": "Thread-3", "execution_time": 0.0336461067199707, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_click_email_activity_id.8e4b4af9fd", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_click_email`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.996528Z", "completed_at": "2024-02-29T15:28:15.533545Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.534721Z", "completed_at": "2024-02-29T15:28:15.534724Z"}], "thread_id": "Thread-4", "execution_time": 0.539909839630127, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__email_template_history", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as \n \n created_at\n \n, \n \n \n description\n \n as \n \n description\n \n, \n \n \n folder_folder_name\n \n as \n \n folder_folder_name\n \n, \n \n \n folder_id\n \n as \n \n folder_id\n \n, \n \n \n folder_type\n \n as \n \n folder_type\n \n, \n \n \n folder_value\n \n as \n \n folder_value\n \n, \n \n \n from_email\n \n as \n \n from_email\n \n, \n \n \n from_name\n \n as \n \n from_name\n \n, \n \n \n id\n \n as \n \n id\n \n, \n \n \n name\n \n as \n \n name\n \n, \n \n \n operational\n \n as \n \n operational\n \n, \n \n \n program_id\n \n as \n \n program_id\n \n, \n \n \n publish_to_msi\n \n as \n \n publish_to_msi\n \n, \n \n \n reply_email\n \n as \n \n reply_email\n \n, \n \n \n status\n \n as \n \n status\n \n, \n \n \n subject\n \n as \n \n subject\n \n, \n \n \n template\n \n as \n \n template\n \n, \n \n \n text_only\n \n as \n \n text_only\n \n, \n \n \n updated_at\n \n as \n \n updated_at\n \n, \n \n \n url\n \n as \n \n url\n \n, \n \n \n version\n \n as \n \n version\n \n, \n \n \n web_view\n \n as \n \n web_view\n \n, \n \n \n workspace\n \n as \n \n workspace\n \n\n\n\n from base\n\n), fields as (\n\n select \n created_at as created_timestamp,\n description,\n folder_folder_name as folder_name,\n folder_id,\n folder_type,\n folder_value,\n from_email,\n from_name,\n id as email_template_id,\n name as email_template_name,\n operational as is_operational,\n program_id,\n publish_to_msi,\n reply_email,\n status as email_template_status,\n subject as email_subject,\n template as parent_template_id,\n text_only as is_text_only,\n updated_at as updated_timestamp,\n url as email_template_url,\n version as version_type,\n web_view as has_web_view_enabled,\n workspace as workspace_name\n from macro\n\n), versions as (\n\n select \n *,\n row_number() over (partition by email_template_id order by updated_timestamp) as inferred_version,\n count(*) over (partition by email_template_id) as total_count_of_versions\n from fields\n\n), valid as (\n\n select \n *, \n case\n when inferred_version = 1 then created_timestamp\n else updated_timestamp\n end as valid_from,\n lead(updated_timestamp) over (partition by email_template_id order by updated_timestamp) as valid_to,\n inferred_version = total_count_of_versions as is_most_recent_version\n from versions\n\n), surrogate_key as (\n\n select \n *,\n to_hex(md5(cast(coalesce(cast(email_template_id as string), '_dbt_utils_surrogate_key_null_') || '-' || coalesce(cast(inferred_version as string), '_dbt_utils_surrogate_key_null_') as string))) as email_template_history_id\n from valid\n\n)\n\nselect *\nfrom surrogate_key", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.530114Z", "completed_at": "2024-02-29T15:28:15.536032Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.537868Z", "completed_at": "2024-02-29T15:28:15.537871Z"}], "thread_id": "Thread-2", "execution_time": 0.009217977523803711, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_change_data_value_activity_id.8ae060d108", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.539041Z", "completed_at": "2024-02-29T15:28:15.548923Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.549407Z", "completed_at": "2024-02-29T15:28:15.549411Z"}], "thread_id": "Thread-3", "execution_time": 0.012738943099975586, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_bounced_activity_id.578b8cddf2", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.542170Z", "completed_at": "2024-02-29T15:28:15.554368Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.554894Z", "completed_at": "2024-02-29T15:28:15.554899Z"}], "thread_id": "Thread-4", "execution_time": 0.018132925033569336, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_change_data_value_activity_id.7c7047bbcd", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_change_data_value`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.545937Z", "completed_at": "2024-02-29T15:28:15.555178Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.556708Z", "completed_at": "2024-02-29T15:28:15.556711Z"}], "thread_id": "Thread-2", "execution_time": 0.01247715950012207, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_bounced_activity_id.28833155c3", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_bounced`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.550957Z", "completed_at": "2024-02-29T15:28:15.556198Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.558051Z", "completed_at": "2024-02-29T15:28:15.558055Z"}], "thread_id": "Thread-3", "execution_time": 0.008633136749267578, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_open_email_activity_id.72e7514396", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.559340Z", "completed_at": "2024-02-29T15:28:15.566767Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.570068Z", "completed_at": "2024-02-29T15:28:15.570073Z"}], "thread_id": "Thread-4", "execution_time": 0.013374090194702148, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_open_email_activity_id.d48e7e93e6", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_open_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.563577Z", "completed_at": "2024-02-29T15:28:15.571140Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.572679Z", "completed_at": "2024-02-29T15:28:15.572682Z"}], "thread_id": "Thread-2", "execution_time": 0.014050960540771484, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_send_email_activity_id.4eaf534bc8", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.567028Z", "completed_at": "2024-02-29T15:28:15.571772Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.575829Z", "completed_at": "2024-02-29T15:28:15.575832Z"}], "thread_id": "Thread-3", "execution_time": 0.013660907745361328, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_send_email_activity_id.bd25ee45d1", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_send_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.572930Z", "completed_at": "2024-02-29T15:28:15.578109Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.582842Z", "completed_at": "2024-02-29T15:28:15.582846Z"}], "thread_id": "Thread-4", "execution_time": 0.01469111442565918, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_email_delivered_activity_id.138e450885", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.579399Z", "completed_at": "2024-02-29T15:28:15.587183Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.591252Z", "completed_at": "2024-02-29T15:28:15.591256Z"}], "thread_id": "Thread-2", "execution_time": 0.014326095581054688, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_email_delivered_activity_id.6f715c1b87", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_email_delivered`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.583120Z", "completed_at": "2024-02-29T15:28:15.587637Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.591559Z", "completed_at": "2024-02-29T15:28:15.591562Z"}], "thread_id": "Thread-3", "execution_time": 0.014204978942871094, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__activity_unsubscribe_email_activity_id.a31edf42c0", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect activity_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`\nwhere activity_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.588138Z", "completed_at": "2024-02-29T15:28:15.593431Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.595131Z", "completed_at": "2024-02-29T15:28:15.595134Z"}], "thread_id": "Thread-4", "execution_time": 0.014453887939453125, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__activity_unsubscribe_email_activity_id.a3bca07e06", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select activity_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__activity_unsubscribe_email`\n where activity_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.598252Z", "completed_at": "2024-02-29T15:28:15.606237Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.607240Z", "completed_at": "2024-02-29T15:28:15.607245Z"}], "thread_id": "Thread-3", "execution_time": 0.014107942581176758, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__lead_describe_lead_describe_id.4f0a7f9cc1", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select lead_describe_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`\n where lead_describe_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.595383Z", "completed_at": "2024-02-29T15:28:15.606511Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.607757Z", "completed_at": "2024-02-29T15:28:15.607760Z"}], "thread_id": "Thread-2", "execution_time": 0.015232086181640625, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__lead_describe_lead_describe_id.37612f6879", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_describe_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_describe`\nwhere lead_describe_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.602549Z", "completed_at": "2024-02-29T15:28:15.607517Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.609521Z", "completed_at": "2024-02-29T15:28:15.609524Z"}], "thread_id": "Thread-4", "execution_time": 0.008529186248779297, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__email_template_history_email_template_history_id.dcab273dfa", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect email_template_history_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`\nwhere email_template_history_id is null\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.611080Z", "completed_at": "2024-02-29T15:28:15.614233Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.614728Z", "completed_at": "2024-02-29T15:28:15.614732Z"}], "thread_id": "Thread-3", "execution_time": 0.005321979522705078, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__email_template_history_email_template_history_id.7e3c0524e2", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select email_template_history_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__email_template_history`\n where email_template_history_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:14.918295Z", "completed_at": "2024-02-29T15:28:15.872859Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.874077Z", "completed_at": "2024-02-29T15:28:15.874096Z"}], "thread_id": "Thread-1", "execution_time": 0.9620952606201172, "adapter_response": {}, "message": null, "failures": null, "unique_id": "model.marketo_source.stg_marketo__lead", "compiled": true, "compiled_code": "with base as (\n\n select *\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead_tmp`\n\n), macro as (\n\n select\n \n cast(null as timestamp) as \n \n _fivetran_synced\n \n , \n \n \n created_at\n \n as created_timestamp , \n \n \n email\n \n as \n \n email\n \n, \n \n \n first_name\n \n as \n \n first_name\n \n, \n \n \n id\n \n as lead_id , \n \n \n last_name\n \n as \n \n last_name\n \n, \n \n \n updated_at\n \n as updated_timestamp , \n cast(null as string) as \n \n phone\n \n , \n cast(null as string) as \n \n main_phone\n \n , \n cast(null as string) as \n \n mobile_phone\n \n , \n cast(null as string) as \n \n company\n \n , \n cast(null as string) as \n \n inferred_company\n \n , \n cast(null as string) as \n \n address_lead\n \n , \n cast(null as string) as \n \n address\n \n , \n cast(null as string) as \n \n city\n \n , \n cast(null as string) as \n \n state\n \n , \n cast(null as string) as \n \n state_code\n \n , \n cast(null as string) as \n \n country\n \n , \n cast(null as string) as \n \n country_code\n \n , \n cast(null as string) as \n \n postal_code\n \n , \n cast(null as string) as \n \n billing_street\n \n , \n cast(null as string) as \n \n billing_city\n \n , \n cast(null as string) as \n \n billing_state\n \n , \n cast(null as string) as \n \n billing_state_code\n \n , \n cast(null as string) as \n \n billing_country\n \n , \n cast(null as string) as \n \n billing_country_code\n \n , \n cast(null as string) as \n \n billing_postal_code\n \n , \n cast(null as string) as \n \n inferred_city\n \n , \n cast(null as string) as \n \n inferred_state_region\n \n , \n cast(null as string) as \n \n inferred_country\n \n , \n cast(null as string) as \n \n inferred_postal_code\n \n , \n cast(null as string) as \n \n inferred_phone_area_code\n \n , \n cast(null as string) as \n \n anonymous_ip\n \n , \n cast(null as boolean) as is_unsubscribed , \n cast(null as boolean) as is_email_invalid , \n cast(null as boolean) as \n \n do_not_call\n \n \n\n\n -- This will check if there are non-default columns to bring in\n \n \n \n \n \n from base\n\n)\n\nselect *\nfrom macro", "relation_name": "`dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`"}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.887870Z", "completed_at": "2024-02-29T15:28:15.894298Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.896229Z", "completed_at": "2024-02-29T15:28:15.896245Z"}], "thread_id": "Thread-4", "execution_time": 0.019097089767456055, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.unique_stg_marketo__lead_lead_id.1a4c20db9f", "compiled": true, "compiled_code": "\n \n \n\nwith dbt_test__target as (\n\n select lead_id as unique_field\n from `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`\n where lead_id is not null\n\n)\n\nselect\n unique_field,\n count(*) as n_records\n\nfrom dbt_test__target\ngroup by unique_field\nhaving count(*) > 1\n\n\n", "relation_name": null}, {"status": "success", "timing": [{"name": "compile", "started_at": "2024-02-29T15:28:15.880328Z", "completed_at": "2024-02-29T15:28:15.894838Z"}, {"name": "execute", "started_at": "2024-02-29T15:28:15.896779Z", "completed_at": "2024-02-29T15:28:15.896786Z"}], "thread_id": "Thread-2", "execution_time": 0.02110600471496582, "adapter_response": {}, "message": null, "failures": null, "unique_id": "test.marketo_source.not_null_stg_marketo__lead_lead_id.a539cbf055", "compiled": true, "compiled_code": "\n \n \n\n\n\nselect lead_id\nfrom `dbt-package-testing`.`marketo_source_marketo_source`.`stg_marketo__lead`\nwhere lead_id is null\n\n\n", "relation_name": null}], "elapsed_time": 3.632714033126831, "args": {"log_file_max_bytes": 10485760, "macro_debugging": false, "project_dir": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests", "which": "generate", "defer": false, "print": true, "select": [], "enable_legacy_logger": false, "indirect_selection": "eager", "partial_parse": true, "vars": {}, "write_json": true, "warn_error_options": {"include": [], "exclude": []}, "introspect": true, "compile": true, "favor_state": false, "partial_parse_file_diff": true, "empty_catalog": false, "send_anonymous_usage_stats": true, "show_resource_report": false, "cache_selected_only": false, "use_colors": true, "use_colors_file": true, "exclude": [], "static_parser": true, "invocation_command": "dbt docs generate", "profiles_dir": "/Users/jamie.rodriguez/.dbt", "static": false, "strict_mode": false, "log_level_file": "debug", "printer_width": 80, "quiet": false, "version_check": true, "log_path": "/Users/jamie.rodriguez/Desktop/dbt_repos/Marketing/Marketo/dbt_marketo_source/integration_tests/logs", "log_level": "info", "log_format_file": "debug", "log_format": "default", "populate_cache": true}} \ No newline at end of file diff --git a/integration_tests/dbt_project.yml b/integration_tests/dbt_project.yml index 0186fb9..569f788 100644 --- a/integration_tests/dbt_project.yml +++ b/integration_tests/dbt_project.yml @@ -1,5 +1,5 @@ name: 'marketo_source_integration_tests' -version: '0.10.0' +version: '0.11.0' profile: 'integration_tests' config-version: 2 vars: diff --git a/macros/get_lead_columns.sql b/macros/get_lead_columns.sql index e2a59cd..a3db44b 100644 --- a/macros/get_lead_columns.sql +++ b/macros/get_lead_columns.sql @@ -7,9 +7,38 @@ {"name": "first_name", "datatype": dbt.type_string()}, {"name": "id", "datatype": dbt.type_int(), "alias": "lead_id"}, {"name": "last_name", "datatype": dbt.type_string()}, - {"name": "updated_at", "datatype": dbt.type_timestamp(), "alias": "updated_timestamp"} + {"name": "updated_at", "datatype": dbt.type_timestamp(), "alias": "updated_timestamp"}, + {"name": "phone", "datatype": dbt.type_string()}, + {"name": "main_phone", "datatype": dbt.type_string()}, + {"name": "mobile_phone", "datatype": dbt.type_string()}, + {"name": "company", "datatype": dbt.type_string()}, + {"name": "inferred_company", "datatype": dbt.type_string()}, + {"name": "address_lead", "datatype": dbt.type_string()}, + {"name": "address", "datatype": dbt.type_string()}, + {"name": "city", "datatype": dbt.type_string()}, + {"name": "state", "datatype": dbt.type_string()}, + {"name": "state_code", "datatype": dbt.type_string()}, + {"name": "country", "datatype": dbt.type_string()}, + {"name": "country_code", "datatype": dbt.type_string()}, + {"name": "postal_code", "datatype": dbt.type_string()}, + {"name": "billing_street", "datatype": dbt.type_string()}, + {"name": "billing_city", "datatype": dbt.type_string()}, + {"name": "billing_state", "datatype": dbt.type_string()}, + {"name": "billing_state_code", "datatype": dbt.type_string()}, + {"name": "billing_country", "datatype": dbt.type_string()}, + {"name": "billing_country_code", "datatype": dbt.type_string()}, + {"name": "billing_postal_code", "datatype": dbt.type_string()}, + {"name": "inferred_city", "datatype": dbt.type_string()}, + {"name": "inferred_state_region", "datatype": dbt.type_string()}, + {"name": "inferred_country", "datatype": dbt.type_string()}, + {"name": "inferred_postal_code", "datatype": dbt.type_string()}, + {"name": "inferred_phone_area_code", "datatype": dbt.type_string()}, + {"name": "anonymous_ip", "datatype": dbt.type_string()}, + {"name": "unsubscribed", "datatype": dbt.type_boolean(), "alias": "is_unsubscribed"}, + {"name": "email_invalid", "datatype": dbt.type_boolean(), "alias": "is_email_invalid"}, + {"name": "do_not_call", "datatype": dbt.type_boolean()} ] %} {{ return(columns) }} -{% endmacro %} +{% endmacro %} \ No newline at end of file diff --git a/models/src_marketo.yml b/models/src_marketo.yml index e80220c..9fd6c69 100644 --- a/models/src_marketo.yml +++ b/models/src_marketo.yml @@ -28,6 +28,93 @@ sources: - name: last_name description: The last name of the lead. + - name: phone + description: Lead’s Phone Number. + + - name: main_phone + description: Primary phone number of the lead’s company + + - name: mobile_phone + description: Lead’s mobile phone number + + - name: company + description: Lead’s company name + + - name: inferred_company + description: Company name inferred by reverse IP lookup of the lead’s first recorded web visit + + - name: address_lead + description: Second address associated with the lead. + + - name: address + description: Lead’s address. + + - name: city + description: Lead’s city + + - name: state + description: Lead’s state + + - name: state_code + description: Alpha-2 code of the Lead’s state + + - name: country + description: Lead’s country + + - name: country_code + description: Alpha-2 code of the Lead’s country + + - name: postal_code + description: Lead’s postal code + + - name: billing_street + description: Billing street address of the lead’s company + + - name: billing_city + description: City of the lead’s billing address + + - name: billing_state + description: State or province of the lead’s billing address + + - name: billing_state_code + description: Alpha-2 code of the state or province of the lead’s billing address + + - name: billing_country + description: Country of the lead’s billing address + + - name: billing_country_code + description: Alpha-2 code of the country of the lead’s billing address + + - name: billing_postal_code + description: Postal code of the lead’s billing address + + - name: inferred_city + description: Lead’s city inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_state_region + description: Lead’s state region inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_country + description: Country inferred by reverse IP lookup of the lead’s first recorded web visit + + - name: inferred_postal_code + description: Lead’s postal code inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_phone_area_code + description: Lead’s phone area code inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: anonymous_ip + description: IP address of the lead’s first recorded web visit + + - name: unsubscribed + description: Lead’s email-unsubscribed status (boolean). Partially system managed. Will prevent receipt of non-operational emails if set to true. + + - name: email_invalid + description: Email invalid status (boolean). All emails to the address will be blocked if set to true. Bounces indicating that the email is invalid will automatically set this field to true. + + - name: do_not_call + description: Lead’s do-not-call preference (boolean) + - name: lead_describe identifier: "{{ var('marketo_lead_describe_identifier', 'lead_describe')}}" description: Table with metadata about lead object columns diff --git a/models/stg_marketo.yml b/models/stg_marketo.yml index f19a5d1..c462209 100644 --- a/models/stg_marketo.yml +++ b/models/stg_marketo.yml @@ -595,6 +595,93 @@ models: - name: last_name description: The last name of the lead. + - name: phone + description: Lead’s Phone Number. + + - name: main_phone + description: Primary phone number of the lead’s company + + - name: mobile_phone + description: Lead’s mobile phone number + + - name: company + description: Lead’s company name + + - name: inferred_company + description: Company name inferred by reverse IP lookup of the lead’s first recorded web visit + + - name: address_lead + description: Second address associated with the lead. + + - name: address + description: Lead’s address. + + - name: city + description: Lead’s city + + - name: state + description: Lead’s state + + - name: state_code + description: Alpha-2 code of the Lead’s state + + - name: country + description: Lead’s country + + - name: country_code + description: Alpha-2 code of the Lead’s country + + - name: postal_code + description: Lead’s postal code + + - name: billing_street + description: Billing street address of the lead’s company + + - name: billing_city + description: City of the lead’s billing address + + - name: billing_state + description: State or province of the lead’s billing address + + - name: billing_state_code + description: Alpha-2 code of the state or province of the lead’s billing address + + - name: billing_country + description: Country of the lead’s billing address + + - name: billing_country_code + description: Alpha-2 code of the country of the lead’s billing address + + - name: billing_postal_code + description: Postal code of the lead’s billing address + + - name: inferred_city + description: Lead’s city inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_state_region + description: Lead’s state region inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_country + description: Country inferred by reverse IP lookup of the lead’s first recorded web visit + + - name: inferred_postal_code + description: Lead’s postal code inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: inferred_phone_area_code + description: Lead’s phone area code inferred by reverse IP lookup of lead’s first recorded web visit. + + - name: anonymous_ip + description: IP address of the lead’s first recorded web visit + + - name: is_unsubscribed + description: Lead’s email-unsubscribed status (boolean). Partially system managed. Will prevent receipt of non-operational emails if set to true. + + - name: is_email_invalid + description: Email invalid status (boolean). All emails to the address will be blocked if set to true. Bounces indicating that the email is invalid will automatically set this field to true. + + - name: do_not_call + description: Lead’s do-not-call preference (boolean) + - name: stg_marketo__program columns: - name: program_id diff --git a/models/stg_marketo__lead.sql b/models/stg_marketo__lead.sql index db5a55b..98db37a 100644 --- a/models/stg_marketo__lead.sql +++ b/models/stg_marketo__lead.sql @@ -13,7 +13,12 @@ with base as ( ) }} -- This will check if there are non-default columns to bring in - {% set default_cols = ['id', 'created_at', 'updated_at', 'email', 'first_name', 'last_name', '_fivetran_synced'] %} + {% set default_cols = ['id', 'created_at', 'updated_at', 'email', 'first_name', 'last_name', '_fivetran_synced', + 'phone', 'main_phone', 'mobile_phone', 'company', 'inferred_company', 'address_lead', 'address', 'city', 'state', + 'state_code', 'country', 'country_code', 'postal_code', 'billing_street', 'billing_city', 'billing_state', + 'billing_state_code', 'billing_country', 'billing_country_code', 'billing_postal_code', 'inferred_city', 'inferred_state_region', + 'inferred_country', 'inferred_postal_code', 'inferred_phone_area_code', 'anonymous_ip', 'unsubscribed', 'email_invalid', 'do_not_call'] %} + {% set new_cols = dbt_utils.star(from=ref('stg_marketo__lead_tmp'), except=default_cols) %} {% if new_cols != '/* no columns returned from star() macro */' %} ,{{ new_cols }}