google_bigquery_data_transfer_config owner field

[lord-skinner]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request.
• Please do not leave +1 or me too comments, they generate extra noise for issue followers and do not help prioritize the request.
• If you are interested in working on this issue or have submitted a pull request, please leave a comment.
• If an issue is assigned to a user, that user is claiming responsibility for the issue.
• Customers working with a Google Technical Account Manager or Customer Engineer can ask them to reach out internally to expedite investigation and resolution of this issue.

Description

I can set the service_account_name, but I need to be able to set the owner to a group so the users who depend on the scheduled query can get notified if there are failures. I need to be able to set these discreetly and use a google group as the owner while running as a Service Account.

New or Affected Resource(s)

google_bigquery_data_transfer_config

Potential Terraform Configuration

resource "google_bigquery_data_transfer_config" "scheduled_query_name" {
  data_refresh_window_days  = 0
  data_source_id            = "scheduled_query"
  destination_dataset_id    = "dataset"
  disabled                  = false
  display_name              = "my fancy scheduled query"
  location                  = "us"
  notification_pubsub_topic = null
  params = {
    destination_table_name_template = "example"
    query                           = "select * from `schema.table`"
    write_disposition               = "WRITE_TRUNCATE"
  }
  project              = "project"
  schedule             = "every 1 hours"
  service_account_name = "[email protected]"
  owner                = "[email protected]"
  email_preferences {
    enable_failure_email = true
  }
}

References

No response

b/380890664

[melinath]

Note from triage: It looks like the API doesn't currently support doing this: https://cloud.google.com/bigquery/docs/reference/datatransfer/rest/v1/projects.locations.transferConfigs

There's an ownerInfo field but it's output-only.

Support would need to be added for this at the API level before we could add it into the providers.

[lord-skinner]

@melinath Thanks for the info. Do I need to take action to get support for this added to the API?

[melinath]

This has been forwarded to engineering for consideration. There's no particular action you need to take. If you're working with a Google Technical Account Manager or Customer Engineer you can ask them to reach out internally to expedite investigation and resolution of this issue.

[wj-chen]

The API is working as intended. According to https://cloud.google.com/bigquery/docs/transfer-run-notifications#email_notifications:

If you used a service account to authenticate a transfer configuration, then you might not have access to the email to receive transfer run notification emails. In such cases, we recommend that you set up Pub/Sub notifications to receive transfer run notifications.

The recommendation is to create a google_pubsub_topic and specify that in notification_pubsub_topic.

[melinath]

Per @wj-chen's comment, closing this ticket as resolved. Thanks for reaching out!

[github-actions]

I'm going to lock this issue because it has been closed for 30 days ⏳. This helps our maintainers find and focus on the active issues.
If you have found a problem that seems similar to this, please open a new issue and complete the issue template so we can capture all the details necessary to investigate further.