Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Create auto refresh materialized view statement ending with semicolon does not create streaming job on EMR-S #2630

Closed
seankao-az opened this issue Apr 20, 2024 · 0 comments
Assignees
Labels
bug Something isn't working Flint

Comments

@seankao-az
Copy link
Collaborator

seankao-az commented Apr 20, 2024

What is the bug?
When CREATE MATERIALIZED VIEW statement ends with a semicolon, no streaming job is created on EMR-S. Instead, an interactive session handles the request.

How can one reproduce the bug?
Steps to reproduce the behavior:
1.

POST /_plugins/_async_query
{
    "datasource": "my_glue",
    "lang": "sql",
    "query": "CREATE MATERIALIZED VIEW my_glue.default.mv AS SELECT 1 FROM my_glue.default.dummy WITH ( auto_refresh = true, checkpoint_location = 's3://test', watermark_delay = '1 Minute');"
}
  1. See response
{
  "queryId": "xxx",
  "sessionId": "xxx"
}
  1. Check EMR-S jobs: no streaming job is created
  2. Check materialized view content: will not get auto refreshed

What is the expected behavior?
Response should not contain a sessionId. EMR-S should spawn streaming job. Materialized view content should get auto refreshed.

What is your host/environment?

  • OS: 2.13
@seankao-az seankao-az added bug Something isn't working untriaged and removed untriaged labels Apr 20, 2024
@seankao-az seankao-az self-assigned this Apr 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Flint
Projects
None yet
Development

No branches or pull requests

1 participant