Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Double quotes in WHERE statements lead to no returned results #507

Closed
A-Gray-Cat opened this issue Aug 1, 2024 · 2 comments
Closed
Assignees
Labels
bug Something isn't working Lang:PPL Pipe Processing Language support

Comments

@A-Gray-Cat
Copy link

A-Gray-Cat commented Aug 1, 2024

What is the bug?
Running a query where filters are applied by referencing data in double quotes returns no results. Using single quotes instead works as expected. The documentation references using double quotes for these types of statements so this bug can lead to user confusion.

How can one reproduce the bug?
Steps to reproduce the behavior:

  1. Go to Data sources -> securitylake -> query data -> open log explorer
  2. Run the follow queries:
SELECT * 
FROM
securitylake.amazon_security_lake_glue_db_us_east_1.amazon_security_lake_table_us_east_1_cloud_trail_mgmt_2_0
WHERE time_dt > "2024-07-31 00:00:00"
    AND region = "us-east-1"
LIMIT 10

source = securitylake.amazon_security_lake_glue_db_us_east_1.amazon_security_lake_table_us_east_1_cloud_trail_mgmt_2_0
| where time_dt > "2024-07-31 00:00:00" and region = "us-east-1"
| head 10

What is the expected behavior?
Filters are applied, and results that met the criteria returned

What is your host/environment?

  • OS: [e.g. iOS]
  • Version 2.13
  • Plugins

Do you have any screenshots?
If applicable, add screenshots to help explain your problem.

Do you have any additional context?
Add any other context about the problem.

@A-Gray-Cat A-Gray-Cat added bug Something isn't working untriaged labels Aug 1, 2024
@YANG-DB YANG-DB added Lang:PPL Pipe Processing Language support and removed untriaged labels Aug 12, 2024
@YANG-DB YANG-DB moved this to Todo in PPL Commands Aug 12, 2024
@salyh
Copy link
Contributor

salyh commented Aug 20, 2024

I can not reproduce this on the current main branch with the following test:

test("test string condition functions with different quoting") {
    val singleQuotesFrame = sql(s"""
                             | source = $timeseriesTable | where time > '2023-10-01 00:00:00' and address = 'Seattle' | head 10
                             | """.stripMargin)

    val results1: Array[Row] = singleQuotesFrame.collect()
    assert(results1.size == 2)

    val doubleQuotesFrame = sql(s"""
                                | source = $timeseriesTable | where time > "2023-10-01 00:00:00" and address = "Seattle" | head 10
                                | """.stripMargin)

    val results2: Array[Row] = doubleQuotesFrame.collect()
    assert(results2.size == 2)

  }

@YANG-DB
Copy link
Member

YANG-DB commented Aug 20, 2024

ok - will close this issue

@YANG-DB YANG-DB closed this as completed Aug 20, 2024
@github-project-automation github-project-automation bot moved this from Todo to Done in PPL Commands Aug 20, 2024
@YANG-DB YANG-DB self-assigned this Aug 20, 2024
@YANG-DB YANG-DB moved this from Done to non-issue in PPL Commands Aug 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working Lang:PPL Pipe Processing Language support
Projects
Status: non-issue
Development

No branches or pull requests

3 participants