Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CALCITE-6699] Invalid unparse for Varchar in StarRocksDialect #4055

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

xiaochen-zhou
Copy link

Copy link

sonarcloud bot commented Nov 19, 2024

@xiaochen-zhou xiaochen-zhou changed the title [CALCITE-6699] Invalid unparse for INT and BIGINT in StarRocksDialect [CALCITE-6699] Invalid unparse for Varchar in StarRocksDialect Nov 19, 2024
@@ -121,6 +121,10 @@ public StarRocksSqlDialect(Context context) {
return new SqlDataTypeSpec(
new SqlBasicTypeNameSpec(SqlTypeName.BIGINT, SqlParserPos.ZERO),
SqlParserPos.ZERO);
case VARCHAR:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need to add a unit test.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what happens to the precision if it is specified?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1. The accuracy issue is not considered here.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

test

Sorry for the late reply. I will add it later today.

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what happens to the precision if it is specified?

I initially thought that if precision is not set here, the default precision for varchar might be used. However, I just looked at the code, and it seems that if precision is not set, the default is PRECISION_NOT_SPECIFIED. Could this lead to a loss of precision, or did I not look at the code carefully?

@mihaibudiu @caicancai

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can try to follow the startRocks behavior. Does Starrocks support Varchar without setting precision? If so, add test cases to override it. If not, set the default varchar precision to Starrocks' default value. Also, add unit test to cover when Varchar setting precision.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried cast varchar with precision in Starrocks, and it seems that the precision doesn't affect the result and type(If the precision does not exceed 65533).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I tried cast varchar with precision in Starrocks, and it seems that the precision doesn't affect the result and type(If the precision does not exceed 65533).

Although this is not a common situation, we should still consider it.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

VARCHAR(N) is supposed to truncate to N characters, and then trim the whitespaces from the end of the string.
If the dialect does not support VARCHAR(N) perhaps it should report an error when an attempt is made to use it.
Then you should also add an assertion that the precision is "not specified".

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants