Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-983098: redo arrow update 15.0.0 #708

Merged
6 commits merged into from
Apr 23, 2024
Merged

Conversation

ghost
Copy link

@ghost ghost commented Apr 17, 2024

teamwork issue 780
temporarily add build number in libsnowflakeclient version to avoid replacing artifacts on s3 built with gcc5. Will remove when ODBC also move to gcc8.

@ghost ghost self-requested a review as a code owner April 17, 2024 18:54
@ghost ghost force-pushed the SNOW-983098-redo-arrow-update-15.0.0 branch from e6a0e84 to 7b25a64 Compare April 17, 2024 18:54
@ghost ghost marked this pull request as draft April 18, 2024 01:02
@ghost
Copy link
Author

ghost commented Apr 18, 2024

The SEGFAULT with Mac debug build is related to static regex defined in https://github.com/snowflakedb/libsnowflakeclient/blob/master/cpp/logger/SecretDetector.cpp when calling ~mem_block_cache at the ending of test application. Will get that fixed before asking for review.

@ghost ghost marked this pull request as ready for review April 18, 2024 03:49
@ghost ghost requested review from sfc-gh-dprzybysz and removed request for sfc-gh-dprzybysz April 18, 2024 03:49
@ghost ghost marked this pull request as draft April 18, 2024 03:58
@ghost ghost requested a review from sfc-gh-dprzybysz April 18, 2024 18:54
@ghost ghost marked this pull request as ready for review April 18, 2024 18:54
@ghost
Copy link
Author

ghost commented Apr 19, 2024

Confirmed no performance issue with adding -DBOOST_REGEX_MAX_CACHE_BLOCKS=0
regex is used by arrow also for logging in libsfc directly.
Tested with ODBC driver using testapp in teamwork issue 697 (fetch a large result using SQLGetData) with both loglevel=6 (1GB log generated) and loglevel=0, compared with 3.3.0, no performance issue found.
new build vs 3.3.0 in seconds
loglevel=6: 94.043 / 112.014
loglevel=0: 7.344 / 7.401

@ghost ghost merged commit 8a38e7f into master Apr 23, 2024
42 checks passed
@ghost ghost deleted the SNOW-983098-redo-arrow-update-15.0.0 branch April 23, 2024 15:32
@github-actions github-actions bot locked and limited conversation to collaborators Apr 23, 2024
This pull request was closed.
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants