Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SNOW-893835 Arrow - support for multi-chunk results #771

Merged
merged 4 commits into from
Sep 13, 2023

Conversation

sfc-gh-dstempniak
Copy link
Collaborator

@sfc-gh-dstempniak sfc-gh-dstempniak commented Sep 4, 2023

Description

Arrow - support for multi-chunk results.

Checklist

  • Code compiles correctly
  • Code is formatted according to Coding Conventions
  • Created tests which fail without the change (if possible)
  • All tests passing (dotnet test)
  • Extended the README / documentation, if necessary
  • Provide JIRA issue id (if possible) or GitHub issue id in PR name

Snowflake.Data/Core/ArrowChunkParser.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/ArrowResultChunk.cs Show resolved Hide resolved
Snowflake.Data/Core/ArrowResultSet.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/BaseResultChunk.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/SFBlockingChunkDownloaderV3.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/SFBlockingChunkDownloader.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/SFResultSet.cs Outdated Show resolved Hide resolved
Snowflake.Data/Core/SFResultSet.cs Outdated Show resolved Hide resolved
Snowflake.Data.Tests/UnitTests/ArrowResultChunkTest.cs Outdated Show resolved Hide resolved
@sfc-gh-dstempniak sfc-gh-dstempniak marked this pull request as ready for review September 11, 2023 16:45
@sfc-gh-dstempniak sfc-gh-dstempniak requested a review from a team as a code owner September 11, 2023 16:45
@sfc-gh-igarish
Copy link
Collaborator

I saw many "public" method changes. Are we going to mark it as a BCR? Also do we added result format changes from ARROW to JSON and vice versa like "alter session set DOTNET_RESULT_FORMAT = 'ARROW' | 'JSON'"? Default should be arrow like JDBC/ODBC/GO drivers.

@sfc-gh-dstempniak
Copy link
Collaborator Author

@sfc-gh-igarish thank you for your comment. I recreated IResultChunk interface not to do BCR. Now interface of all public methods in public classes remain the same.
DOTNET_QUERY_RESULT_FORMAT parameter will be added to GS in SNOW-893840. Arrow code is already unit-tested, integration tests will be added later.

@sfc-gh-dstempniak sfc-gh-dstempniak merged commit 78ddc27 into master Sep 13, 2023
@sfc-gh-dstempniak sfc-gh-dstempniak deleted the SNOW-893835 branch September 13, 2023 07:53
@github-actions github-actions bot locked and limited conversation to collaborators Sep 13, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants