Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

SQL - add streaming support for legend result set processing to handle large datasets more efficiently #2280

Merged
merged 6 commits into from
Sep 28, 2023

Conversation

shtirlets
Copy link
Contributor

What type of PR is this?

Improvement

What does this PR do / why is it needed ?

Enhance Alloy SQL to stream Legend Results (JSON). Previously the entire JSON response was parsed causing memory spikes/performance issues on large responses.

Which issue(s) this PR fixes:

Fixes #

Other notes for reviewers:

Does this PR introduce a user-facing change?

@shtirlets shtirlets requested a review from a team as a code owner September 19, 2023 02:00
@github-actions
Copy link

github-actions bot commented Sep 19, 2023

Test Results

     681 files  +1       681 suites  +1   58m 53s ⏱️ - 1m 2s
11 235 tests +2  10 857 ✔️ +2  378 💤 ±0  0 ±0 
14 024 runs  +2  13 562 ✔️ +2  462 💤 ±0  0 ±0 

Results for commit 1d5ffe5. ± Comparison against base commit 57895aa.

♻️ This comment has been updated with latest results.

@aormerod-gs aormerod-gs changed the title add streaming for legend result set SQL - add streaming support for legend result set processing to handle large datasets more efficiently Sep 19, 2023
@gs-manvig
Copy link
Contributor

Looks good to me

@aormerod-gs aormerod-gs merged commit 82f663d into finos:master Sep 28, 2023
@shtirlets shtirlets deleted the add-streaming branch January 23, 2024 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants