Display large tables in the dataset landing page #2535
Labels
ADC CI-14
Data search and display improvements (ADC deliverable)
arctic data center
dataset landing page
Enhancements and bugs for the dataset landing pages
enhancement
The TableEditorView now has a "view" mode, which is used to show data objects from the dataset landing page, see these PRs. With those changes, we made rendering in the TableEditorView more efficient, but there are still opportunities to improve the performance, especially when dealing with large datasets.
There are limits set on the size of data that can be loaded into the table to prevent the browser from freezing or crashing. Enabling lazy loading and other optimizations would allow users to view & browser large tables directly in the browser.
Here are a few ideas to improve the performance:
chunk
- Process multiple csv rows at a time so we can progressively render the table without freezing the browser. See if we can clear unused data after each chunk is processed?worker
- Run the parsing in a background thread, keeping the UI responsive while the CSV is being parsed.preview
- Parse the firstn
rows of the CSV file. We should set this to the maximum threshold of rows that we can handle in the browser.Other improvements:
These would make it easier for users to browser large tables
The text was updated successfully, but these errors were encountered: