Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Switch file format from '.feather' to '.arrow' #53

Open
bmschmidt opened this issue Sep 6, 2022 · 1 comment
Open

Switch file format from '.feather' to '.arrow' #53

bmschmidt opened this issue Sep 6, 2022 · 1 comment
Milestone

Comments

@bmschmidt
Copy link
Collaborator

I've used '.feather' as the file format here, but over the last couple years the community has standardized around '.arrow' instead, to the point where the mailing list is now discussing deprecating the 'feather' methods entirely and reminding me that ".arrow is the official registered extension."

This will only get worse as time goes on, so will be changed in the next version bump. This is going to cause some breakage and will probably need an ability to specify, in plots, use of the '.feather' extension.

@bmschmidt bmschmidt added this to the 3.0 milestone Sep 6, 2022
@cceyda
Copy link

cceyda commented Sep 9, 2024

I see there is an arrow_table: option in the prefs but how can I format the arrow table so that it is tiled(batched) like with quadfeather?
If I pass an arrow table naively webgl buffers error out after 2**16 rows.
Edit: aha I guess you just add batch_id column according to example here:

batch_id: vectorFromArray(batch_id),

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants