Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement mapreduce for SkipMissingVal #813

Closed

Conversation

tiemvanderdeure
Copy link
Contributor

The implementations is copy-pasted from Base, except that ismissing(ai) is replaced by _missing(ai, itr)

Solves #812

I'm not sure what this means for lazy rasters and chunked data from diskarrays. We might want to overload IndexStyle for those? Let's see if tests pass.

@tiemvanderdeure
Copy link
Contributor Author

ArchGDAL still segfaults on some resample.

There is a PR that will fix this in Julia base and make this unnecessary: JuliaLang/julia#52397. So we can choose to wait it out.

@rafaqz
Copy link
Owner

rafaqz commented Nov 5, 2024

Oh maybe we can wait for base iterators to be fixed? This will break DiskArrays.

And yes, it still segfaults.

@rafaqz
Copy link
Owner

rafaqz commented Nov 12, 2024

Lets close and wait for Base

@rafaqz rafaqz closed this Nov 12, 2024
@asinghvi17
Copy link
Collaborator

Should we recommend some more accurate summation algorithms in the meantime? Maybe in the zonal docs?

@rafaqz
Copy link
Owner

rafaqz commented Nov 12, 2024

Yeah possibly. Maybe when we allow online stats we can recommend that?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants