Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP] [FIX] Try modin for parallelization #669

Closed
wants to merge 5 commits into from

Conversation

36000
Copy link
Collaborator

@36000 36000 commented Apr 8, 2021

This may be an easy way of fixing the parallelization code: https://github.com/modin-project/modin

@36000 36000 force-pushed the try_modin branch 2 times, most recently from ad177ed to 5588f59 Compare April 8, 2021 23:04
@arokem
Copy link
Collaborator

arokem commented Apr 9, 2021

I'm thinking of giving pathos a try over on #652. Might help here as well? Maybe it's time to refactor our dataframe-driven dataflow? Try out pydra? It would be a big lift, but it might be worth doing at some point (?)

@36000 36000 closed this Apr 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants