Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: Replace conda install with pip due to unreliable libmamba-solver [skip ci] #11506

Closed
wants to merge 2 commits into from

Conversation

pxLi
Copy link
Collaborator

@pxLi pxLi commented Sep 26, 2024

We started suffering from internal docker build error after mamba released 2.0 https://github.com/mamba-org/mamba/releases/tag/2024.09.25 which is now the default solver of conda for python 3.10+
and failed

Error while loading conda entry point: conda-libmamba-solver (module 'libmambapy' has no attribute 'QueryFormat')

This change was trying to apply a workaround to use classic solver (this would significantly increase the conda install time, from ~10mins to ~50-70mins). this is too slow, so I starts trying to make IT to run with pip installed cudf

@pxLi pxLi added bug Something isn't working build Related to CI / CD or cleanly building labels Sep 26, 2024
@pxLi pxLi marked this pull request as draft September 26, 2024 10:05
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 26, 2024

the classic-solver installation is too slow. We can make a pip install version in the future

@pxLi pxLi changed the title Workaround conda libmamba error [skip ci] Replace conda install with pip due to unreliable libmamba-solver [skip ci] Sep 26, 2024
@pxLi pxLi changed the title Replace conda install with pip due to unreliable libmamba-solver [skip ci] WIP: Replace conda install with pip due to unreliable libmamba-solver [skip ci] Sep 26, 2024
@pxLi pxLi changed the title WIP: Replace conda install with pip due to unreliable libmamba-solver [skip ci] WIP: Workaround conda libmamba error [skip ci] Sep 26, 2024
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 26, 2024

cc @NvTimLiu for visibility if need to build pre_release images

@pxLi pxLi changed the title WIP: Workaround conda libmamba error [skip ci] WIP: Replace conda install with pip due to unreliable libmamba-solver [skip ci] Sep 26, 2024
@pxLi pxLi force-pushed the fix-conda-mamba2-solver branch 2 times, most recently from 7a81d3b to 5ad4302 Compare September 26, 2024 12:15
Signed-off-by: Peixin Li <[email protected]>
@pxLi pxLi changed the base branch from branch-24.10 to branch-24.12 September 26, 2024 12:26
@pxLi
Copy link
Collaborator Author

pxLi commented Sep 26, 2024

#11507

Closing this issue to explore a more effective escalation solution later

@pxLi pxLi closed this Sep 26, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant