Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

No module named 'tensorrt_llm.bindings' #2599

Open
2 of 4 tasks
WGS-note opened this issue Dec 20, 2024 · 1 comment
Open
2 of 4 tasks

No module named 'tensorrt_llm.bindings' #2599

WGS-note opened this issue Dec 20, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@WGS-note
Copy link

System Info

...

Who can help?

@pathorn @ttim @Superjomn @aaronp24 @lopuhin

Information

  • The official example scripts
  • My own modified scripts

Tasks

  • An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
  • My own task or dataset (give details below)

Reproduction

...

Expected behavior

Thank you so much to the author team for responding, I have a question:

I cloned the source and pip install -e . Install and got an error:

The `bindings` module does not exist. Please check the package integrity. If you are attempting to use the pip development mode (editable installation), please execute `build_wheels.py` first, and then run `pip install -e .`

Then I didn't find bindings in the source directory.

So I comment out sanity_check() and pip install -e .

Error reported when importing packages:

No module named 'tensorrt_llm.bindings'

What should I do?

actual behavior

No module named 'tensorrt_llm.bindings'

additional notes

...

@WGS-note WGS-note added the bug Something isn't working label Dec 20, 2024
@zhangts20
Copy link

As indicated by the error message, you should execute scripts/build_scripts.py first.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants