Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Function call does not work #469

Open
lekhnath opened this issue Nov 26, 2024 · 4 comments
Open

Function call does not work #469

lekhnath opened this issue Nov 26, 2024 · 4 comments
Assignees
Labels
bug Something isn't working question Further information is requested

Comments

@lekhnath
Copy link

lekhnath commented Nov 26, 2024

I followed the this example :

https://github.com/aurelio-labs/semantic-router/blob/main/docs/05-local-execution.ipynb

But it did not call the function from dynamic routing. Instead it got stuck on Extracting function input.... And jupyter notebook kernel restarted without completing the process.

Screenshot Attached

image

@jamescalam
Copy link
Member

hi @lekhnath what hardware are you running this on? It looks like an out of memory error, so we could try using a smaller model or try running on Google Colab with T4 GPU instances

@jamescalam jamescalam added bug Something isn't working question Further information is requested labels Nov 26, 2024
@jamescalam jamescalam self-assigned this Nov 26, 2024
@lekhnath
Copy link
Author

lekhnath commented Nov 27, 2024

@jamescalam I tried running this example in two environments and got same issue on both:

  1. M3 Macbook pro
  2. 16 GB NVIDIA-T4 GPU on AWS (Instance Type: g4dn.xlarge)

@jamescalam
Copy link
Member

@lekhnath I can reproduce, we're currently working through a refactor / upgrade across many places in the codebase, we'll include a bug fix for this in there. Should be this week

@lekhnath
Copy link
Author

@jamescalam I'm really looking forward to this! Can't wait to integrate this feature into my codebase.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants