You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello! I'd like to learn how to run an inference with a baseline model of Vicuna without Medusa support. Additionally, I’m curious if there has been any analysis done on the memory footprint, and whether Medusa provides any notable improvements compared to the baseline.
The text was updated successfully, but these errors were encountered:
kailashg26
changed the title
How to run infernece of a baseline model without medusa support?
How to run inference of a baseline model without medusa support?
Sep 16, 2024
Hello! I'd like to learn how to run an inference with a baseline model of Vicuna without Medusa support. Additionally, I’m curious if there has been any analysis done on the memory footprint, and whether Medusa provides any notable improvements compared to the baseline.
The text was updated successfully, but these errors were encountered: