-
|
Hello, I'm quite interested in Tabby and I'm wondering if anyone has any data on what would be the actual cost to run it as a hobbyist on something like Modal/HF ? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
Modal provides $30 per month in free credits, offering approximately 50 hours of T4 GPU time. Depending on your coding activity, the cost can range from free to a few low digits. Conversely, a T4 setup on Modal, configured with proper settings, can easily support a team of around 15 people (e.g., serving DeepseekCoder-1.3B with approximately 4 QPS). Assuming 12 active hours per day and 25 active days in a month, the cost is roughly $180 per month, making it approximately $10 per person. |
Beta Was this translation helpful? Give feedback.
-
|
Thank you, then I might try for a month and see how it goes then ! |
Beta Was this translation helpful? Give feedback.
Modal provides $30 per month in free credits, offering approximately 50 hours of T4 GPU time. Depending on your coding activity, the cost can range from free to a few low digits.
Conversely, a T4 setup on Modal, configured with proper settings, can easily support a team of around 15 people (e.g., serving DeepseekCoder-1.3B with approximately 4 QPS).
Assuming 12 active hours per day and 25 active days in a month, the cost is roughly $180 per month, making it approximately $10 per person.