Limitations with output tokens that prevent detailed answers

[orangeelephant2013]

Hello, I had raised this in the discussions but received no answers (link: #936 (comment)). How can we ensure that answers aren't truncated baed not he maximum output tokens? Even if the tokens are set at 2000, the answers are truncated when using the bling-phi-3-gguf model (and I assume any other model dependent on llmware's apis). I tried multiple methods to change the maximum output tokens including passing it into the method to get the model as well as in the gguf config. Can someone please help. thanks!

[NYDocutest]

Hi @orangeelephant2013 Thank you for bringing this to our attention. We made the necessary update in our repo as shown so please try again with a fresh clone.

[orangeelephant2013]

Thanks so much for the reply. We will update and try again. I will keep you posted once things work as expected. thanks again