[REQUEST]: working tool call configuration with localai

[codefromthecrypt]

Has this been supported or requested before?

• I have checked the GitHub README.
• I have checked the Qwen documentation.
• I have checked the documentation of the related framework.
• I have searched the issues and there is not a similar one.

What is this feature about?

tool calling with LocalAI

Proposal

Introduction

I would like to see an example of tool calling with LocalAI, similar to Olllama

Rational

My company has customers that use ollama which works with tool calling, but we also have customers that use LocalAI. I would like to investigate qwen2.5 as an option for those using LocalAI

Anything else

Here is an example pull request which when run with LocalAI, Qwen2.5 cannot complete the same tests that pass with Ollama (both via the OpenAI API). It is my assumption the reason is that Ollama controls the prompt when calling tools square/exchange#51

Contributions are welcomed

• I am willing to help implement this feature.