Skip to content

Latest commit

 

History

History
91 lines (69 loc) · 2.53 KB

README.md

File metadata and controls

91 lines (69 loc) · 2.53 KB
Raw

Templating for API

One tool for several generative AIs: we need a common interface to do so.

Tplfa ("templating for api") defines such common interface and provides API-specific templates.

The templates are written in jsonnet and can be used in most popular languages.

Tplfa is a part of Gewova collaborative prompt engineering project. Tplfa is published under permissive MIT license and can be included in commercial applications.

In action

cd in-action/nodejs-tplfa/
npm ci

export OPENAI_API_KEY=...
npx ts-node src/index.ts --debug \
  --api ../../apis/openai/lib \
  --prompt "Tell me a joke about APIs."

According to the debug log, the prompt is converted to a fetch-object:

{
   "url": "https://api.openai.com/v1/chat/completions",
   "method": "POST",
   "headers": {
      "Authorization": "...",
      "Content-type": "application/json"
   },
   "body": {
      "messages": [
         {
            "content": "Tell me a joke about APIs.",
            "role": "user"
         }
      ],
      "model": "gpt-3.5-turbo"
   }
}

The response from OpenAI is converted to the document representation:

{
  "doc": [
    {
      "content": [
        {
          "text": "Why did the API go to therapy? \n\nBecause it couldn't handle all the rejection codes!",
          "type": "text"
        }
      ],
      "type": "markdown"
    }
  ]
}

APIs

./apis/.

At the moment, there is only a template for OpenAI chat completion.

How to contribute an API

  • Copy-paste the openai template to a new directory
  • Modify the templates and update tests

Add templating to an application

There are official libraries for Python, Go, C and C++, plus unofficial third-party bindings: https://jsonnet.org/ref/bindings.html.

For JavaScript and TypeScript, this repository provides:

  • bindings to jsonnet through WebAssembly compilation,
  • utilities for templating

Contents