From 4c5c4173ca31ed2243775840cccc6086df90c2ea Mon Sep 17 00:00:00 2001 From: Rui Azevedo Date: Mon, 8 Jul 2024 17:21:50 +0100 Subject: [PATCH] Add documentation for the transpile task Part of #201 --- README.md | 15 +++++++++++++++ 1 file changed, 15 insertions(+) diff --git a/README.md b/README.md index e9ac2a20..893abdaf 100644 --- a/README.md +++ b/README.md @@ -243,6 +243,21 @@ Currently, the following cases are available for this task: - Go - [`golang/mistakes`](testdata/golang/mistakes) +### Task: Transpile + +Transpile is the task of converting source code from one language to another. + +The test data repository for this task consists of several packages. At the root of each package, there must be a folder called `implementation` containing a **single file**, which is the one to be transpiled. Each package must also contain a source file with a stub (a function signature so the LLM's know the signature of the function they need to generate code for) and a valid test suite. The LLM's response is then validated with the predefined test suite. + +#### Cases + +Currently, the following cases are available for this task: + +- Java + - [`java/transpile`](testdata/java/transpile) +- Go + - [`golang/transpile`](testdata/golang/transpile) + ### Reward Points Currently, the following points are awarded for any task: