Skip to content

Commit

Permalink
Add documentation for the transpile task
Browse files Browse the repository at this point in the history
Part of #201
  • Loading branch information
ruiAzevedo19 authored and ahumenberger committed Jul 17, 2024
1 parent b1350aa commit 4052eec
Showing 1 changed file with 15 additions and 0 deletions.
15 changes: 15 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -242,6 +242,21 @@ Currently, the following cases are available for this task:
- Go
- [`golang/mistakes`](testdata/golang/mistakes)

### Task: Transpile

Transpile is the task of converting source code from one language to another.

The test data repository for this task consists of several packages. At the root of each package, there must be a folder called `implementation` containing a **single file**, which is the one to be transpiled. Each package must also contain a source file with a stub (a function signature so the LLM's know the signature of the function they need to generate code for) and a valid test suite. The LLM's response is then validated with the predefined test suite.

#### Cases

Currently, the following cases are available for this task:

- Java
- [`java/transpile`](testdata/java/transpile)
- Go
- [`golang/transpile`](testdata/golang/transpile)

### Reward Points

Currently, the following points are awarded for any task:
Expand Down

0 comments on commit 4052eec

Please sign in to comment.