Skip to content

Commit

Permalink
add: ggml graph encoding format (#66)
Browse files Browse the repository at this point in the history
This commit adds the `ggml` graph encoding format to the `graph_encoding`
enum.

The motivation for this is to allow the `wasi-nn` interface to support
models that are encoded in the `ggml` format which is the model format
used by llama.cpp.

Signed-off-by: Daniel Bevenius <[email protected]>
  • Loading branch information
danbev authored Apr 10, 2024
1 parent 06c30c0 commit c0840c2
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 0 deletions.
1 change: 1 addition & 0 deletions ml.md
Original file line number Diff line number Diff line change
Expand Up @@ -214,6 +214,7 @@ backends that encode (i.e., serialize) their graph IR with different formats.</p
<li><a name="graph_encoding.tensorflow"><code>tensorflow</code></a></li>
<li><a name="graph_encoding.pytorch"><code>pytorch</code></a></li>
<li><a name="graph_encoding.tensorflowlite"><code>tensorflowlite</code></a></li>
<li><a name="graph_encoding.ggml"><code>ggml</code></a></li>
<li><a name="graph_encoding.autodetect"><code>autodetect</code></a></li>
</ul>
<h4><a name="execution_target"><code>enum execution-target</code></a></h4>
Expand Down
1 change: 1 addition & 0 deletions wit/wasi-nn.wit
Original file line number Diff line number Diff line change
Expand Up @@ -78,6 +78,7 @@ interface graph {
tensorflow,
pytorch,
tensorflowlite,
ggml,
autodetect,
}

Expand Down

0 comments on commit c0840c2

Please sign in to comment.