Skip to content

Commit

Permalink
Add instructions on models.
Browse files Browse the repository at this point in the history
  • Loading branch information
cedruszhang committed Jul 9, 2023
1 parent 36a435f commit 0dd4aa1
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,5 +8,10 @@ This is an implementation of the [language model of RWKV](https://github.com/Bli
1. [Install Rust](https://rustup.rs/).
2. Run `cargo r -r --example generation` to generate 100 tokens and test the time cost.

## Convert Models
You may download the official RWKV World series models from [HuggingFace](https://huggingface.co/BlinkDL/rwkv-4-world), and convert them via the provided [`convert_safetensors.py`](convert_safetensors.py).

An already-converted 0.4B model can be found under [`assets/models`](assets/models/RWKV-4-World-0.4B-v1-20230529-ctx4096.st).

## Credits
- Tokenizer is implemented by [@koute](https://github.com/koute/rwkv_tokenizer).

0 comments on commit 0dd4aa1

Please sign in to comment.