README.md

Overview

This is an ongoing project to use recent advancements in generative transformers to resurrect the lost works of Stoic philosphy. Open to community contributions. Catch up with my blog post

The Idea

1. Train transformer model on Stoic text to predict the next word
2. Autoregress on fragments of lost text
3. Generate some remanence of the rest of the lost work.

Useful Resources

1. The Illustrated Transformer
2. The Annotated Transformer
3. GPT-3 Paper