Skip to content

xk97/transformer-walkthrough

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 

Repository files navigation

A walkthrough of transformer architecture code

Open In Colab

The notebook walks through a single forward pass of the Transformer architecture in pytorch. It is meant for illustration and educational purposes only. The walkthrough explains every stage of the architecture accompanied by a detailed computation graph.

Transformer Computation Graph

About

A walkthrough of transformer architecture code

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Jupyter Notebook 100.0%