Skip to content

Infographic about the inner computations of a transformer model, training and inference

License

Notifications You must be signed in to change notification settings

javismiles/X-Ray-Transformer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

33 Commits
 
 
 
 
 
 

Repository files navigation

X-Ray-Transformer Infographic

Dive into transformers training & inference computations through a single visual, an all in one x-ray of the model that gave rise to GPT-3. Explore computations and transformations end to end during training and inference. The X-Ray Transformer infographic allows you to make the journey from the beginning to the end of the transformer's computations in both the training and inference phases. Its objective is to achieve a quick and deep understanding of the inner computations of a transformer model through the analysis and exploration of a single visual asset.

Find a step by step explanation of the X-Ray Transformer Infographic at this medium article I published:

https://medium.com/towards-data-science/x-ray-transformer-dive-into-transformers-training-inference-computations-through-a-single-visual-4e8d50667378?sk=5481d5818a45a7958a131fde17c1bce8

Download a higher resolution version of the Infographic at:

https://github.com/javismiles/X-Ray-Transformer/tree/master/images

Even larger resolution versions of the Infographic will be released soon at losslandscape.com

Alt text

About

Infographic about the inner computations of a transformer model, training and inference

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published