Skip to content

Latest commit

 

History

History
 
 

01_main-chapter-code

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
ch04.ipynb
ch04.ipynb
 
 
exercise-solutions.ipynb
exercise-solutions.ipynb
 
 
gpt.py
gpt.py
 
 
previous_chapters.py
previous_chapters.py
 
 
tests.py
tests.py
 
 

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter