thisisiron / transformer-tf2 Public

Notifications You must be signed in to change notification settings
Fork 1
Star 13

🤖 Transformer implemented as Tensorflow 2.0

13 stars 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 24 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
download.sh		download.sh
main.py		main.py
model.py		model.py
run.py		run.py
utils.py		utils.py

Repository files navigation

transformer-tf2

Requirements

Tensorflow == 2.0

Data

WMT'14 English-German data: https://nlp.stanford.edu/projects/nmt/

Download the datasets using the following script:

./download.sh

Results

	Train Set	Validation Set	Test Set
Model	--%	--%	--%

Reference

Attention Is All You Need

About

🤖 Transformer implemented as Tensorflow 2.0

nlp natural-language-processing translation tensorflow tf2 transformer attention attention-is-all-you-need self-attention tensorflow2

Report repository

Releases

No releases published

Packages

No packages published

Languages