Transformer-Spam-message-classification

Using transformer for Spam message classification(tensorflow attention is all you need)

edit model.py for datasource and other hyper-parameters
edit model.py for train or test

python model.py

data_format:

label message

0 not
1 spam

reference:
Attenion is all you need
https://github.com/tensorflow/models.git
https://github.com/Embedding/Chinese-Word-Vectors.git

accuracy：99%+ recall：99%+ precision：98%+

UCAS Web Data Mining homework