BERT from R Bidirectional Encoder Representations from Transformers We can load pretrained BERT models via Keras BERT.