Obs! This is the version we used for the shared task that is not maintained and updated anymore. Please refer to https://github.com/yanshao9798/segmenter for the updated version.
Universal segmenter, written by Y. Shao, Uppsala University
python segmenter.py train -p ud-treebanks-conll2017/UD_English -gru -cp -m seg_Eng
python segmenter.py train -p ud-treebanks-conll2017/UD_English -ss -gru -cp -m ss_seg_Eng
python segmenter.py tag -p ud-treebanks-conll2017/UD_English -m ss_seg_Eng -r ud-raw/en_pud.txt -opth tokenized/en_pud.txt