This package is the core function for any NLP operation or pacakge used by lingorithm.
Use the package manager pip to install llck.
pip install llck
import llck
nlp = llck('ar', {'tokenize': 'tokenize' })
processed = nlp.process('منشار أرضيتم بالحيوة الدنيا من الأخرة')
print(processed.sentences[0].tokens)
# [منشار, أرضيتم, ب, الحيوة, الدنيا, من, الأخرة]
Pull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.
Please make sure to update tests as appropriate.