Sign Language Recognition Models

Sign language recognition labels lexical signs from an isolated sign video.

Usage

pip install git+https://github.com/sign-language-processing/recognition

Kaggle ASL Signs

The winning entry for the ASL Signs Kaggle competition.

from sign_language_recognition.kaggle_asl_signs import predict

pose = ... # Load pose from a file
class_probabilities = predict(pose)
gloss = predict(pose, label=True)

Or in CLI, given a .pose file, and an ELAN file with a SIGN tier:

sign_language_recognition --model="kaggle_asl_signs" --pose="sign.pose" --elan="sign.eaf"