Inference-only model (ONNX or otherwise)

[streamsnipersgames]

Hi everyone,

Thanks for the great package! What is the current best way to deploy the model in production? The pip package is very large due to the pytorch dependencies. Is there any alternative such as ONNX? I found this but it's out of date.

Thank you!
Andrei