Optimization

[jamessmith90]

Good:
It is accurate.

Bad:
The inference time is more than 80 ms for realtime usage.
To make it work for realtime image has to be resized to less than 200x200 which reduces accuracy.

So in order to make it usable the only way is to make it faster.
Have you tried using TensorRT or TVM or Pytorch serving in C++ ?