openFrameworks
, addon for IP Cameras using Neuralktalk2 for automatic captioning. This is using the ofxIpVideoGrabber
addon's example code. We've just modified it to read captions from neuraltalk2 and display it.
If you haven't seen this video already, go check it out. It demenonstrates how deep learning can be used for automatic captioning based on what the webcam sees.
What we've done here is, instead of using a webcam attached directly to the computer, we're feeding neuraltalk2 with feeds from an IP camera. In addition to that we've added text to speech so it reads what the camera sees as well. Useful for a blind person interested in hearing what the camera sees.
This is a hack my friend and I worked on after seeing the original video demo of what neuraltalk2 can do.
We also modified neuraltalk2's eval.lua
5 script and so it's possible to read the image feed from the IP camera.