Note: Support for the Intel RealSense R200 is currently not available for Linux. This is due to "librealsense" requiring kernel patches for the "Video4Linux" backend.
All Intel RealSense cameras require librealsense to be installed. Please follow the install instructions for your operating system.
pyrealsense provides Python bindings for librealsense. Run the following command in your terminal to install it.
pip install git+https://github.com/pupil-labs/pyrealsenseSelect RealSense 3D in the Capture Selection menu and activate your RealSense camera. Afterwards you should see the colored video stream of the selected camera.
Pupil Capture accesses both streams, color and depth, at all times but only previews one at a time. Enable the Preview Depth option to see the normalized depth video stream.
The Record Depth Stream option (enabled by default) will save the depth stream during a recording session to the file depth.mp4 within your recording folder.
By default, you can choose different resolutions for the color and depth streams. This is advantageous if you want to run both streams at full resolution. The Intel RealSense R200 has a maximum color resolution of 1920 x 1080 pixels and maximum depth resolution of 640 x 480 pixels. librealsense also provides the possibility to pixel-align color and depth streams. Align Streams enables this functionality. This is required if you want to infer from depth pixels to color pixels and vice versa.
The Sensor Settings menu lists all available device options. These may differ depending on your OS, installed librealsense version, and device firmware.
Note: Not all resolutions support all frame rates. Try different resolutions if your desired frame rate is not listed.
Pupil Capture accesses the YUVY color stream of the RealSense camera. All color frames are accessible through the events object using the frame key within your plugin's recent_events method.
Depth frame objects are accessible through the events object using the depth_frame key within your plugin's recent_events method. The orginal 16-bit grayscale image of the camera can be accessed using the depth attribute of the frame object. The bgr attribute provides a colored image that is calculated using histogram equalization. These colored images are previewed in Pupil Capture, stored during recordings, and referred to as "normalized depth stream" in the above section. The librealsense examples use the same coloring method to visualize depth images.