Mediapipe Projects

A set of project using OpenCV and Media Pipe library.

System Requirements

• Ubuntu 20.04
• Python 3.8.5
• No GPU requirements

Installation

• Ubuntu 20.04

  $ pip3 install -r requirements_linux.txt

• Windows 10

  /> pip3 install -r requirements_win.txt

Utilities

• Hand Tracking
• Face Detection
• Face Mesh
• Pose Estimation
• Objectron (3D Object Detection)

Hand Landmark:

Face Detection:

Face Mesh:

Pose Estimation:

Objectron:

Projects

• P1: Hand Gesture based system volume control

  Objective:

  Real time volume control using hand gesture. The volume of the system shall be controlled only when middle, ring and pinky fingers are closed.

  python3 vol_control.py

  Compatibility:

  • Windows 10
  • Ubuntu 20.04

  

• P2: Finger Counter

  Objective:

  Real time finger counting.

  python3 finger_counter.py

  Compatibility:

  • Windows 10
  • Ubuntu 20.04

  

• P3: Finger Mouse control

  Objective:

  To control mouse pointer using finger tracking.

  1. Use Index finger only to move the cursor
  2. Use Index and Middle fingers to do left-click
  3. Use Index, Middle and Ring to do right-click
  4. Perform step-ii twice fast for double click

  python3 mouse_control.py

  Compatibility:

  • Windows 10
  • Ubuntu 20.04

• P4: Finger Virtual Painter

  Objective:

  To Paint on the screen using finger gestures.

  1. Use 👆 to Draw
  2. Use 🤚 to Erase
  3. Make a 🤟 to clear the screen

  python3 finger_painter.py

  Compatibility:

  • Windows 10
  • Ubuntu 20.04

Known issues:

1. Segmentation Fault due to keypress in OpenCV when using with Ubuntu 20.04. OpenCV Github Issue #20311

Reference

• Mediapipe
• OpenCV
• pycaw
• alsaaudio
• pyautogui