Open-Source Code for Hand Gesture Recognition – Sign Language Translation

• Tweet
• Pin It

MediaPipe is a framework for building multimodal (eg. video, audio, any time series data) applied ML pipelines. With MediaPipe, a perception pipeline can be built as a graph of modular components, including, for instance, inference models (e.g., TensorFlow, TFLite) and media processing functions.

In the visualization above, the red dots represent the localized hand landmarks, and the green lines are simply connections between selected landmark pairs for visualization of the hand skeleton. The red box represents a hand rectangle that covers the entire hand, derived either from hand detection (see hand detection example) or from the pervious round of hand landmark localization using an ML model (see also model card). Hand landmark localization is performed only within the hand rectangle for computational efficiency and accuracy, and hand detection is only invoked when landmark localization could not identify hand presence in the previous iteration.

The example can also run in a mode that localizes hand landmarks in 3D (i.e., estimating an extra z coordinate):

In the visualization above, the localized hand landmarks are represented by dots in different shades, with the brighter ones denoting landmarks closer to the camera.

More info

Related Posts

• 

  Segstick: Build Your Own Self-Balancing Vehicle in Just 2 Days with Arduino
  Segstick: Build Your Own Self-Balancing Vehicle in Just 2 Days with Arduino
• 

  ZSWatch: An Open-Source Smartwatch Project Based on the Zephyr Operating System
  ZSWatch: An Open-Source Smartwatch Project Based on the Zephyr Operating System
• 

  What is IoT and which devices to use
  What is IoT and which devices to use
• 

  Maker Faire Rome Unveils Thrilling “Padel Smash Future” Pavilion for Sports Enthusiasts
  Maker Faire Rome Unveils Thrilling “Padel Smash Future” Pavilion for Sports Enthusiasts