Hand Gesture Control System for Robotic Hand Using Computer Vision
Article Sidebar
Main Article Content
Human–machine interction plays an important role in modern industrial automation systems. In many industrial environments, operators are required to interact directly with machines through switches, buttons, and control panels. In hazardous environments such as chemical plants, radioactive facilities, and high-voltage power stations, this direct interaction may expose operators to serious safety risks. This paper presents a computer vision–based hand gesture control system that enables contactless interaction with machines. The proposed system uses a camera to capture hand gestures, which are processed using Python with OpenCV and MediaPipe libraries. The system detects hand landmarks and interprets gestures in real time. The recognized gesture is converted into control signals and transmitted to an Arduino microcontroller through serial communication. The Arduino generates PWM signals to control servo motors connected to a robotic hand mechanism that replicates the user’s gesture. The developed prototype demonstrates the feasibility of integrating artificial intelligence and embedded systems for safer human–machine interaction in industrial environments.
Downloads
References
J. Qi, L. Ma, Z. Cui, and Y. Yu, “Computer vision-based hand gesture recognition for human–robot interaction: A review,” Complex & Intelligent Systems, 2023.
H. H. Li, “Dynamic Hand Gesture Recognition Using MediaPipe and Transformer Model,” MDPI Engineering Proceedings, vol.108, no.1, 2025.
M. Altayeb, “Hand Gestures Replicating Robot Arm Based on MediaPipe,” International Journal of Electrical Engineering and Informatics, 2023.
S. Chavan et al., “Real-Time Hand Gesture Recognition Based Control of Arduino Robot,” International Journal of Trend in Scientific Research and Development, vol.6, no.4, pp.79-83, 2022.
A. S. Amirtha Varshini et al., “Real-Time Hand Gesture Recognition for Robotic Arm Control,” ACM International Conference Proceedings, 2021.
I. Darmawan et al., “Hand Gesture Recognition for Collaborative Robots Using Lightweight Deep Learning Models,” arXiv, 2025.
V. Chaudhari, P. Mhatre, and J. Bind, “Hand Gesture Control Robot Using Arduino,” VIVA-Tech International Journal for Research and Innovation, 2024.
A. Ahmed et al., “Tracked Robot Control with Hand Gesture Based on MediaPipe,” ResearchGate Technical Paper, 2024.
M. Oudah et al., “Hand Gesture Recognition Based on Computer Vision: A Review,” Sensors Journal, 2020.
“Real-Time Robotic Hand Interaction Control Using MediaPipe for Gesture-Based Applications,” Robotics Research Article, 2025.
This work is licensed under a Creative Commons Attribution 4.0 International License.
All articles published in our journal are licensed under CC-BY 4.0, which permits authors to retain copyright of their work. This license allows for unrestricted use, sharing, and reproduction of the articles, provided that proper credit is given to the original authors and the source.