controlling digital devices with hand gestures is so cool and you can control things like media, APPs and etc. but controlling physical objects with hand gestures is much more cooler. in this project with help of computer vision I'm controlling printed photo with hand gestures.
you can use this idea and code to control any physical objects with hand gestures. video:https://youtu.be/6PgNuSUyM-Q
Detailsthis project have two parts:
first part is a python code that runs on the computer.and second part is hardware, including Arduino board and 3 servo motors.
in python code with the help of opencv and mediapipe we can trace finger motions and based on finger motions we send commands to arduino board with serial port and Arduino controls servo motors.
For running the python code you need PyCharm softwarebefore running the code you should install:opencvmediapipeSerial
OpenCV (Open Source Computer Vision Library) is an open source computer vision and machine learning software library.OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in the commercial products.
MediaPipe offers open source cross-platform, customizable ML solutions for live and streaming media.
You can download the code from the YouTube video description.
I have also posted this project to PCBWay community, here is the link:
https://www.pcbway.com/project/shareproject/Control_objects_with_your_hand_Gesture_1641066b.html
Comments