Opencv based hand gesture interface for keyboard and mouse with 100+ gestures
It is a mouse and keyboard simulation system that performs all the functions that are performed by old peripherals corresponding to our hand movements and gestures. Simply speaking, a camera captures our video and depending on your gestures it can perform all the functions a simple mouse can
2025-06-28 16:34:21 - Adil Khan
Opencv based hand gesture interface for keyboard and mouse with 100+ gestures
Project Area of Specialization Artificial IntelligenceProject SummaryIt is a mouse and keyboard simulation system that performs all the functions that are performed by old peripherals corresponding to our hand movements and gestures. Simply speaking, a camera captures our video and depending on your gestures it can perform all the functions a simple mouse can do e.g. left and right clicks, object selection, drag and drop and scrolling up and down. Similarly it can also perform keyboard events.
Project Objectives- The goal of this project is try to develop a computer vision based software for controlling computer or laptop events like mouse clicks, cursor motion and keystrokes by using hand gesture.
- Try to develop a computer vision based keyboard.
- Try to develop a computer vision based mouse.
The implementation phase will include the following aspects.
- Based on our design, we will use python to write the image processing algorithms to detect hand gesture.
- Based on our design, we develop the user interface.
- Based on our design we develop the Mouse interface and its Operations using hand gesture.
- Based on our design we develop the keyboard interface and its operations using hand gesture.
The goal of this project is try to develop a computer vision based software for controlling computer or laptop events like mouse clicks, cursor motion and keystrokes by using hand gesture.Some of the benefits are as follows:
- Automatic inspection, e.g., in manufacturing applications
- Assisting humans in identification tasks, e.g., a species identification system
- Controlling processes, e.g., an industrial robot
- Detecting events, e.g., for visual surveillance or people counting
- Interaction, e.g., as the input to a device for computer-human interaction
- Modeling objects or environments, e.g., medical image analysis Navigation, e.g., by an autonomous vehicle or mobile robot; and
- Organizing information, e.g., for indexing databases of images and image sequences.
We wil deliver a camera as our main hardware component,software,report and project related research paper.
Final Deliverable of the Project HW/SW integrated systemType of Industry IT Technologies Artificial Intelligence(AI)Sustainable Development Goals Quality EducationRequired Resources| Item Name | Type | No. of Units | Per Unit Cost (in Rs) | Total (in Rs) |
|---|---|---|---|---|
| Total in (Rs) | 68500 | |||
| Intel RealSense Depth Camera D435i | Equipment | 1 | 29000 | 29000 |
| DM160222 processor(board) | Equipment | 2 | 3000 | 6000 |
| L.T cables | Equipment | 3 | 3000 | 9000 |
| overheads | Equipment | 3 | 3000 | 9000 |
| communication cables | Equipment | 3 | 2500 | 7500 |
| printing and stationary | Miscellaneous | 1 | 8000 | 8000 |