Computer Vision · Real-Time · No Touch Required

Control your
machine
with your hands.

— The future of human-computer interaction is already here.

A gesture-driven desktop interface built with Python, OpenCV, and MediaPipe. Move your cursor, click, scroll, and control volume — entirely hands-free, no extra hardware needed.

Download for Windows — Free ↓ scroll
FPS: 60
LIVE
MOVE MOUSE
Landmarks
21
Confidence
94%
Latency
12ms
Event LogLIVE
Move Mouse✓
Left Click✓
Scroll Up✓
Built With
Python 3.x
OpenCV
MediaPipe
PyInstaller
NumPy
How It Works

From webcam to action,
in real time.

Six stages. Zero latency. Pure gesture.

01 / CAPTURE
📷
Camera Input
Your webcam feeds a live stream into the system. OpenCV handles frame capture and preprocessing at high frame rates with no additional hardware.
02 / DETECT
🖐
Landmark Detection
MediaPipe tracks 21 precise 3D hand landmarks per frame — every joint, knuckle, and fingertip — with sub-20ms latency at 60 FPS.
03 / INTERPRET
🧠
Gesture Recognition
A deep learning–backed gesture engine analyzes landmark geometry, finger angles, and relative positions — distinguishing even subtle hand states.
04 / ACT
⚡
System Control
Recognized gestures are mapped to OS-level actions — cursor movement, mouse events, scrolling, volume, and screenshots.
05 / LOOP
🔄
Continuous Processing
The entire pipeline runs at 60 FPS — capture, detect, interpret, act — delivering seamless, uninterrupted interaction in real time.
06 / DEPLOY
📦
Zero-Install Executable
Packaged with PyInstaller into a standalone .exe. No Python, no libraries, no setup. Download it and it just works.
Under the Hood

Engineering built for
precision at speed.

Not a demo. A deployable system.

Advanced Hand Tracking
High-Precision Landmark Detection
Utilizes MediaPipe to track 21 3D hand landmarks in real-time, capturing every joint and fingertip movement with extreme accuracy.
Sub-20ms Latency
Engineered for high-speed processing at 60 FPS — the transition from physical movement to screen action feels instantaneous.
Robust Gesture Engine
Employs deep learning and geometric analysis to distinguish subtle hand states — such as index-middle contact vs. separation.
Intelligent Cursor Control
Dynamic Mouse Mapping
Seamlessly translates your hand's 3D coordinates into 2D screen space using OpenCV and PyAutoGUI for natural, fluid movement.
Movement Locking Mechanism
A specialized gesture allows you to freeze the cursor — preventing accidental drift while you prepare to click or perform a precise action.
Multi-Click Support
Sophisticated detection for single left click, double click, and right click — each mapped to a distinct, independently recognized finger gesture.
Integrated System Commands
Intuitive Scroll Mode
Activate scrolling by raising your thumb and moving your hand vertically — ideal for reading documents or browsing without a physical wheel.
Rotary Volume Control
A virtual dial gesture where rotating your open hand adjusts system volume up or down — natural and precise.
Screenshot Trigger
A deliberate Fist→Open→Fist sequence that captures your screen, mapped to avoid accidental triggers during normal use.
Developer & Performance
Zero-Dependency Deployment
Packaged as a standalone .exe via PyInstaller — users need no Python installation or additional libraries to run it.
Cross-Platform Foundations
Built on a Python core that supports future-proofing for Windows, macOS, and Linux deployments.
Visual Debugger / Analytics
Live event log and confidence meter provide real-time feedback on how the AI is interpreting your gestures — transparent and informative.
Features

Precision-built for
real-world use.

Every gesture mapped. Every action deliberate.

01
Real-Time Cursor Control
Index and middle finger joined — their contact point maps directly to your cursor position across the screen in real time.
02
Movement Lock
Spread index and middle finger apart to freeze cursor movement. Eliminates drift when preparing to click.
03
Click Actions
Index finger dips once for left click, twice for double click. Middle finger dips for right click — each independently detected.
04
Thumb-Activated Scroll
Raise your thumb to enter scroll mode. Move your hand up or down to scroll. Low-effort and intuitive.
05
Rotary Volume Control
All fingers extended, rotate your hand like a dial — right to increase, left to decrease. Directly mapped to system volume.
06
Screenshot Gesture
Fist → Open → Fist within 2 seconds triggers a screenshot. Deliberate enough to avoid accidental triggers, fast enough to feel natural.
Use Cases

Built for people.
All of them.

Where hands-free isn't a luxury — it's a necessity.

♿
Accessibility First
Designed to empower users with limited mobility or those who cannot use traditional peripherals. GestureX brings full desktop control to anyone with a working webcam — no special hardware, no compromise.
🧤
Contactless Environments
Perfect for kitchens, laboratories, factory floors, or medical settings — anywhere touching a physical mouse is impractical, unhygienic, or impossible. Control your system without ever laying a finger on it.
🎤
Presentations & Demos
Navigate slides, control media, and manage your screen with natural hand gestures while staying fully engaged with your audience. No clicker, no keyboard, no interruption.
🔬
Research & Innovation
A foundation for exploring the future of HCI. GestureX is modular and extensible — ideal as a platform for researchers and developers building the next generation of gesture-based interfaces.
Gesture Map

Ten gestures.
Total control.

Learn them in minutes. Use them for life.

Gesture
Mapped Action
Index + middle finger joined, raised
Move Mouse
Index + middle finger raised, apart
Lock Movement
Index fingertip dips down once
Left Click
Middle fingertip dips down once
Right Click
Index fingertip dips down twice
Double Click
Thumb raised, hand moves upward
Scroll Up
Thumb raised, hand moves downward
Scroll Down
Closed fist → open fist → closed fist (within 2s)
Screenshot
All fingers extended, hand rotates right
Volume Up
All fingers extended, hand rotates left
Volume Down
Download

Your hands.
Your computer.

— No setup. No dependencies. Just download and run.

A standalone Windows application. No Python installation required. Download the .exe, double-click, and start controlling your machine with gestures.

Windows Executable · v1.0.0
gestureX_v1.0.0.exe
Download Free
Windows 10 / 11 · 64-bit · Webcam required
Security Notice
This is an independently developed project by final year students and is not code-signed. Windows Defender or SmartScreen may flag it as unrecognized software when you first run it.

This is expected for unsigned indie software and does not indicate malware. To proceed: if SmartScreen appears, click "More info" → "Run anyway". If Windows Defender prompts, click "Allow" or "Run anyway". The source code is open on GitHub for full transparency.