All projects

Gesture-controlled music

Cuey

A hands-free macOS music controller that turns webcam-tracked gestures into Spotify controls.

Cuey displaying real-time hand tracking and gesture controls over a webcam feed.

The project

Cuey uses real-time hand landmark detection and motion analysis to make play, pause, skip, and back controls feel natural while working at a computer. A custom OpenCV interface gives immediate visual feedback, while AppleScript bridges the gesture layer to Spotify on macOS.

What it does

01

Real-time tracking

Uses MediaPipe hand landmarks and motion analysis to recognize commands from a webcam feed.

02

Native controls

Maps gestures to Spotify through macOS AppleScript without interrupting the current workflow.

03

Visual feedback

Renders an anti-aliased OpenCV interface so every recognized gesture has an immediate response.