Virtual Music: Create & Perform Music in Thin Air
Tunevate is the next-generation virtual music studio that transforms webcam hand tracking into polyphonic harmony, expressive synthesis, drum rhythms, and multitrack loops. No MIDI keyboard, audio cables, or software installation needed.
How Hand Gesture Tracking Works
Tunevate uses your device’s webcam and client-side computer vision to track 21 hand landmarks in 3D space with sub-millisecond precision. Here is how your hands shape chords, melodies, and sound parameters:
Harmonic Foundation & Key Center
Position your left hand in frame to select scale roots and chord qualities. Tilt your hand to toggle between major brightness and minor warmth.
Melodic Voicing & Texture
Raise right-hand fingers to build triads, 7th chords, and inversions. Strum acoustic guitars or sweep synth filters with natural wrist rotation.
Multitrack Layering & Drum Beats
Switch between playing instruments and arming drum beats. Record quantised passes to the loop timeline and build complete songs piece by piece.
Built for Real-Time Music Creation
Engineered with Tone.js, Web Audio API, and MediaPipe AI for professional synthesis, responsive acoustic instruments, and seamless loop recording.
Real-Time Music Theory Engine
Generates full 4-note voicings dynamically from diatonic scale intervals across all 12 chromatic musical keys.
Integrated Looper & Session Recorder
Layer endless tracks with bar-accurate tempo quantisation. Export your creations to portable .tvate session files.
Gesture Drum Machine
Finger-combination drum sequencer with 31 percussion slots: punchy kicks, crisp snares, claps, and open/closed hi-hats.
ChordPro Song Learning Mode
Load popular songs and learn chord-by-chord with visual chord targets and synchronized lyrics.
100% In-Browser Performance
Runs on Web Audio API and WebAssembly with zero background latency, completely offline-capable.
Complete Privacy By Design
Camera frames are processed strictly in GPU/CPU RAM and discarded immediately. No data is stored or streamed.
Audio & Machine Learning Architecture
| Harmonic Range | All 12 chromatic keys (Major, Natural Minor, Inversions, 7ths) |
| Audio Architecture | Tone.js Web Audio Synth + Sample Playback Engine |
| Vision Pipeline | Google MediaPipe Hand Landmark Detection (21 points/hand) |
| Clock Resolution | 1/16th note quantisation at customizable BPM |
| File Export | .tvate session file format with JSON metadata and loop timing |
Frequently Asked Questions
Everything you need to know about playing this instrument online with hand gestures.
Can I make complete songs with virtual music in Tunevate?
Yes! Tunevate includes a full rhythm section (drums), polyphonic harmony (synths, pianos, guitars, bass), and an integrated multitrack looper that locks all parts to a shared master clock.
Do I need musical training to create virtual music with hand gestures?
No prior music training is required. Tunevate's built-in music theory engine constrains notes to the selected harmonic key, making it virtually impossible to play out-of-tune notes.
Can I use Tunevate for live virtual music performances?
Tunevate was engineered specifically for real-time live performance. The low-latency audio engine and visual HUD feedback let audiences see and hear your hand gestures creating music simultaneously.