# Tunevate — Gesture Synth & Virtual Music Studio

> Tunevate is a free, zero-install browser application that turns webcam hand gestures into real-time music. It includes a polyphonic gesture synthesizer, acoustic and electric virtual pianos, acoustic/country/electric guitars, bass guitars, a 31-slot drum machine, and a multitrack looper. All video and audio processing runs 100% client-side in the browser using MediaPipe AI and Tone.js Web Audio.

## Core Capabilities & Features
- **Gesture Synth**: Polyphonic synthesizer with Warm Pad (triple saw), Bright Saw, and Square Lead voices. Lowpass filter cutoff frequency is modulated live by wrist tilt; thumb extension shifts pitch down by one octave.
- **Online Piano**: High-definition Concert Grand Piano and vintage Rhodes Electric Piano samples with realistic decay and optional sustain.
- **Online Guitar & Bass**: Strum acoustic, country, and electric guitar chords using lateral right-hand flicking motions. Pluck bass guitar root notes with single-note policy.
- **Virtual Drums**: 31-slot percussion kit addressed via 5-bit finger combinations. Includes a 16-step grid sequencer synchronized to a master transport clock.
- **Online Looper & Virtual Looper**: Multi-layer loop recorder with automatic 1/16th-note quantisation, pre-roll count-in, independent track mixing, and `.tvate` session file export.
- **Music Theory Engine**: Automatically translates hand gestures into musically valid chords and inversions across all 12 chromatic keys (C through B).
- **ChordPro Song Practice**: Synchronized lyric and chord charts with visual gesture targets.
- **Privacy Guarantee**: Zero video frames or audio streams are sent to remote servers; all computer vision occurs inside local WebAssembly/GPU memory.

## Gesture Control Architecture
- **Left Hand (Harmonic Key & Chord Degree)**:
  - 1 finger = I (Tonic chord)
  - 2 fingers = ii (Supertonic chord)
  - 3 fingers = iii (Mediant chord)
  - 4 fingers = IV (Subdominant chord)
  - 5 fingers = V (Dominant chord)
  - Wrist Tilt = Toggles Major vs Minor triad quality.
- **Right Hand (Voicing & Modulation)**:
  - 1 finger = Root position triad
  - 2 fingers = 1st inversion
  - 3 fingers = 7th chord extension
  - 4 fingers = Extended voicing
  - Extended Thumb = Drops the entire chord down one octave (-12 semitones)
  - Wrist Tilt = Lowpass filter cutoff sweep (Tilt back for open highs, forward for muffled warmth)
  - Vertical Height = Volume dynamic level
  - Lateral Flick = Strum trigger (for guitars and bass)

## URL Directory & Documentation
- Live Camera Studio: https://chordexempire.online/
- Virtual Instruments Suite: https://chordexempire.online/virtual-instruments
- Gesture Synth: https://chordexempire.online/gesture-synth
- Online Piano: https://chordexempire.online/online-piano
- Online Synth: https://chordexempire.online/online-synth
- Online Guitar: https://chordexempire.online/online-guitar
- Virtual Drums: https://chordexempire.online/virtual-drums
- Online Looper: https://chordexempire.online/online-looper
- Virtual Looper: https://chordexempire.online/virtual-looper
- Virtual Music Studio: https://chordexempire.online/virtual-music

## Tech Stack
- Frontend: Next.js 16 (App Router), React 19, TypeScript
- Machine Learning: Google MediaPipe HandLandmarker (WebAssembly / WebGL)
- Audio Engine: Tone.js v15, Web Audio API
- Monorepo: npm workspaces (@tunevate/audio-engine, @tunevate/chord-mapper, @tunevate/drums, @tunevate/hand-tracking, @tunevate/looper, @tunevate/music-theory, @tunevate/session, @tunevate/song, @tunevate/transport)
- Open Source: https://github.com/Flufive/Tunevate