Gesture Synth Chords: Hand Gesture Chord Tutorial

Gesture Chords is the mode to try when you want to make a progression without aiming at individual piano keys. Your left hand picks the chord. Your right hand brings it in and changes its character. Once the two gestures feel steady, a four-bar loop is not far away.

Open the Gesture Synth instrument, or choose Gesture Chords from the hand gesture music library. You need a laptop or desktop webcam, speakers or headphones, and a little room for both hands. A plain background and light in front of you help more than expensive equipment.

Two hands, two jobs

The left hand selects a degree in the current scale. In the Easy C-major preset, the first five shapes are:

| Left-hand pose | Chord degree | C-major chord | | -------------- | ------------ | ------------- | | 1 finger | I | C major | | 2 fingers | II | D minor | | 3 fingers | III | E minor | | 4 fingers | IV | F major | | 5 fingers | V | G major |

The preset uses fixed chord settings, so you can concentrate on the finger count. The full gesture settings allow more variation, but there is no reason to learn every option on the first try.

The right hand controls the sound around the chord. Raise it for more volume and tilt it to change the tone. In the full mode, its finger shape can choose a chord style, and the thumb can move the chord down an octave. Keep the right hand simple at first. One or two visible fingers and a steady height are enough.

Get one chord working

Start with the Easy C-major chords preset. Wait for the hand-tracking setup to finish, allow the camera, and click inside the instrument once so the browser can start audio.

Now try this:

1. Raise one finger on the left hand.
2. Lift the right hand slowly until you hear I.
3. Hold both hands still for four beats.
4. Change the left hand to four fingers for IV.
5. Change it to five fingers for V, then return to four.

The first goal is not speed. It is a chord that stays on the screen long enough to hear. If the label changes before you are ready, spread the fingers apart and wait a beat between poses. If the sound disappears, raise the right hand a little. Browsers can also leave audio paused until the first click, so check that before changing the hand shape.

Keep the tracker calm

The tracker sees fingers, not intention. A finger hidden behind another finger may not count. A hand near the edge of the frame can vanish for a moment. A fast change can look like an extra finger.

Use a clear pose and hold it briefly. Keep your palms facing the camera. Put the light in front of your hands instead of behind your head. If one hand keeps dropping out, move it closer to the center of the frame and slow down.

The live chord label is useful feedback. Watch it while you practice. When it jumps, return to the last shape that worked, let it settle, and then try the next shape. This is usually faster than changing several settings at once.

Three loops worth trying

I | IV | V | IV

This is the easiest four-bar exercise. Use 1, 4, 5, and 4 fingers on the left hand, one chord per bar. Keep the right hand at one height. When the loop is stable, add a short piano melody or a held theremin note on Track 2.

I | V | VI | IV

This progression has a familiar pop feel. Use scale degrees 1, 5, 6, and 4. The sixth degree may require the extended finger shape shown by the instrument. Take it slowly. The point is to hear the change to VI, not to get through the loop as quickly as possible.

IV | V | I | I

Start on four fingers, move to five, and resolve to one. Hold I for two bars. Try lowering the right hand during IV and V, then raising it slightly when I arrives. The small volume change makes the resolution easier to hear.

Record the progression

Set the loop controls to 96 BPM, 4/4, and four bars. Select Track 1 and press R, or use the red record button. Wait for the count-in, then play one chord per bar.

When Track 1 starts looping, select Track 2. A held chord, a small piano phrase, or a simple drum part usually fits better than another busy progression. Use M to mute the selected track and S to hear it on its own. Delete clears the take so you can record it again.

The bottom Export control saves the loop mix as an audio WebM file. The top Record control captures the hand performance and synthesized sound as video when the browser supports it. If you only want to hear the progression, Export is the simpler choice.

Download the starter chart

Here is a downloadable Gesture Synth chord chart for the C-major I-IV-V-IV loop. It lists the finger counts and four-beat timing. Keep it beside the webcam while you play, or print it before starting the instrument.

Once the first loop feels ordinary, change one thing. Try the Dreamy D-minor sevenths preset, adjust the chord quality, or use right-hand tilt to change the tone. For single notes, read the Gesture Synth piano guide. For camera setup, recording, and the other instruments, use the Gesture Synth tutorial.

Start with one progression. A small loop that stays in time is more useful than a complicated setup you cannot yet control.