NYU Music Experience Design Lab

← Back to project archive

Active project

Virtual Piano Duet v2

Improvise a duet with Steve Wogaman of the Chamber Music Society of Detroit. Code adapted from Yotam Mann; design by Diana Castro and Alex Ruthmann; earlier code updates by Guergana Tzatchkova.

Open Virtual Piano Duet v2 →

Virtual Piano Duet v2 Melody Notebook with two test melodies and replay, export and import controls
Live interface captured 13 October 2026. Select the screenshot to view it at full size.

Melody Notebook

V2 automatically tracks played notes, timing and chords as piano rolls. Name and save phrases in this browser, replay them alone or with the duet, and export or import compatible melody JSON files. These are note events, not audio or microphone recordings. Saving uses this browser’s local storage, with no account or cloud sync; clearing browser data removes saved takes, so export a JSON backup to keep or transfer them.

Capture saves after a 2.5-second pause with all keys released, retains the newest 60 takes, and supports up to 90 seconds per take. Very short gestures (fewer than two notes or 0.8 seconds) are not saved. Import accepts compatible CMSD melody JSON, not audio or MIDI.

What has been tested

51 capture/replay browser checks and 199 original-input checks passed, along with live save/reload, replay, naming and JSON import/export checks. Phone/tablet browser layouts were checked; physical devices remain untested.

Makey Makey mode is off by default. When enabled, arrows, Space and W/A/S/D/F/G play notes without triggering video or page shortcuts while the piano has focus. Browser tests covered all eleven inputs, note release, repeated keys and video-control conflicts.

Availability and limits

Physical Makey Makey hardware, iPads and phones have not been tested. Clicking video controls still works; Tab and Escape remain available. Held notes are released when focus leaves the piano.

Open the original version

Credits and provenance

Responsive design update documented in May 2020. Makey Makey browser-key repair published 13 October 2026. V2 Melody Notebook published 13 October 2026. Screenshot shows the verified v2 notebook with test melodies.

Original project documentation · Public application source