SynesthDraw

by Tyloo

Project Description:
The Composer - Interactive Turntable Musical Installation This project aims to create an interactive installation called The Composer, which generates music based on visual patterns drawn by users.


This project aims to create an interactive installation called The Composer, which generates real-time music based on visual patterns drawn by users. Each participant begins by using a black marker to freely draw on a custom-made “record” — a circular piece of white paper. Once the drawing is complete, the record is placed into the device and playback begins.

As the turntable spins, a beam of light is projected from above while a light sensor positioned below detects interruptions caused by the black markings. By analyzing the position and timing of these interruptions, the system determines which part of the drawing corresponds to which angle of rotation. It then triggers a servo motor connected to a mallet, which strikes the corresponding xylophone key — simulating the playback of a traditional record through drawing-driven musical output.

A key feature of The Composer is its dual-user interaction. The installation includes two independent rotating platforms, each controlled by a user's drawing. Together, the two records cover a total of 15 xylophone keys. The visual data from both records is sensed simultaneously and instantly converted into melodic parameters, creating a unique and collaborative musical performance in real time.