Mother is a series of generative sculptures that explore synesthetic connections between language and form by analyzing hand gestures that represent the participants’ interpretations of unfamiliar spoken words. The gestures of the participants were captured in 3D using a Kinect, interpreted with open Frameworks, and printed with a rapid prototyping machine.
Mother studies sound symbolism and explores synesthetic connections between language and shapes. It translates audible and intelligent communication into a visual and tangible form through the use of computation and 3D printing. Verbal descriptions of a set of unknown sounds, as well as the hand gestures used by participants to describe the sounds, are captured using XBox Kinect, extruded over time with a custom-built software made with openFrameWorks, and finally printed into sculptures. In contrast to the unrecorded spoken language, which is ephemeral, language that is printed three-dimensionally becomes embodied in a physical form. In this work, the human translator is replaced by a computer. The concept of translation is thus stretched, expanded, and re-contextualized, providing a flexible way to see and experience language through a work of art.
ITP/New York University