VIDEO POST relaunches MetaPhase, the artistic output of a cross-sector encounter between avant-garde pianist and researcher Giusy Caruso (BE) and the innovative start-up LWT3 (IT). This joint research was driven to explore the creative potential of data processing, human-machine interaction, and biotechnological applications in a XR performance.
The pianist performs by wearing a suit with light-reflecting markers and biosensor to allow the system to track her gestures and the related muscles effort in real-time. Then, the pianist wears the Oculus Rift to enter in the meta-performance-scene developed by LWT3 with Unity platform and performs the counterpoint part of Steve Reich’s Piano Phase for two pianos by interacting with another avatar-pianist playing the first part of the piece. This second virtual human is animated by the real pianist’s expressive motion previously recorded together with the audio track on a Yamaha Disklavier piano. LWT3’s wearable interfaces acquire bio-signals such as sEMG from the real pianist to modify visuals, video effects, and audio parameters.
Giusy Caruso (BE) and innovative start-up LWT3, Avatar Piano Project
piano concert and motion tracking, Rassegna Open NIght, Museo Nazionale della Scienza e della Tecnologia Leonardo da Vinci, Milan
The work was recognized with the Honorary Mention at S+T+ARTS, Ars Electronica Festival 2023