Vibrating shapes : Design and evolution of a spatial augmented reality interface for actuated instruments

Cagan Arslan (1) , Florent Berthaut (1, 2) , Anthony Beuchey (1) , Paul Cambourian (3, 4, 5) , Arthur Paté (4, 5, 3)

1 CRIStAL - Centre de Recherche en Informatique, Signal et Automatique de Lille - UMR 9189
2 IRCICA - Institut de Recherche sur les Composants logiciels et matériels pour l'Information et la Communication Avancé - UAR 3380
3 JUNIA - JUNIA
4 IEMN - Institut d’Électronique, de Microélectronique et de Nanotechnologie - UMR 8520
5 ACOUSTIQUE - IEMN - Acoustique - IEMN

In this paper we propose a Spatial Augmented Reality interface for actuated acoustic instruments with active vibration control. We adopt a performance-led research approach to design augmentations throughout multiple residences. The resulting system enables two musicians to improvise with four augmented instruments through virtual shapes distributed in their peripheral space: two 12-string guitars and 1 drum kit actuated with surface speakers and a trumpet attached to an air compressor. Using ethnographic methods, we document the evolution of the augmentations and conduct a thematic analysis to shine a light on the collaborative and iterative design process. In particular, we provide insights on the opportunities brought by Spatial AR and on the role of improvisation.

Keywords: Actuated instruments; Spatial Augmented Reality; Performance-led research

Domains: Sound [cs.SD]; Human-Computer Interaction [cs.HC]; Musicology and performing arts

Cagan Arslan, Florent Berthaut, Anthony Beuchey, Paul Cambourian, Arthur Paté. Vibrating shapes : Design and evolution of a spatial augmented reality interface for actuated instruments. New Interfaces for Musical Expression, Jun 2022, Auckland, New Zealand. ⟨10.21428/92fbeb44.c28dd323⟩. ⟨hal-03712843⟩