Sketching is at the core of every design activity. In visual design, pencil and paper are the preferred tools to produce sketches for their simplicity and immediacy. Analogue tools for sonic sketching do not exist yet, although voice and gesture are embodied abilities commonly exploited to communicate sound concepts. The EU project SkAT-VG aims to support vocal sketching with computeraided technologies that can be easily accessed, understood and controlled through vocal and gestural imitations. This imitation-driven sound synthesis approach is meant to overcome the ephemerality and timbral limitations of human voice and gesture, allowing to produce more re- fined sonic sketches and to think about sound in a more designerly way. This paper presents two main outcomes of the project: The Sound Design Toolkit, a palette of basic sound synthesis models grounded on ecological perception and physical description of sound-producing phenomena, and SkAT-Studio, a visual framework based on sound design workflows organized in stages of input, analysis, mapping, synthesis, and output. The integration of these two software packages provides an environment in which sound designers can go from concepts, through exploration and mocking-up, to prototyping in sonic interaction design, taking advantage of all the possibilities offered by vocal and gestural imitations in every step of the process.

Sketching sonic interactions by imitation-driven sound synthesis

Baldan, Stefano;Delle Monache, Stefano;Rocchesso, Davide;
2016-01-01

Abstract

Sketching is at the core of every design activity. In visual design, pencil and paper are the preferred tools to produce sketches for their simplicity and immediacy. Analogue tools for sonic sketching do not exist yet, although voice and gesture are embodied abilities commonly exploited to communicate sound concepts. The EU project SkAT-VG aims to support vocal sketching with computeraided technologies that can be easily accessed, understood and controlled through vocal and gestural imitations. This imitation-driven sound synthesis approach is meant to overcome the ephemerality and timbral limitations of human voice and gesture, allowing to produce more re- fined sonic sketches and to think about sound in a more designerly way. This paper presents two main outcomes of the project: The Sound Design Toolkit, a palette of basic sound synthesis models grounded on ecological perception and physical description of sound-producing phenomena, and SkAT-Studio, a visual framework based on sound design workflows organized in stages of input, analysis, mapping, synthesis, and output. The integration of these two software packages provides an environment in which sound designers can go from concepts, through exploration and mocking-up, to prototyping in sonic interaction design, taking advantage of all the possibilities offered by vocal and gestural imitations in every step of the process.
2016
Proceedings of the 13. Sound & Music Computing Conference
2518-3672
Inglese
47
54
8
9783000537004
Zentrum für Mikrotonale Musik und Multimediale Komposition (ZM4) Hochschule für Musik und Theater
Hamburg, Germany
GERMANIA
13. Sound & Music Computing Conference (SMC 2016)
31.8.–3.9.2016
Amburgo
Internazionale
no
contributo
Esperti anonimi
https://zenodo.org/record/1400818#.X-Hxk1VKjIU
vocal sketching, sound synthesis, sound design tools,
sì
open
info:eu-repo/semantics/conferenceObject
4
3. Contributo in atti di convegno (Proceedings)::3.1 Contributo in atti di convegno
Baldan, Stefano; Delle Monache, Stefano; Rocchesso, Davide; Lachambre, Helene
273
File in questo prodotto:
File Dimensione Formato  
SMC2016_dellemonache.pdf

accesso aperto

Tipologia: Versione Editoriale
Licenza: Creative commons
Dimensione 2.15 MB
Formato Adobe PDF
2.15 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11578/264489
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
social impact