This is the video accompanying our paper "Real-time sound synthesis for paper material based on geometric analysis" By Schreck, Rohmer, James, Hahmann, Cani ACM SIGGRAPH/Eurographics Symposium on Computer Animation (SCA'16)Best Paper Award

pdf: https://hal.inria.fr/hal-01333238v3

Abstract: In this article, we present the first method to generate plausible sounds while animating crumpling virtual paper in real time.Our method handles shape-dependent friction and crumpling sounds which typically occur when manipulating or creasing paper by hand. Based on a run-time geometric analysis of the deforming surface, we identify resonating regions characterizing the sound being produced. Coupled to a fast analysis of the surrounding elements, the sound can be efficiently spatialized to take into account nearby wall or table reflectors. Finally, the sound is synthesized in real time using a pre-recorded database of frequency- and time-domain sound sources. Our synthesized sounds are evaluated by comparing them to recordings for a specific set of paper deformations.