Procedurally-Generated Audio for Soft-Body Interactions

It appears your Web browser is not configured to display PDF files. Download adobe Acrobat or click here to download the PDF file.

Click here to download the PDF file.

Supplemental Files: 

Creator: 

Su, Feng

Date: 

2020

Abstract: 

Procedural audio generation is an important method for automatically synthesizing realistic sounds for computer animations and games. While synthesis techniques for rigid bodies have been well studied, few existing works have tackled the challenges of soft-body interactions. In this dissertation, we explore practical methods for procedural audio generations of soft bodies. First, we synthesize both impulsive and continuous sounds for elastic deformations. Our method is built on granular synthesis that retargets sound tracks of real-world recordings to match the motion of input elastic objects. Next, to synthesize sounds for plastic deformations, we introduce a concatenative synthesis method with a fast feature correlation technique, which is able to calculate the motion events of highly deformable objects at run time and simultaneously generate sounds according to these motion signals. Last but not least, we focus on evaluating the synthesized audio using both subjective and objective techniques, and the results demonstrate that our proposed synthesis methods can produce convincing sounds for soft bodies that are comparable to the recorded ones. Our presented methods do not require computationally expensive physics simulations and have improved previous data-driven synthesis approaches with more efficient analysis, control and evaluation techniques, which makes it possible to automatically generate plausible audio for a variety of soft-body interactions.

Subject: 

Engineering - Electronics and Electrical
Computer Science
Physics - Acoustics

Language: 

English

Publisher: 

Carleton University

Thesis Degree Name: 

Doctor of Philosophy: 
Ph.D.

Thesis Degree Level: 

Doctoral

Thesis Degree Discipline: 

Engineering, Electrical and Computer

Parent Collection: 

Theses and Dissertations

Items in CURVE are protected by copyright, with all rights reserved, unless otherwise indicated. They are made available with permission from the author(s).