Real sound synthesis for interactive applications / Perry R. Cook.

Format:

Book

Author/Creator:

Cook, Perry R.

Language:

English

Subjects (All):

Sound--Recording and reproducing--Digital techniques.

Sound.

Computer sound processing.

Interactive multimedia.

Physical Description:

xvii, 263 pages : illustrations ; 23 cm + 1 CD-ROM (4 3/4 in.)

4 3/4 in.

Place of Publication:

Natick, Mass. : A K Peters, [2002]

System Details:

digital

optical

text file

Summary:

This book emphasizes physical modeling of sound and focuses on real-world interactive sound effects. It is intended for game developers, graphics programmers, developers of virtual reality systems and training simulators, and others who want to learn about computational sound. It is written at an introductory level with mathematical foundations provided in appendices.

Contents:

1. Digital Audio Signals 1

1.2 Sampling and Aliasing 2

1.3 Quantization 4

1.4 Resampling and Interpolation 5

1.5 Digital Audio Compression 7

2. Sampling (Wavetable) Synthesis 11

2.1 Wavetable Synthesis 11

2.2 Concatenative Speech Synthesis 13

2.3 Manipulating PCM 14

2.4 Let's Pause and Think Here 18

3. Digital Filters 21

3.1 Linear Systems, LTI Systems, Convolution 21

3.2 Digital Filters 24

3.3 FIR Filters 24

3.4 IIR Filters 26

3.5 The General Filter Form 26

3.6 The Z Transform 27

3.7 The Transfer Function 28

3.8 Zeroes and Poles 29

3.9 First Order One-Zero and One-Pole Filters 29

3.10 The Second Order Pole/Zero (BiQuad) Filter 31

3.11 A Little on Filter Topologies 34

4. Modal Synthesis 39

4.1 A Simple Mechanical System 39

4.2 Solution of the Mass/Spring/Damper System 41

4.3 Boundary Conditions and Solutions 43

4.4 Sinusoidal Additive Synthesis 45

4.5 Filter-Based Modal Synthesis 46

4.6 Residual Extraction and Resynthesis 48

5. The Fourier Transform 51

5.1 The Frequency Domain Spectrum 52

5.2 The Fourier Series 52

5.3 The Discrete Fourier Transform 53

5.4 Orthogonality and Uniqueness of the DFT 55

5.5 Convolution with the DFT and the FFT 55

5.6 Some Fourier Transform Applications 57

5.7 The Short-Time Fourier Transform 60

6. Spectral Modeling and Additive Synthesis 63

6.1 Types of Spectra 63

6.2 Spectral Modeling 68

6.3 Sines Plus Noise Plus Transients 71

6.4 Spectra in Time 72

7. Subband Vocoders and Filterbanks 75

7.1 Subband Decomposition of Audio 75

7.2 The Channel Vocoder 78

7.3 The Cross-Synthesizing Channel Vocoder 80

7.4. The Phase Vocoder 81

8. Subtractive Synthesis and LPC 85

8.1 Subtractive Synthesis 85

8.2 Resonance-Factored (Formant) Synthesis 87

8.3 Linear Prediction 88

8.4 LPC Speech Examples 90

8.5 LPC for Nonspeech and Real-World Sounds 92

8.6 LPC and Physics 94

9. Strings and Bars 97

9.1 The Ideal String 97

9.2 Refining the Ideal String 101

9.3 Weak Stiffness 103

9.4 Really Stiff Structures: Bars 105

10. Nonlinearity, Waveshaping, FM 109

10.1 Simple Physical Nonlinearity 109

10.2 Simulating Physical Nonlinearity 113

10.3 Nonlinear Wave Synthesis by Lookup Table 114

11. Tubes and Air Cavities 121

11.1 The Ideal Acoustic Tube 121

11.2 Building a Simple Clarinet 122

11.3 Resonance in Air Cavities 124

12. Two and Three Dimensions 131

12.1 Membranes and Plates, Mass/Spring Models 131

12.2 Three-Dimensional Structures 136

12.3 Banded Waveguides in Higher Dimensions 140

12.4 Spatial Modes in Complex Geometries 143

13. FOFs, Wavelets, and Particles 149

13.1 Formants in the Time Domain: FOFs 149

13.2 Wavelets 152

13.3 Granular Synthesis 155

13.4 Particle Models 155

14. Exciting and Controlling Sound Models 169

14.1 Plucking and Striking 169

14.2 Friction 174

14.3 Controlling Synthesis Parameters 183

14.4 Controllers 187

15. Walking Synthesis: A Complete System 191

15.1 Overall Architecture of the System 191

15.2 Event Analysis 192

15.3 Spectral Analysis 194

15.4 Statistical Modeling and Estimation 194

15.5 Testing on Real Sounds 197

15.6 Parametric Resynthesis 199

16. Examples, Systems, and Applications 201

16.1 Auditory Display: Real-Time Multimodal User Interfaces 201

16.2 Auditory Display: Sonification 202

16.3 Digital Foley Production Workstation/Stage 205

16.4 Virtual and Augmented Reality 206

16.5 Computer Music and Interactive Art 206

16.6 Animation and Gaming 207

16.7 The Future 209

A. DFT, Convolution, and Transform Properties 211

A.1 Orthogonality of the Fourier Transform Kernel 211

A.2 Uniqueness of the Fourier Transform 212

A.3 Convolution 213

A.4 Convolution and the DFT 214

A.5 A Few Useful DFT Properties and Theorems 216

B. The Ideal String 221

B.1 The Ideal String 221

C. Acoustic Tubes 225

C.1 The Ideal Acoustic Tube 225

C.2 D'Alembert Solution to the Acoustic Tube Equation 227

C.3 Relating Pressure and Velocity in Acoustic Tubes 227

C.4 The Acoustic Tube With Varying Cross-Sectional Area 228

C.5 An Acoustic Tube Network 230

D. Sound Examples and Code on CD/CDROM 233

D.1 Sound Examples 233

D.2 Source Code and Other Materials on CDROM Data Segment 236

E. The Synthesis Toolkit in C++ 239

E.1 What is the Synthesis Toolkit? 239

E.2 A Brief History of the Development of The Synthesis ToolKit 241

E.3 Synthesizing Sound in Real Time 241

E.4 Non-Real-Time Soundfile Synthesis 243

E.5 An Example Instrument: Blown Bottle 244

E.6 Real-Time Synthesis Control 245

E.7 Classes and Instruments 246.

Notes:

Accompanying CD-ROM contains sound examples, programs in C and C++, movie files, and miscellaneous files.

Includes bibliographical references and index.

ISBN:

1568811683

OCLC:

49493459