Course Description

Sound is the essential part of ever-increasing multimedia content. This course introduces theories and applications to handle sound on computers. The theories include the fundamentals of acoustics, digital audio, filters, Fourier analysis, sound synthesis and digital audio effects. The applications cover music synthesizers, music production, game sound, sound arts and other topics. Through practices using audio software and programming, students will also learn basic skills and recipes to create sound applications and contents.

Textbooks

• Mathematics of the Discrete Fourier Transform (DFT), Julius O. Smith III
• Introduction to Digital Filters (with audio applications), Julius O. Smith III
• The Theory and Technique of Electronic Music, Miller Puckette
• DAFx: Digital Audio Effects (2nd Eds.), Udo Zolzer
• Designing Sound, Andy Farnell

KLMS / Classum             GitHub (Code)             Resources

Schedule

Week	Topics
1	Course Introduction [pdf] Fundamentals of Acoustics: Tone Generation [pdf]
2	Fundamentals of Acoustics: Human Hearning [pdf]
3	Digital audio [pdf] [Practice] 01. Digital Audio.ipynb Fourier Analysis (Part 1) [pdf] [Practice] 02. Fourier Analysis.ipynb Suggested Readings Complex Numbers Sinusoids and Exponentials Fourier Transforms for Continuous/Discrete Time/Frequency
4	Fourier Analysis (Part 2) [pdf] [Practice] 03. DFT and STFT.ipynb Suggested Readings Geometric Signal Theory Derivation of the Discrete Fourier Transform (DFT) Example Applications of the DFT [Homework #1] Sinusoid, Sampling, DFT and STFT (Due Mar 30, 11:59 PM)
5	Sound Synthesis (Part 1) [pdf] Sound Synthesis (Part 2) [pdf] [Practice] 04. Drum Machine.ipynb [Practice] 05. Sound Synthesis - Subtractive.ipynb [Practice] 06. Sound Synthesis - RM and FM.ipynb
6	Fundamentals of Digital Filters (Part 1) [pdf] [Demo] Convolution Demo Video Suggested Readings The Simplest Lowpass Filter Linear Time-Invariant Digital Filters Time Domain Digital Filter Representations [Homework #2] Convolution, FIR Filter, IIR Filter, and Wind Sound Design (Due Apr 15, 11:59 PM)
7	Fundamentals of Digital Filters (Part 2) [pdf] [Practice] 07. FIR Filter and Convolution.ipynb [Practice] 08. IIR Filters.ipynb [Demo] Filter Playgraound Suggested Readings Transfer Function Analysis Frequency Response Analysis Pole-Zero Analysis
8	Midterm Exam: Apr 20 (Wed), 14:30-16:00, N25 #3229 백남준홀(Paik Nam June Hall), openbook
9	Mid-term Poblem Solving Session Delay-based Audio Effects [pdf] [Practice] 09. Delay-based Audio Effects.ipynb Suggested readings DAFX Book: Chapter 2. Filters and Delays
10	Digital Filter, EQ and Dynamic Range Control [pdf] JUCE Tutorial [pdf] [Homework #3] Building a Simple FM Synthesizer (Due May 15, 11:59 PM) Suggested readings All About Audio Equalization: Solutions and Frontiers, Vesa Välimäki and Joshua D. Reiss, Applied Science, 2016
11	Digital Filter, EQ and Dynamic Range Control (Cont'd) Resampling, Pitch shifting and Time-Scale Modification [pdf] Suggested readings DAFX Book: Chapter 6. Time‐Segment Processing A Review of Time-Scale Modification of Music Signals, Jonathan Driedger and Meinard Müller, Applied Science, 2016
12	Spatial audio: HRTF, Reverbervation [pdf] No Class (May-18) Suggested Readings DAFX Book: Chapter 5. Spatial Effects
13	Student Meetings [Homework #4] Making a Delay Effect Using JUCE (Due Jun 6, 11:59 PM)
14	Final Project: Idea Presentation No Class (Jun-1): Local Election Day
15	No Class (Jun-6): National Holiday TBD
16	Final Project: Presentation