source:http://kspc.org/biweekly-picks-from-the-music-department-the-premiere-episode/

Course Description

This is an introductory course on music technology focusing on computational aspects. The first part of the course covers fundamentals of digital audio, digital filters, analysis and synthesis of musical tones along with web audio examples. The second part focuses on practical use cases in musical activities such as composition, production, performance and listening.

General Information

Instructor: Juhan Nam ( juhannam at kaist.ac.kr )
TA: Soonbeom Choi ( cjb3549 at kaist.ac.kr )
Lecture: Tuesday, Thursday 1:00-2:30 PM
Room: N25, #3239 Laughlin Hall

Grading Policy

Assignments: 40%
Midterm (paper exam): 20%
Final Project (presentation/submission): 40%

Textbook

Music and Computer: a theoretical and historical approach [online book]

* Last year's course webpage is found at this link.

Schedule

Week Date Topics Textbook and References
1 Sep 1 Course Introduction [slides]
2 Sep 6 Fundamentals of Sound and Digital Audio [slides]
  • What's Sound?
  • Loudess, Pitch and Timbre
  • Sampling and Quantization
MC: Chapter 1 and 2
Sep 8 Web Audio Session 0
  • Introduction to HTML, CSS and Javascript
3 Sep 13 / 15 Holiday
4 Sep 20 Spectral Analysis [slides]
  • Discrete Fourier Transform (DFT)
  • Short-Time Fourier Transform (STFT)
MC: Chapter 3
Supplementary: the JOS DFT book
Sep 22 Web Audio Session 1 [code]
  • More about HTML and Javascript
  • Hello Sine
  • Hello Synth
  • Loading and Playing Audio Files
5 Sep 27 Spectral Analysis (Cont'd)
  • Discrete Fourier Transform (DFT)
  • Short-Time Fourier Transform (STFT)
Sep 29 Web Audio Session 2 [code]
  • Waveform and Spectrum Visualization
  • Monitoring Microphone Input
Web Audio Analyser
Visualizations with Web Audio API
Canvas tutorial
Due Oct 9 Homework #1: Beatbox [link]
6 Oct 4 Audio Signal Processing (part 1) [slides]
  • Linear Time-Invariant Digital Filters
  • Impulse Response
  • Convolution
  • FIR Filter
MC: Chapter 5
JOS Book: LTI Digital Filters
JOS Book: Time-Domain Digital Filters

*** Demo Video: Convolution ***
Oct 6 Web Audio Session 2 (Cont'd) [code]
  • Feature Extraction: Loudness, Pitch Detection and Spectral Centroid
  • Visualization
7 Oct 11 Audio Signal Processing (part 1) (Cont'd)
  • IIR FIlter
  • Reson and Comb Filters
  • Z-transform
Oct 13 Audio Signal Processing (part 2) [slides]
  • Filter/EQ
  • Compressor
  • Delay-based Effects
 iZotope: Pro Audio Essentials
Due Oct 30 Homework #2: Music Visualizer [link]
8 Oct 18 Audio Signal Processing (part 2) (Cont'd)
  • Head-Related Transfer Function (HRTF)
  • Reverberation
  • Resampling
Oct 20 Midterm
9 Oct 25 No Class
Oct 27 Midterm Review
Web Audio Session 3 [code]
  • Digital Audio Effect
LFO (AudioNode --> AudioParam)
10 Nov 1 / 3 Sound Synthesis [slides]
  • Additive Synthesis
  • Subtractive Synthesis
 MC: Chapter 4
11 Nov 8 Sound Synthesis (Cont'd)
  • FM Synthesis
  • Physical Modeling
  • Sample-based Synthesis
Nov 10 Web Audio Session 4 [code]
  • Simple Synth
  • Drum machine
  • FM synthesis
  • Web Audio Library: WAAX.js, Tone.js
Due Nov 24 Homework #3: Music Synthesizer [link]
12 Nov 15 Musical Interface [slides]
Nov 17 Web Audio Session 5
  • Web MIDI
13 Nov 22 Project Proposal Presentation
Nov 24 Break
14 Nov 29 / Dec 1 Music Information Retrieval
15 Dec 6 / 8 Project Discussion
16 Dec 13 / 15 No Class
Dec 20 Final Presentation

This year's selected final projects

Resources


Sound and Music Data Repositories

Audio DSP Online Books

Computer Music Books

HTML/CSS/Javascript Tutorials

Web Audio

Computer Music Media