Audio Processing by People and Machines
MAS.241 / MAS.641J / 21M.566J

Final Time this Subject will be Offered

Fall 2009

 

Instructor:
Time:
Location:
Prereq:
Units:

 

Prof. Barry Vercoe
Thu. 1:00-3:00pm
E15-443 (Orange & Green room) & E15-484 (studio)
Permission of instructor
3-0-6 U-LEVEL / H-LEVEL credits

Description:

Information processing by the human auditory system, from detection of frequency, intensity, and spectrum, to the development of their perceptual correlates as pitch, loudness and timbre. Machine models of the human auditory and musical experience using perceptually based sensor and interpretive constructs, sufficient to enable machines to experience sound and music in a manner similar to our own. Scripted control of these models using a Python API connected to virtual sound servers and audio processors. Interactive models of voice and instruments in realtime musical performance using networked platforms of PC, Mac, and OLPC Linux machines. Personal expression via bit-wise creativity.

Requirements:

There will be 2 quizzes (10% each) during the course. Class participants will also be asked to complete 2 self-determined projects during the term. At least some of the work should be done in the studio. Students will be expected to develop interactive applications such as musical games, distributed compositions, etc. The mid-term project will be private, each person meeting with Prof. Barry Vercoe for 30 mins per project (worth 30%). The final project (50%) will be public, and will be presented in class during the last week of term.

Schedule:

Each class is divided into three 40-minute segments concerning Neurons, Bits, and Expressive Control.
 
Date 1st Part 2nd Part 3rd Part
10 Sep. Introduction to Human Listening Introduction to Digital Music Processing Introduction to Python Networks
17 Sep. Sound and the Human Ear Representing Sound in Computers Symbolic Audio Processing
24 Sep. Encoding in the Auditory Nerve Feed-forward Filters;  Networks External Control Signals
1 Oct. Critical Band Filtering Feeback Filters; Subtractive Synthesis Python Canons and Score Hacks
8 Oct. FIRST QUIZ
Frequency and Pitch		  
Pitch Detectors and Harmonizers		  
MIDI Files and Sequencers
15 Oct. Complex Tones and Timbre FM Synthesis and Waveshaping MIDI Controllers
22 Oct. MID-TERM PROJECTS DUE
Speech Perception

  
LPC Synthesis, Phase Vocoder		  
Speech REMIX
29 Oct. Notes, Intervals, Scales, Tuning Expression and Tempo Python Music Painter
5 Nov. Sound Space and Source Localization Reverberators, Chorusers, Flangers Parametric Controllers
12 Nov. SECOND QUIZ
How People survive On-stage		  
How Machines survive On-stage

  
Multi-processor Performances
19 Nov. Perception of Rhythm Patterns Rhythm Detectors and Followers Remote Rhythmic Collaboration
26 Nov. (Thanksgiving Vacation)
1, 3, 8 Dec. FINAL PROJECTS:  Preparation and Problem-solving Tutorials
10 Dec. FINAL PROJECT PRESENTATIONS


Textbooks:


The Csound Book. (R. Boulanger.) Required. Available at the MIT Press bookstore.

Music, Cognition and Computerized Sound. (P. Cook.) Required. Available at the MIT Press bookstore.

Learning Python, 2nd Ed. (Lutz and Ascher,) or equivalent text. Required.

Perception and Cognition of Music. (I. Deliege and J. Sloboda.) Optional.

Listening: An Introduction to the Psychology of Hearing. (S. Handel.) Optional.

An Introduction to the Psychology of Hearing. (B.C.J. Moore.) Optional.

This is Your Brain on Music. (D. Levitin.) Optional.