Wei Chai
See all of Wei's recent research."Automated analysis of musical structure."
Research on automatic music segmentation, summarization and classification using a framework combining music cognition, machine learning and signal processing. It will inquire scientifically into the nature of human perception of music, and offer a practical solution to difficult problems of machine intelligence for automatic musical content analysis and pattern discovery.
This paper presents an algorithm that can automatically analyze the repetitive structure of musical signals. First, the algorithm detects the repetitions of each segment of fixed length in a piece using dynamic programming. Second, the algorithm summarizes this repetition information and infers the structure based on heuristic rules.
John Harrison
See all of John's current research.Sound Blocks, Sound Scratch
SoundBlocks and SoundScratch are two different environments in which children can manipulate digital sound.
SoundBlocks is a tangible programming language for describing dataflow with adaptive, context aware primitives and real-time sensing.
SoundScratch is a set of sound primitives that extend the media-rich capabilities of the children's programming language called Scratch.
Both environments have been created and developed as a way to explore how it might be possible to construct an environment in which youth design their own sounds. Children ages 10-15 years old have explored the environments and participated in user studies. Music educators have observed these studies, and their observations are summarized.
PyPortMIDI
PyPortMidi is a Python wrapper for PortMidi. PortMidi is a cross-platform C library for realtime MIDI control. Using PyPortMidi, you can send and receive MIDI data in realtime from Python.
Proximity Detecting Microphone
Worldwide, people fall into one of two categories: those who are experienced microphone users and those who are not. For experienced microphone users, a proximity detection system within a microphone could provide another dimensionality for expression. For inexperienced microphone users, a proximity detection system could make a microphone easier to use. To explore these ideas further, I added proximity detection to a microphone and added an amplification circuit whose gain was inversely proportional to the distance of the microphone from the user.
Chord Recognition (with Victor Adan)
How can a computer recognize chords in music?
Victor Adan
See all of Victor's current research.Music Structure Modeling
This project explores representation as it pertains to music. Specifically, we address the question of how to extract the "essence" of a piece of music and how to use it as a source for generating new music with similar qualities.
We approach the problem of modeling of high level musical structures from a dynamical systems and signal processing perspective, focusing on motion per se independently of particular musical systems or styles.
The point of departure is the construction of a state space that represents geometrically the motion characteristics of music. We address ways in which this space can be modeled deterministically, as well as ways in which it can be transformed to generate new musical structures.
Chord Recognition (with John Harrison)
How can a computer recognize chords in music?
Andrew McPherson
Judy Brown
See all of Judy's current research.
Matlab code to calculate a constant Q transform by the "brute force method" as described in:
Classification of Vocalizations of Killer Whales
A large number of whale sounds recorded from the Captive Killer Whale Population at Marineland of Antibes, France were classified into call types using acoustic input and visual examination of spectral patterns.
Brian Whitman
See all of Brian's current research."Learning the meaning of music"
Expression as complex and personal as music is not adequately represented by the signal alone. For every artist and song there is a significant culture of meaning connecting the perception to interpretation. This thesis aims to computationally model the meaning of music by taking advantage of community usage and description, using the self-selected and natural similarity clusters, opinions, and usage patterns as labels and ground truth to inform on-line and unsupervised 'music acquisition' systems. We present a framework for capturing community metadata from free-text sources, audio representations robust enough to handle event and meaning relationships yet general enough to work across domains of music, and a machine-learning framework for learning the relationship between music signals and reaction iteratively, at a large scale.
Automatic Record Reviews
We analyze a large testbed of music and a corpus of reviews for each work to uncover patterns and develop mechanisms for removing reviewer bias and extraneous non-musical discussion. By building upon work in grounding free text against audio signals we invent an “automatic record review” system that labels new music audio with maximal semantic value for future retrieval tasks. In effect, we grow an unbiased music editor trained from the consensus of the online reviews we have gathered.
Eigenradio
Eigenradio is the future music: a constantly live radio stream automatically synthesized by eigenanalysis of up to 100 radio stations at once.
Chiclet / The DSP Music Box and Concrete Music
All music is already algorithmic in that a process generated it and generates it. Interference from a laser to pits on a plastic disc is just small-scale microcode, the simplest Turing machine scanning in radial order. But what are the possibilities when we're freed from the static medium? Can we embed a process in song from composer to audience?