The multimodal music stand

Bo Bell; Jim Kleban; Dan Overholt; Lance Putnam; John Thompson; Joann Kuchera-Morin

doi:10.1145/1279740.1279750

The multimodal music stand

Bo Bell, Jim Kleban, Dan Overholt, Lance Putnam, John Thompson, Joann Kuchera-Morin

Fred & Dinah Gretsch School of Music

Research output: Contribution to conference › Paper › peer-review

11 Scopus citations

Abstract

We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.

Original language	English
Pages	62-65
Number of pages	4
DOIs	https://doi.org/10.1145/1279740.1279750
State	Published - 2007
Event	7th International Conference on New Interfaces for Musical Expression, NIME '07 - New York, NY, United States Duration: Jun 6 2007 → Jun 10 2007

Conference

Conference	7th International Conference on New Interfaces for Musical Expression, NIME '07
Country/Territory	United States
City	New York, NY
Period	06/6/07 → 06/10/07

Scopus Subject Areas

Artificial Intelligence
Computer Networks and Communications
Human-Computer Interaction
Hardware and Architecture
Signal Processing
Control and Systems Engineering
Instrumentation
Computer Science Applications
Music

Keywords

Computer vision
E-field sensing
Interactivity
Multimodal
Untethered control

Access to Document

10.1145/1279740.1279750

Cite this

@conference{a2e755c21ef84e8e9109de6a3f94c632,

title = "The multimodal music stand",

abstract = "We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.",

keywords = "Computer vision, E-field sensing, Interactivity, Multimodal, Untethered control",

author = "Bo Bell and Jim Kleban and Dan Overholt and Lance Putnam and John Thompson and Joann Kuchera-Morin",

year = "2007",

doi = "10.1145/1279740.1279750",

language = "English",

pages = "62--65",

note = "7th International Conference on New Interfaces for Musical Expression, NIME '07 ; Conference date: 06-06-2007 Through 10-06-2007",

}

TY - CONF

T1 - The multimodal music stand

AU - Bell, Bo

AU - Kleban, Jim

AU - Overholt, Dan

AU - Putnam, Lance

AU - Thompson, John

AU - Kuchera-Morin, Joann

PY - 2007

Y1 - 2007

N2 - We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.

AB - We present the Multimodal Music Stand (MMMS) for the untethered sensing of performance gestures and the interactive control of music. Using e-field sensing, audio analysis, and computer vision, the MMMS captures a performer's continuous expressive gestures and robustly identifies discrete cues in a musical performance. Continuous and discrete gestures are sent to an interactive music system featuring custom designed software that performs real-time spectral transformation of audio.

KW - Computer vision

KW - E-field sensing

KW - Interactivity

KW - Multimodal

KW - Untethered control

UR - https://www.scopus.com/pages/publications/73649088953

U2 - 10.1145/1279740.1279750

DO - 10.1145/1279740.1279750

M3 - Paper

AN - SCOPUS:73649088953

SP - 62

EP - 65

T2 - 7th International Conference on New Interfaces for Musical Expression, NIME '07

Y2 - 6 June 2007 through 10 June 2007

ER -

The multimodal music stand

Abstract

Conference

Scopus Subject Areas

Keywords

Access to Document

Other files and links

Fingerprint

Cite this