Wekinating 000000swan: Using machine learning to create and control complex artistic systems

Margaret Schedel; Phoenix Perry; Rebecca Fiebrink

Wekinating 000000swan: Using machine learning to create and control complex artistic systems

Margaret Schedel
, Phoenix Perry
, Rebecca Fiebrink

Music

Polytechnic University
Princeton University

Research output: Contribution to journal › Conference article › peer-review

9 Scopus citations

Abstract

In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome.

Original language	English
Pages (from-to)	453-456
Number of pages	4
Journal	Proceedings of the International Conference on New Interfaces for Musical Expression
State	Published - 2011
Event	International conference on New Interfaces for Musical Expression, NIME 2011 - Oslo, Norway Duration: May 30 2011 → Jun 1 2011

Keywords

Animation
Bow Articulation
Interactive
K-Bow
Kinect
Machine Learning
Motion-Tracking
Multimedia
Wekinator

Cite this

@article{925cf370d60c41cb813be67f214f510f,

title = "Wekinating 000000swan: Using machine learning to create and control complex artistic systems",

abstract = "In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome.",

keywords = "Animation, Bow Articulation, Interactive, K-Bow, Kinect, Machine Learning, Motion-Tracking, Multimedia, Wekinator",

author = "Margaret Schedel and Phoenix Perry and Rebecca Fiebrink",

note = "Publisher Copyright: {\textcopyright} 2020, Steering Committee of the International Conference on New Interfaces for Musical Expression.; International conference on New Interfaces for Musical Expression, NIME 2011 ; Conference date: 30-05-2011 Through 01-06-2011",

year = "2011",

language = "English",

pages = "453--456",

journal = "Proceedings of the International Conference on New Interfaces for Musical Expression",

issn = "2220-4792",

}

TY - JOUR

T1 - Wekinating 000000swan

T2 - International conference on New Interfaces for Musical Expression, NIME 2011

AU - Schedel, Margaret

AU - Perry, Phoenix

AU - Fiebrink, Rebecca

PY - 2011

Y1 - 2011

N2 - In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome.

AB - In this paper we discuss how the band 000000Swan uses machine learning to parse complex sensor data and create intricate artistic systems for live performance. Using the Wekinator software for interactive machine learning, we have created discrete and continuous models for controlling audio and visual environments using human gestures sensed by a commercially-available sensor bow and the Microsoft Kinect. In particular, we have employed machine learning to quickly and easily prototype complex relationships between performer gesture and performative outcome.

KW - Animation

KW - Bow Articulation

KW - Interactive

KW - K-Bow

KW - Kinect

KW - Machine Learning

KW - Motion-Tracking

KW - Multimedia

KW - Wekinator

UR - https://www.scopus.com/pages/publications/84907415405

M3 - Conference article

AN - SCOPUS:84907415405

SN - 2220-4792

SP - 453

EP - 456

JO - Proceedings of the International Conference on New Interfaces for Musical Expression

JF - Proceedings of the International Conference on New Interfaces for Musical Expression

Y2 - 30 May 2011 through 1 June 2011

ER -

Wekinating 000000swan: Using machine learning to create and control complex artistic systems

Abstract

Keywords

Other files and links

Fingerprint

Cite this