Improvising through the senses: a performance approach with the indirect use of technology

Tychonas Michailidis, James Dooley, Niccolo Granieri, Balandino Di Donato

Research output: Contribution to journalArticle

Abstract

This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer’s arm movements and mapped them onto a bespoke device that stimulates the pianist’s tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points.
Original languageEnglish
Pages (from-to)149-164
Number of pages16
JournalDigital Creativity
Volume29
Issue number2/3
DOIs
Publication statusPublished - 3 Jul 2018
EventInnovation In Music - University of Westminster, London, United Kingdom
Duration: 6 Sep 20178 Sep 2017
http://www.musicinnovation.co.uk

Fingerprint

Feedback
Pianists
Communication
Sensors
Dancers
Interaction
Feedback Loop
User Experience
Sensor
Haptics
Performer
Sensory Experience
Pathway

Cite this

Michailidis, Tychonas ; Dooley, James ; Granieri, Niccolo ; Di Donato, Balandino. / Improvising through the senses: a performance approach with the indirect use of technology. In: Digital Creativity. 2018 ; Vol. 29, No. 2/3. pp. 149-164.
@article{494712f5669d4479a2c1d7e36f7d48f9,
title = "Improvising through the senses: a performance approach with the indirect use of technology",
abstract = "This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer’s arm movements and mapped them onto a bespoke device that stimulates the pianist’s tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points.",
author = "Tychonas Michailidis and James Dooley and Niccolo Granieri and {Di Donato}, Balandino",
year = "2018",
month = "7",
day = "3",
doi = "10.1080/14626268.2018.1511600",
language = "English",
volume = "29",
pages = "149--164",
journal = "Digital Creativity",
issn = "1462-6268",
publisher = "Taylor & Francis",
number = "2/3",

}

Improvising through the senses: a performance approach with the indirect use of technology. / Michailidis, Tychonas; Dooley, James; Granieri, Niccolo; Di Donato, Balandino.

In: Digital Creativity, Vol. 29, No. 2/3, 03.07.2018, p. 149-164.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Improvising through the senses: a performance approach with the indirect use of technology

AU - Michailidis, Tychonas

AU - Dooley, James

AU - Granieri, Niccolo

AU - Di Donato, Balandino

PY - 2018/7/3

Y1 - 2018/7/3

N2 - This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer’s arm movements and mapped them onto a bespoke device that stimulates the pianist’s tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points.

AB - This article explores and proposes new ways of performing in a technology-mediated environment. We present a case study that examines feedback loop relationships between a dancer and a pianist. Rather than using data from sensor technologies to directly control and affect musical parameters, we captured data from a dancer’s arm movements and mapped them onto a bespoke device that stimulates the pianist’s tactile sense through vibrations. The pianist identifies and interprets the tactile sensory experience, with his improvised performance responding to the changes in haptic information received. Our system presents a new way of technology-mediated performer interaction through tactile feedback channels, enabling the user to establish new creative pathways. We present a classification of vibrotactile interaction as means of communication, and we conclude how users experience multi-point vibrotactile feedback as one holistic experience rather than a collection of discrete feedback points.

UR - http://www.mendeley.com/research/improvising-through-senses-performance-approach-indirect-technology

U2 - 10.1080/14626268.2018.1511600

DO - 10.1080/14626268.2018.1511600

M3 - Article

VL - 29

SP - 149

EP - 164

JO - Digital Creativity

JF - Digital Creativity

SN - 1462-6268

IS - 2/3

ER -