Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation

Tatsuya Ogusu, Jun Ohya, Jun Kurumisawa, Shunichi Yonemura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

Original languageEnglish
Title of host publicationCommunications in Computer and Information Science
PublisherSpringer Verlag
Pages213-217
Number of pages5
Volume434 PART I
ISBN (Print)9783319078564
DOIs
Publication statusPublished - 2014

Publication series

NameCommunications in Computer and Information Science
Volume434 PART I
ISSN (Print)18650929

Fingerprint

Audition
Painting
Acoustic waves
Time series
Color
Experiments

Keywords

  • Abstract Painting
  • Gaze Behavior
  • Inspiration
  • Music

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Ogusu, T., Ohya, J., Kurumisawa, J., & Yonemura, S. (2014). Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. In Communications in Computer and Information Science (Vol. 434 PART I, pp. 213-217). (Communications in Computer and Information Science; Vol. 434 PART I). Springer Verlag. https://doi.org/10.1007/978-3-319-07857-1_38

Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. / Ogusu, Tatsuya; Ohya, Jun; Kurumisawa, Jun; Yonemura, Shunichi.

Communications in Computer and Information Science. Vol. 434 PART I Springer Verlag, 2014. p. 213-217 (Communications in Computer and Information Science; Vol. 434 PART I).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ogusu, T, Ohya, J, Kurumisawa, J & Yonemura, S 2014, Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. in Communications in Computer and Information Science. vol. 434 PART I, Communications in Computer and Information Science, vol. 434 PART I, Springer Verlag, pp. 213-217. https://doi.org/10.1007/978-3-319-07857-1_38
Ogusu T, Ohya J, Kurumisawa J, Yonemura S. Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. In Communications in Computer and Information Science. Vol. 434 PART I. Springer Verlag. 2014. p. 213-217. (Communications in Computer and Information Science). https://doi.org/10.1007/978-3-319-07857-1_38
Ogusu, Tatsuya ; Ohya, Jun ; Kurumisawa, Jun ; Yonemura, Shunichi. / Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. Communications in Computer and Information Science. Vol. 434 PART I Springer Verlag, 2014. pp. 213-217 (Communications in Computer and Information Science).
@inproceedings{4e9ae2860c6644459f53300582379f97,
title = "Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation",
abstract = "This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that {"}hearing gaze based music{"} could stimulate the viewers' inspiration and imagination best, {"}hearing pre-selected music{"} second best, and {"}without music{"} third best.",
keywords = "Abstract Painting, Gaze Behavior, Inspiration, Music",
author = "Tatsuya Ogusu and Jun Ohya and Jun Kurumisawa and Shunichi Yonemura",
year = "2014",
doi = "10.1007/978-3-319-07857-1_38",
language = "English",
isbn = "9783319078564",
volume = "434 PART I",
series = "Communications in Computer and Information Science",
publisher = "Springer Verlag",
pages = "213--217",
booktitle = "Communications in Computer and Information Science",

}

TY - GEN

T1 - Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation

AU - Ogusu, Tatsuya

AU - Ohya, Jun

AU - Kurumisawa, Jun

AU - Yonemura, Shunichi

PY - 2014

Y1 - 2014

N2 - This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

AB - This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

KW - Abstract Painting

KW - Gaze Behavior

KW - Inspiration

KW - Music

UR - http://www.scopus.com/inward/record.url?scp=84903516517&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84903516517&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-07857-1_38

DO - 10.1007/978-3-319-07857-1_38

M3 - Conference contribution

AN - SCOPUS:84903516517

SN - 9783319078564

VL - 434 PART I

T3 - Communications in Computer and Information Science

SP - 213

EP - 217

BT - Communications in Computer and Information Science

PB - Springer Verlag

ER -