Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation

Tatsuya Ogusu, Jun Ohya, Jun Kurumisawa, Shunichi Yonemura

Research output: Chapter in Book/Report/Conference proceedingConference contribution


This paper explores the effectiveness of prompting abstract paintings' viewers' inspiration and imagination by the authors' gaze based music generation system. The authors' music generation system detects the viewer's gaze by a gaze detection equipment. At each of the gaze staying positions in the painting, the color of that point is converted to the sound so that as the gaze moves, music that consists of the converted time series sounds is generated. Experiments using six subjects and six abstract paintings were conducted for the three cases in which the subjects see the abstract paintings without hearing any music, while hearing pre-selected music and while hearing the viewers' gaze based music generated by the authors' system. The experimental results imply that "hearing gaze based music" could stimulate the viewers' inspiration and imagination best, "hearing pre-selected music" second best, and "without music" third best.

Original languageEnglish
Title of host publicationCommunications in Computer and Information Science
PublisherSpringer Verlag
Number of pages5
Volume434 PART I
ISBN (Print)9783319078564
Publication statusPublished - 2014

Publication series

NameCommunications in Computer and Information Science
Volume434 PART I
ISSN (Print)18650929



  • Abstract Painting
  • Gaze Behavior
  • Inspiration
  • Music

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Ogusu, T., Ohya, J., Kurumisawa, J., & Yonemura, S. (2014). Inspiring Viewers of Abstract Painting by a Gaze Based Music Generation. In Communications in Computer and Information Science (Vol. 434 PART I, pp. 213-217). (Communications in Computer and Information Science; Vol. 434 PART I). Springer Verlag.