Characteristics of moving sound images with various numbers of discrete coordinates pre-sented with a moving icon according to presen-tation time

Kenji Muto, Mika Kurabayashi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The aim of this study is to develop a simple personal computer-based sound reproduction system for audiovisual systems with high immersion. Conventional systems for providing high-presence sound have the disadvantage of requiring powerful computers. To simplify such systems, we propose a method for reducing the amount of processing required for moving sound images. In the proposed method, moving sound images are given as combinations of discrete coordinates. When visual and auditory stimuli are shown simultaneously, a ventriloquist effect occurs, causing moving sound images with discrete coordinates to be perceived as natural. Previous studies have clarified the conditions under which the ventriloquist effect occurs for a fixed sound image. However, the conditions under which this effect occurs for moving sound images remain unclear. We conducted an experiment comparing pairs of stimuli to evaluate synchronization of a moving sound and image. In the experiment, moving sound sources with different presentation times were compared to obtain an upper limit on the distance between discrete coordinates of moving sound images that are perceived as natural. We analyzed the relationship between synchroniza-tion score and presentation time by a paired comparison method, and found that the score de-pended on the presentation time of the sound image. This indicates that, for moving sound imag-es to be perceived as natural, the upper limit on the distance between discrete coordinates de-pends on presentation time.

Original languageEnglish
Title of host publication"Advances in Acoustics, Noise and Vibration - 2021" Proceedings of the 27th International Congress on Sound and Vibration, ICSV 2021
EditorsEleonora Carletti, Malcolm Crocker, Marek Pawelczyk, Jiri Tuma
PublisherSilesian University Press
ISBN (Electronic)9788378807995
Publication statusPublished - 2021
Event27th International Congress on Sound and Vibration, ICSV 2021 - Virtual, Online
Duration: 2021 Jul 112021 Jul 16

Publication series

Name"Advances in Acoustics, Noise and Vibration - 2021" Proceedings of the 27th International Congress on Sound and Vibration, ICSV 2021

Conference

Conference27th International Congress on Sound and Vibration, ICSV 2021
CityVirtual, Online
Period21/7/1121/7/16

Keywords

  • Audiovisual reproduction system
  • Moving sound image
  • Pair comparison method
  • Subjective evaluation
  • Ventriloquist effect

ASJC Scopus subject areas

  • Acoustics and Ultrasonics

Fingerprint

Dive into the research topics of 'Characteristics of moving sound images with various numbers of discrete coordinates pre-sented with a moving icon according to presen-tation time'. Together they form a unique fingerprint.

Cite this