Effects of facial expressions on impression evaluation for Japanese stuttering voices

Atsuko K. Yamazaki, Noriaki Miwa, Kazukiyo Inada, Muhammad Nur Adilin Bin Mohd Anuardi, Mashu Sanjo

研究成果: Conference article査読


Many studies have highlighted that speech disfluencies, such as stuttering, can negatively affect communication. In this study, the authors investigated listeners' impressions of Japanese words spoken with stuttering characteristicS. We investigated the manner in which different facial expressions can contribute to improving these impressionS. Recordings of male and female voices of short Japanese words were modified to have stuttering characteristics by using sound editing software. Then, the listeners' impressions of the modified voices were examined by using the Semantic differential method. The impression evaluation scores of the stuttering voices were compared with those of the original voices (without stuttering). In addition, the authors conducted an experiment to investigate whether the listeners' impressions of stuttering characteristics could be changed by facial expressionS. The results of this study showed that the listeners evaluated the stuttering voices much more negatively than the ones without stuttering characteristicS. However, they rated the same stuttering voices very positively when the voices were accompanied by videos of smiling facial expressionS. When presented with sullen facial expressions, the listeners returned negatively rating to the stuttering voiceS. These results suggest that the quality of communication can be highly improved when a speaker smiles, even if the speaker's speech is not fluent. The result can be useful not only for human-human communication but also for human-machine communication.

ジャーナルProcedia Computer Science
出版ステータスPublished - 2018
イベント22nd International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, KES 2018 - Belgrade, Serbia
継続期間: 2018 9月 32018 9月 5

ASJC Scopus subject areas

  • コンピュータ サイエンス(全般)


「Effects of facial expressions on impression evaluation for Japanese stuttering voices」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。