Emotion-sensitive voice-casting care robot in rehabilitation using real-time sensing and analysis of biometric information

Peeraya Sripian, Muhammad Nur Adilin Mohd Anuardi, Teppei Ito, Yoshito Tobe, Midori Sugaya

Research output: Contribution to journalArticlepeer-review


An important part of nursing care is the physiotherapist's physical exercise recovery training (for instance, walking), which is aimed at restoring athletic ability, known as rehabilitation (rehab). In rehab, the big problem is that it is difficult to maintain motivation. Therapies using robots have been proposed, such as animalistic robots that have positive psychological, physiological, and social effects on the patient. These also have an important effect in reducing the on-site human workload. However, the problem with these robots is that they do not actually understand what emotions the user is currently feeling. Some studies have been successful in estimating a person's emotions. As for non-cognitive approaches, there is an emotional estimation of non-verbal information. In this study, we focus on the characteristics of real-time sensing of emotion through heart rates - unconsciously evaluating what a person experiences - and applying it to select the appropriate turn of phrase by a voice-casting robot. We developed a robot to achieve this purpose. As a result, we were able to confirm the effectiveness of a real-time emotion-sensitive voice-casting robot that performs supportive actions significantly different from non-voice casting robots.

Original languageEnglish
Pages (from-to)413-431
Number of pages19
JournalJournal of Ambient Intelligence and Smart Environments
Issue number6
Publication statusPublished - 2021


  • Biometric information
  • Emotion analysis
  • Emotion estimation
  • Rehabilitation
  • Voice casting robot

ASJC Scopus subject areas

  • Software


Dive into the research topics of 'Emotion-sensitive voice-casting care robot in rehabilitation using real-time sensing and analysis of biometric information'. Together they form a unique fingerprint.

Cite this