EMG signal processing for audio-emg-based multi-modal speech recognition

Zhipeng Zhang; Hiroyuki Manabe; Tsutomu Horikoshi; Tomoyuki Ohya

EMG signal processing for audio-emg-based multi-modal speech recognition

Zhipeng Zhang, Hiroyuki Manabe, Tsutomu Horikoshi, Tomoyuki Ohya

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

This paper proposes robust methods for processing EMG (electromyography) signals in the framework of audio-EMG-based speech recognition. The EMG signals are captured when uttered and used as auxiliary information for recognizing speech. Two robust methods (Cepstral Mean Normalization and Spectral Subtraction) for EMG signal processing are investigated to improve the recognition performance. We also investigate the importance of stream weighting in audio-EMG-based multi-modal speech recognition. Experiments are carried out at various noise conditions and the results show the effectiveness of the proposed methods. A significant improvement in word accuracy over the audio-only recognition scheme is achieved by combining the methods.

Original language	English
Title of host publication	Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005
Editors	M.H. Hamza
Pages	430-433
Number of pages	4
Publication status	Published - 2005
Externally published	Yes
Event	3rd IASTED International Conference on Medical Engineering 2005 - Innsbruck, Austria Duration: 2005 Feb 16 → 2005 Feb 18

Publication series

Name	Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005

Conference

Conference	3rd IASTED International Conference on Medical Engineering 2005
Country/Territory	Austria
City	Innsbruck
Period	05/2/16 → 05/2/18

Keywords

Cepstral Mean Subtraction
EMG
Multimodal speech recognition
Spectral Subtraction

ASJC Scopus subject areas

Engineering(all)

Cite this

EMG signal processing for audio-emg-based multi-modal speech recognition. / Zhang, Zhipeng; Manabe, Hiroyuki; Horikoshi, Tsutomu et al.
Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005. ed. / M.H. Hamza. 2005. p. 430-433 (Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Zhang, Z, Manabe, H, Horikoshi, T & Ohya, T 2005, EMG signal processing for audio-emg-based multi-modal speech recognition. in MH Hamza (ed.), Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005. Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005, pp. 430-433, 3rd IASTED International Conference on Medical Engineering 2005, Innsbruck, Austria, 05/2/16.

@inproceedings{9b4afa8c709a4066bdaa762583b9e6e9,

title = "EMG signal processing for audio-emg-based multi-modal speech recognition",

abstract = "This paper proposes robust methods for processing EMG (electromyography) signals in the framework of audio-EMG-based speech recognition. The EMG signals are captured when uttered and used as auxiliary information for recognizing speech. Two robust methods (Cepstral Mean Normalization and Spectral Subtraction) for EMG signal processing are investigated to improve the recognition performance. We also investigate the importance of stream weighting in audio-EMG-based multi-modal speech recognition. Experiments are carried out at various noise conditions and the results show the effectiveness of the proposed methods. A significant improvement in word accuracy over the audio-only recognition scheme is achieved by combining the methods.",

keywords = "Cepstral Mean Subtraction, EMG, Multimodal speech recognition, Spectral Subtraction",

author = "Zhipeng Zhang and Hiroyuki Manabe and Tsutomu Horikoshi and Tomoyuki Ohya",

year = "2005",

language = "English",

isbn = "0889864780",

series = "Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005",

pages = "430--433",

editor = "M.H. Hamza",

booktitle = "Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005",

note = "3rd IASTED International Conference on Medical Engineering 2005 ; Conference date: 16-02-2005 Through 18-02-2005",

}

TY - GEN

T1 - EMG signal processing for audio-emg-based multi-modal speech recognition

AU - Zhang, Zhipeng

AU - Manabe, Hiroyuki

AU - Horikoshi, Tsutomu

AU - Ohya, Tomoyuki

PY - 2005

Y1 - 2005

N2 - This paper proposes robust methods for processing EMG (electromyography) signals in the framework of audio-EMG-based speech recognition. The EMG signals are captured when uttered and used as auxiliary information for recognizing speech. Two robust methods (Cepstral Mean Normalization and Spectral Subtraction) for EMG signal processing are investigated to improve the recognition performance. We also investigate the importance of stream weighting in audio-EMG-based multi-modal speech recognition. Experiments are carried out at various noise conditions and the results show the effectiveness of the proposed methods. A significant improvement in word accuracy over the audio-only recognition scheme is achieved by combining the methods.

AB - This paper proposes robust methods for processing EMG (electromyography) signals in the framework of audio-EMG-based speech recognition. The EMG signals are captured when uttered and used as auxiliary information for recognizing speech. Two robust methods (Cepstral Mean Normalization and Spectral Subtraction) for EMG signal processing are investigated to improve the recognition performance. We also investigate the importance of stream weighting in audio-EMG-based multi-modal speech recognition. Experiments are carried out at various noise conditions and the results show the effectiveness of the proposed methods. A significant improvement in word accuracy over the audio-only recognition scheme is achieved by combining the methods.

KW - Cepstral Mean Subtraction

KW - EMG

KW - Multimodal speech recognition

KW - Spectral Subtraction

UR - http://www.scopus.com/inward/record.url?scp=27844589598&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=27844589598&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:27844589598

SN - 0889864780

T3 - Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005

SP - 430

EP - 433

BT - Proceedings of the 3rd IASTED International Conference on Biomedical Engineering 2005

A2 - Hamza, M.H.

T2 - 3rd IASTED International Conference on Medical Engineering 2005

Y2 - 16 February 2005 through 18 February 2005

ER -

EMG signal processing for audio-emg-based multi-modal speech recognition

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this