Selfie mask: A face-capturing hmd with polarizing plates

Wataru Yamada, Hiroyuki Hakoda, Hiroyuki Manabe, Daizo Ikeda, Jun Rekimoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)


Head-mounted displays (HMDs) that provide a virtual reality (VR) experience using a simple configuration have been become popular. However, HMDs still have a well-known problem in that they hide the user's face when worn making it difficult for their avatars in VR space to communicate with each other because the users cannot relay their facial expressions and gaze information to their avatars. In this paper, we propose a new HMD constructed using polarizing plates that can capture the user's face and expressions while wearing it. The proposed method enables the user's face to be captured by an internal camera while blocking the scenery from the user's view using orthogonal polarizing plates. The proposed method can be implemented at low cost and can directly capture a full-color image of the user's face unlike conventional methods using infrared cameras. We implemented a prototype and confirmed that the proposed HMD captures the user's face while showing VR images. This paper discusses the unique characteristics and possible applications of the proposed method.

Original languageEnglish
Title of host publicationCHI EA 2020 - Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450368193
Publication statusPublished - 2020 Apr 25
Externally publishedYes
Event2020 ACM CHI Conference on Human Factors in Computing Systems, CHI EA 2020 - Honolulu, United States
Duration: 2020 Apr 252020 Apr 30

Publication series

NameConference on Human Factors in Computing Systems - Proceedings


Conference2020 ACM CHI Conference on Human Factors in Computing Systems, CHI EA 2020
Country/TerritoryUnited States


  • Face-capturing
  • Head-mounted display
  • Virtual reality

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Graphics and Computer-Aided Design
  • Software


Dive into the research topics of 'Selfie mask: A face-capturing hmd with polarizing plates'. Together they form a unique fingerprint.

Cite this