TYTH-typing on your teeth: Tongue-teeth localization for human-computer interface

Phuc Nguyen, Hoang Truong, Duy Pham, Nam Bui, Abhijit Suresh, Thang Dinh, Anh Nguyen, Matt Whitlock, Tam Vu

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

This paper explores a new wearable system, called TYTH, that enables a novel form of human computer interaction based on the relative location and interaction between the user’s tongue and teeth. TYTH allows its user to interact with a computing system by tapping on their teeth. This form of interaction is analogous to using a finger to type on a keypad except that the tongue substitutes for the finger and the teeth for the keyboard. We study the neurological and anatomical structures of the tongue to design TYTH so that the obtrusiveness and social awkwardness caused by the wearable is minimized while maximizing its accuracy and sensing sensitivity. From behind the user’s ears, TYTH senses the brain signals and muscle signals that control tongue movement sent from the brain and captures the miniature skin surface deformation caused by tongue movement. We model the relationship between tongue movement and the signals recorded, from which a tongue localization technique and tongue-teeth tapping detection technique are derived. Through a prototyping implementation and an evaluation with 15 subjects, we show that TYTH can be used as a form of hands-free human computer interaction with 88.61% detection rate and promising adoption rate by users.

Original languageEnglish
Title of host publicationMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages269-282
Number of pages14
ISBN (Electronic)9781450357203
DOIs
StatePublished - Jun 10 2018
Event16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018 - Munich, Germany
Duration: Jun 10 2018Jun 15 2018

Publication series

NameMobiSys 2018 - Proceedings of the 16th ACM International Conference on Mobile Systems, Applications, and Services

Conference

Conference16th ACM International Conference on Mobile Systems, Applications, and Services,MobiSys 2018
Country/TerritoryGermany
CityMunich
Period06/10/1806/15/18

Keywords

  • Brain-muscles sensing
  • Human Computer Interaction (HCI)
  • Skin deformation sensing
  • Tongue-teeth typing
  • Wearable devices

Fingerprint

Dive into the research topics of 'TYTH-typing on your teeth: Tongue-teeth localization for human-computer interface'. Together they form a unique fingerprint.

Cite this