TY - GEN
T1 - JawSense
T2 - 22nd International Workshop on Mobile Computing Systems and Applications, HotMobile 2021
AU - Khanna, Prerna
AU - Srivastava, Tanmay
AU - Pan, Shijia
AU - Jain, Shubham
AU - Nguyen, Phuc
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/2/24
Y1 - 2021/2/24
N2 - This paper explores a new wearable system, called JawSense, that enables a novel form of human-computer interaction based on unvoiced jaw movement tracking. JawSense allows its user to interact with computing machine just by moving their jaw. We study the neurological and anatomical structure of the human cheek and jaw to design JawSense so that jaw movement can be reliably captured under the strong impact of noises from human artifacts. In particular, JawSense senses the muscle deformation and vibration caused by unvoiced speaking to decode the unvoiced phonemes spoken by the user. We model the relationship between jaw movements and phonemes to develop a classification algorithm to recognize nine phonemes. Through a prototyping implementation and evaluation with six subjects, we show that JawSense can be used as a form of hands-free and privacy-preserving human-computer interaction with 92% phoneme classification rate.
AB - This paper explores a new wearable system, called JawSense, that enables a novel form of human-computer interaction based on unvoiced jaw movement tracking. JawSense allows its user to interact with computing machine just by moving their jaw. We study the neurological and anatomical structure of the human cheek and jaw to design JawSense so that jaw movement can be reliably captured under the strong impact of noises from human artifacts. In particular, JawSense senses the muscle deformation and vibration caused by unvoiced speaking to decode the unvoiced phonemes spoken by the user. We model the relationship between jaw movements and phonemes to develop a classification algorithm to recognize nine phonemes. Through a prototyping implementation and evaluation with six subjects, we show that JawSense can be used as a form of hands-free and privacy-preserving human-computer interaction with 92% phoneme classification rate.
KW - Accelerometer sensing
KW - Unvoiced sound recognition
KW - Wearable devices
UR - https://www.scopus.com/pages/publications/85102074575
U2 - 10.1145/3446382.3448363
DO - 10.1145/3446382.3448363
M3 - Conference contribution
AN - SCOPUS:85102074575
T3 - HotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications
SP - 44
EP - 49
BT - HotMobile 2021 - Proceedings of the 22nd International Workshop on Mobile Computing Systems and Applications
PB - Association for Computing Machinery, Inc
Y2 - 24 February 2021 through 26 February 2021
ER -