Skip to main navigation Skip to search Skip to main content

Jawthenticate: Microphone-free Speech-based Authentication using Jaw Motion and Facial Vibrations

  • Stony Brook University
  • University of California Merced
  • University of Massachusetts

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

15 Scopus citations

Abstract

In this paper, we present Jawthenticate, an earable system that authenticates a user using audible or inaudible speech without using a microphone. This system can overcome the shortcomings of traditional voice-based authentication systems like unreliability in noisy conditions and spoofing using microphone-based replay attacks. Jawthenticate derives distinctive speech-related features from the jaw motion and associated facial vibrations. This combination of features makes Jawthenticate resilient to vocal imitations as well as camera-based spoofing. We use these features to train a two-class SVM classifier for each user. Our system is invariant to the content and language of speech. In a study conducted with 41 subjects, who speak different native languages, Jawthenticate achieves a Balanced Accuracy (BAC) of 97.07%, True Positive Rate (TPR) of 97.75%, and True Negative Rate (TNR) of 96.4% with just 3 seconds of speech data.

Original languageEnglish
Title of host publicationSenSys 2023 - Proceedings of the 21st ACM Conference on Embedded Networked Sensors Systems
PublisherAssociation for Computing Machinery, Inc
Pages209-222
Number of pages14
ISBN (Electronic)9798400704147
DOIs
StatePublished - Apr 26 2024
Event21st ACM Conference on Embedded Networked Sensors Systems, SenSys 2023 - Istanbul, Turkey
Duration: Nov 13 2023Nov 15 2023

Publication series

NameSenSys 2023 - Proceedings of the 21st ACM Conference on Embedded Networked Sensors Systems

Conference

Conference21st ACM Conference on Embedded Networked Sensors Systems, SenSys 2023
Country/TerritoryTurkey
CityIstanbul
Period11/13/2311/15/23

Keywords

  • IMU sensing
  • biometrics
  • signal processing
  • speech authentication

Fingerprint

Dive into the research topics of 'Jawthenticate: Microphone-free Speech-based Authentication using Jaw Motion and Facial Vibrations'. Together they form a unique fingerprint.

Cite this