Skip to main navigation Skip to search Skip to main content

Demo: Lost and Found! Associating Target Persons in Camera Surveillance Footage with Smartphone Identifiers

  • Hansi Liu
  • , Abrar Alali
  • , Mohamed Ibrahim
  • , Hongyu Li
  • , Marco Gruteser
  • , Shubham Jain
  • , Kristin Dana
  • , Ashwin Ashok
  • , Bin Cheng
  • , Hongsheng Lu
  • Old Dominion University

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

We demonstrate an application of finding target persons on a surveillance video. Each visually detected participant is tagged with a smartphone ID and the target person with the query ID is highlighted. This work is motivated by the fact that establishing associations between subjects observed in camera images and messages transmitted from their wireless devices can enable fast and reliable tagging. This is particularly helpful when target pedestrians need to be found on public surveillance footage, without the reliance on facial recognition. The underlying system uses a multi-modal approach that leverages WiFi Fine Timing Measurements (FTM) and inertial sensor (IMU) data to associate each visually detected individual with a corresponding smartphone identifier. These smartphone measurements are combined strategically with RGB-D information from the camera, to learn affinity matrices using a multi-modal deep learning network.

Original languageEnglish
Title of host publicationMobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services
PublisherAssociation for Computing Machinery, Inc
Pages499-500
Number of pages2
ISBN (Electronic)9781450384438
DOIs
StatePublished - Jun 24 2021
Event19th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2021 - Virtual, Online, United States
Duration: Jun 24 2021Jul 2 2021

Publication series

NameMobiSys 2021 - Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services

Conference

Conference19th ACM International Conference on Mobile Systems, Applications, and Services, MobiSys 2021
Country/TerritoryUnited States
CityVirtual, Online
Period06/24/2107/2/21

Keywords

  • machine learning
  • multimodal learning
  • person identification
  • wifi FTM ranging

Fingerprint

Dive into the research topics of 'Demo: Lost and Found! Associating Target Persons in Camera Surveillance Footage with Smartphone Identifiers'. Together they form a unique fingerprint.

Cite this