TY - GEN
T1 - Poster
T2 - 24th Annual International Conference on Mobile Computing and Networking, MobiCom 2018
AU - Zhou, Bing
AU - Guven, Sinem
AU - Tao, Shu
AU - Ye, Fan
N1 - Publisher Copyright:
© 2018 Association for Computing Machinery.
PY - 2018/10/15
Y1 - 2018/10/15
N2 - While existing visual recognition approaches, which rely on 2D images to train their underlying models, work well for object classification, recognizing the changing state of a 3D object requires addressing several additional challenges. This paper proposes an active visual recognition approach to this problem, leveraging camera pose data available on mobile devices. With this approach, the state of a 3D object, which captures its appearance changes, can be recognized in real time. Our novel approach selects informative video frames filtered by 6-DOF camera poses to train a deep learning model to recognize object state.We validate our approach through a prototype for Augmented Reality-assisted hardware maintenance.
AB - While existing visual recognition approaches, which rely on 2D images to train their underlying models, work well for object classification, recognizing the changing state of a 3D object requires addressing several additional challenges. This paper proposes an active visual recognition approach to this problem, leveraging camera pose data available on mobile devices. With this approach, the state of a 3D object, which captures its appearance changes, can be recognized in real time. Our novel approach selects informative video frames filtered by 6-DOF camera poses to train a deep learning model to recognize object state.We validate our approach through a prototype for Augmented Reality-assisted hardware maintenance.
KW - active visual recognition
KW - augmented reality
KW - mobile devices
UR - https://www.scopus.com/pages/publications/85056836411
U2 - 10.1145/3241539.3267771
DO - 10.1145/3241539.3267771
M3 - Conference contribution
AN - SCOPUS:85056836411
T3 - Proceedings of the Annual International Conference on Mobile Computing and Networking, MOBICOM
SP - 756
EP - 758
BT - MobiCom 2018 - Proceedings of the 24th Annual International Conference on Mobile Computing and Networking
PB - Association for Computing Machinery
Y2 - 29 October 2018 through 2 November 2018
ER -