@jpmor

Natural Interaction with 3D Content on Mobile AR Systems Using Gesture Recognition

, , and . Augmented Reality, Virtual Reality, and Computer Graphics, volume 9769 of Lecture Notes in Computer Science, page 348-357. Cham, Springer, (2016)
DOI: 10.1007/978-3-319-40651-0_28

Abstract

We present a mobile AR interaction system where the user can naturally interact with and manipulate 3D content by recognizing discrete in-air gestures and temporal poses of a hand in front of the camera. Our system consists of established image processing, pose estimation and AR rendering steps, and a novel fingertip detection algorithm that can run real-time on off-the-shelf mobile devices with the use of an external depth camera. We also present an application prototype implemented on a tablet with a mounted IR structured-lighting depth camera.

Description

Natural Interaction with 3D Content on Mobile AR Systems Using Gesture Recognition | SpringerLink

Links and resources

Tags

community

  • @jpmor
  • @dblp
@jpmor's tags highlighted