Real-time animation and motion retargeting of virtual characters based on single RGB-D camera

Ning Kang; Junxuan Bai; Junjun Pan; Hong Qin

doi:10.1109/VR.2019.8797856

Real-time animation and motion retargeting of virtual characters based on single RGB-D camera

Ning Kang
, Junxuan Bai
, Junjun Pan
, Hong Qin

Computer Science

Beihang University

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

7 Scopus citations

Abstract

The rapid generation and flexible reuse of characters animation by commodity devices are of significant importance to rich digital content production in virtual reality. This paper aims to handle the challenges of current motion imitation for human body in several indoor scenes (e.g., fitness training). We develop a real-time system based on single Kinect device, which is able to capture stable human motions and retarget to virtual characters. A large variety of motions and characters are tested to validate the efficiency and effectiveness of our system.

Original language	English
Title of host publication	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1006-1007
Number of pages	2
ISBN (Electronic)	9781728113777
DOIs	https://doi.org/10.1109/VR.2019.8797856
State	Published - Mar 2019
Event	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Osaka, Japan Duration: Mar 23 2019 → Mar 27 2019

Publication series

Name	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

Conference

Conference	26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019
Country/Territory	Japan
City	Osaka
Period	03/23/19 → 03/27/19

Keywords

Adaptive filter
Character animation
Inverse kinematics
Motion capture
Retargeting
Rgb-d camera

Access to Document

10.1109/VR.2019.8797856

Cite this

Kang, N., Bai, J., Pan, J., & Qin, H. (2019). Real-time animation and motion retargeting of virtual characters based on single RGB-D camera. In 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings (pp. 1006-1007). Article 8797856 (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/VR.2019.8797856

Kang, Ning ; Bai, Junxuan ; Pan, Junjun et al. / Real-time animation and motion retargeting of virtual characters based on single RGB-D camera. 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. pp. 1006-1007 (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings).

@inproceedings{34c86bbbf2ac49a9ba7b6af9202977d1,

title = "Real-time animation and motion retargeting of virtual characters based on single RGB-D camera",

abstract = "The rapid generation and flexible reuse of characters animation by commodity devices are of significant importance to rich digital content production in virtual reality. This paper aims to handle the challenges of current motion imitation for human body in several indoor scenes (e.g., fitness training). We develop a real-time system based on single Kinect device, which is able to capture stable human motions and retarget to virtual characters. A large variety of motions and characters are tested to validate the efficiency and effectiveness of our system.",

keywords = "Adaptive filter, Character animation, Inverse kinematics, Motion capture, Retargeting, Rgb-d camera",

author = "Ning Kang and Junxuan Bai and Junjun Pan and Hong Qin",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 ; Conference date: 23-03-2019 Through 27-03-2019",

year = "2019",

month = mar,

doi = "10.1109/VR.2019.8797856",

language = "English",

series = "26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1006--1007",

booktitle = "26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings",

}

Kang, N, Bai, J, Pan, J & Qin, H 2019, Real-time animation and motion retargeting of virtual characters based on single RGB-D camera. in 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings., 8797856, 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings, Institute of Electrical and Electronics Engineers Inc., pp. 1006-1007, 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019, Osaka, Japan, 03/23/19. https://doi.org/10.1109/VR.2019.8797856

Real-time animation and motion retargeting of virtual characters based on single RGB-D camera. / Kang, Ning; Bai, Junxuan; Pan, Junjun et al.
26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. p. 1006-1007 8797856 (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Real-time animation and motion retargeting of virtual characters based on single RGB-D camera

AU - Kang, Ning

AU - Bai, Junxuan

AU - Pan, Junjun

AU - Qin, Hong

PY - 2019/3

Y1 - 2019/3

N2 - The rapid generation and flexible reuse of characters animation by commodity devices are of significant importance to rich digital content production in virtual reality. This paper aims to handle the challenges of current motion imitation for human body in several indoor scenes (e.g., fitness training). We develop a real-time system based on single Kinect device, which is able to capture stable human motions and retarget to virtual characters. A large variety of motions and characters are tested to validate the efficiency and effectiveness of our system.

AB - The rapid generation and flexible reuse of characters animation by commodity devices are of significant importance to rich digital content production in virtual reality. This paper aims to handle the challenges of current motion imitation for human body in several indoor scenes (e.g., fitness training). We develop a real-time system based on single Kinect device, which is able to capture stable human motions and retarget to virtual characters. A large variety of motions and characters are tested to validate the efficiency and effectiveness of our system.

KW - Adaptive filter

KW - Character animation

KW - Inverse kinematics

KW - Motion capture

KW - Retargeting

KW - Rgb-d camera

UR - https://www.scopus.com/pages/publications/85071862014

U2 - 10.1109/VR.2019.8797856

DO - 10.1109/VR.2019.8797856

M3 - Conference contribution

AN - SCOPUS:85071862014

T3 - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

SP - 1006

EP - 1007

BT - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019

Y2 - 23 March 2019 through 27 March 2019

ER -

Kang N, Bai J, Pan J, Qin H. Real-time animation and motion retargeting of virtual characters based on single RGB-D camera. In 26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. p. 1006-1007. 8797856. (26th IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2019 - Proceedings). doi: 10.1109/VR.2019.8797856

Real-time animation and motion retargeting of virtual characters based on single RGB-D camera

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Fingerprint

Cite this