Go to CS Dept. Main Page Go to CityU Main page

3D Motion Capture Laboratory


Project - Dance Education Using Motion Capture System


Motivation and Aim

Dancing is a popular activity which can be enjoyed by people of different ages. There are mainly two ways to learn dancing. The first way is to attend a dance lesson in which a teacher demonstrates the moves, points out the mistake made by the students and guides them to improve. It is the most effective way but some people do not have time to attend lessons and teachers are not always available. The second way is self-learning by watching demonstrations in videos such that students observe the moves and practice by themselves. However, students may not be able to completely understand the moves and perform them correctly. This project is to build up a dance training system using motion capture technology. Virtual teachers in our system will demonstrate different dance motions. Users can observe and learn those moves. They can also perform what they learnt and our system will give them feedback. By studying the feedback, they will know what's wrong with their performances and how to improve them.

Top of this page

Method Description

In order to overcome the shortage of current self-learning method in motion training, we propose a solution with a practical example to address the problems. Our solution makes use of motion capture technology and motion analysis method.

System Architecture

The architecture of the system includes four components: 3D graphics, motion matching, motion database and motion capture system. Fig. 1 shows the relationships between each component. The user¡¦s movements which are obtained by the motion capture system are compared with the motions in the motion database through the motion matching component. The 3D graphics component visualizes the movements by the user and the virtual teacher (template motion).

Figure 1. The System Design

The Steps to Learn Dancing

The student is encouraged to learn following the learning cycle below (Fig.2). Through the cycle, the student improve the skills by using the feedback returned by our system.

Figure 2. The Learning Cycle

Types of Feedback

The system provides THREE types of feedback to the students: 1) Intermediate Feedback which is shown in red (wrong) or yellow (correct) and appears while the students are dancing (Fig. 3); 2) Score Report which shows scores for movement at each joint and appears after each performance (Fig. 4); and 3) Slow Motion Replay which is shown in color of white (correct) to deep red (wrong) indicating the correctness and appears after the score report (Fig. 5).

Figure 3. Intermediate Feedback

Figure 4. Score Report

Figure 5. Slow Motion Reply

Top of this page


Top of this page

Team Member

Top of this page


Any suggestions or comments are welcome. Please send them to Jacky Chan

Top of this page

This website is maintained by Jacky Chan
Copyright @ 2008 3D Motion Capture Laboratory. All rights reserved.
Last update: 25 Feb, 2013 .