Teaching a digital performing agent: Artificial neural network and hidden Markov Model for recognising and performing dance movement

McCormick, John, Vincs, Kim, Nahavandi, Saied, Creighton, Douglas, & Hutchison, Stephanie (2014) Teaching a digital performing agent: Artificial neural network and hidden Markov Model for recognising and performing dance movement. In 2014 International Workshop on Movement and Computing (MOCO' 14), 16-17 June 2014, Paris, France.

View at publisher


For a Digital Performing Agent to be able to perform live with a human dancer, it would be useful for the agent to be able to contextualize the movement the dancer is performing and to have a suitable movement vocabulary with which to contribute to the performance. In this paper we will discuss our research into the use of Artificial Neural Networks (ANN) as a means of allowing a software agent to learn a shared vocabulary of movement from a dancer. The agent is able to use the learnt movements to form an internal representation of what the dancer is performing, allowing it to follow the dancer, generate movement sequences based on the dancer's current movement and dance independently of the dancer using a shared movement vocabulary. By combining the ANN with a Hidden Markov Model (HMM) the agent is able to recognize short full body movement phrases and respond when the dancer performs these phrases. We consider the relationship between the dancer and agent as a means of supporting the agent's learning and performance, rather than developing the agent's capability in a self-contained fashion.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 95372
Item Type: Conference Paper
Refereed: Yes
Keywords: Artificial Intelligence, Choreographic Agent, Neural Network, Hidden Markov Model, Dance, Recognition
DOI: 10.1145/2617995.2618008
ISBN: 9781450328142
Subjects: Australian and New Zealand Standard Research Classification > STUDIES IN CREATIVE ARTS AND WRITING (190000) > PERFORMING ARTS AND CREATIVE WRITING (190400) > Dance (190403)
Divisions: Current > QUT Faculties and Divisions > Creative Industries Faculty
Past > Schools > School of Media, Entertainment & Creative Arts
Deposited On: 24 May 2016 22:50
Last Modified: 26 May 2016 22:20

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page