Visualizing digital media interactions : providing feedback on jam2jam AV performances

Brown, Andrew R. (2010) Visualizing digital media interactions : providing feedback on jam2jam AV performances. In Robinson, Ricky & Bodker, Mads (Eds.) OzCHI 2010 Conference Proceedings, CHISIG and ACM, Queensland University of Technology, Brisbane, Queensland, pp. 196-199.

[img] pending for publisher permission (PDF 1MB)
Published Version.
Administrators only | Request a copy from author

View at publisher


Instrumental music performance is a well-established case of real-time interaction with technology and, when extended to ensembles, of interaction with others. However, these interactions are fleeting and the opportunities to reflect on action is limited, even though audio and video recording has recently provided important opportunities in this regard. In this paper we report on research to further extend these reflective opportunities through the capture and visualization of gestural data collected during collaborative virtual performances; specifically using the digital media instrument Jam2jam AV and the specifically-developed visualization software Jam2jam AV Visualize. We discusses how such visualization may assist performance development and understanding. The discussion engages with issues of representation, authenticity of virtual experiences, intersubjectivity and wordless collaboration, and creativity support. Two usage scenarios are described showing that collaborative intent is evident in the data visualizations more clearly than in audio-visual recordings alone, indicating that the visualization of performance gestures can be an efficient way of identifying deliberate and co-operative performance behaviours.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 38890
Item Type: Conference Paper
Refereed: Yes
Additional URLs:
ISBN: 9781450305020
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > INFORMATION SYSTEMS (080600) > Computer-Human Interaction (080602)
Australian and New Zealand Standard Research Classification > STUDIES IN CREATIVE ARTS AND WRITING (190000) > FILM TELEVISION AND DIGITAL MEDIA (190200)
Australian and New Zealand Standard Research Classification > STUDIES IN CREATIVE ARTS AND WRITING (190000) > PERFORMING ARTS AND CREATIVE WRITING (190400)
Divisions: Past > Research Centres > Australasian CRC for Interaction Design (ACID)
Current > QUT Faculties and Divisions > Creative Industries Faculty
Past > Schools > Music & Sound
Copyright Owner: Copyright the Author(s) and CHISIG
Deposited On: 28 Nov 2010 21:30
Last Modified: 29 Feb 2012 14:26

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page