On the reliability of classifying programming tasks using a Neo-Piagetian theory of cognitive development

Gluga, Richard, Kay, Judy, Lister, Raymond, & Teague, Donna M. (2012) On the reliability of classifying programming tasks using a Neo-Piagetian theory of cognitive development. In Clear, Alison, Sanders, Kate, & Simon, Beth (Eds.) Proceedings of The International Computing Education Research Conference, ACM, Auckland University of Technology, Auckland.

View at publisher

Abstract

Recent research has proposed Neo-Piagetian theory as a useful way of describing the cognitive development of novice programmers. Neo-Piagetian theory may also be a useful way to classify materials used in learning and assessment. If Neo-Piagetian coding of learning resources is to be useful then it is important that practitioners can learn it and apply it reliably. We describe the design of an interactive web-based tutorial for Neo-Piagetian categorization of assessment tasks. We also report an evaluation of the tutorial's effectiveness, in which twenty computer science educators participated. The average classification accuracy of the participants on each of the three Neo-Piagetian stages were 85%, 71% and 78%. Participants also rated their agreement with the expert classifications, and indicated high agreement (91%, 83% and 91% across the three Neo-Piagetian stages). Self-rated confidence in applying Neo-Piagetian theory to classifying programming questions before and after the tutorial were 29% and 75% respectively. Our key contribution is the demonstration of the feasibility of the Neo-Piagetian approach to classifying assessment materials, by demonstrating that it is learnable and can be applied reliably by a group of educators. Our tutorial is freely available as a community resource.

Impact and interest:

3 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

138 since deposited on 28 Feb 2013
9 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 57674
Item Type: Conference Paper
Refereed: Yes
Keywords: Programming, Neo-Piagetian, learning standards, assessment, HERN
ISBN: 9781450316040
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > COMPUTER SOFTWARE (080300) > Software Engineering (080309)
Australian and New Zealand Standard Research Classification > EDUCATION (130000) > EDUCATION SYSTEMS (130100)
Australian and New Zealand Standard Research Classification > EDUCATION (130000) > CURRICULUM AND PEDAGOGY (130200) > Science Technology and Engineering Curriculum and Pedagogy (130212)
Divisions: Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: Copyright 2012 ACM
Copyright Statement: Permission to make digital or hard copies of all or part of this work for
personal or classroom use is granted without fee provided that copies are
not made or distributed for profit or commercial advantage and that copies
bear this notice and the full citation on the first page. To copy otherwise, to
republish, to post on servers or to redistribute to lists, requires prior specific
permission and/or a fee.
ICER’12, September 9–11, 2012, Auckland, New Zealand.
Copyright 2012 ACM 978-1-4503-1604-0/12/09 ...$10.00.
Deposited On: 28 Feb 2013 02:54
Last Modified: 01 Mar 2013 06:04

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page