Structure matters: Adoption of structured classification Approach in the context of cognitive presence classification

Waters, Zak, Kovanovic, Vitomir, Kitto, Kirsty, & Gasevic, Dragan (2015) Structure matters: Adoption of structured classification Approach in the context of cognitive presence classification. In Lecture Notes in Computer Science, Springer, Brisbane. (In Press)

Abstract

Within online learning communities, receiving timely and meaningful insights into the quality of learning activities is an important part of an effective educational experience. Commonly adopted methods – such as the Community of Inquiry framework – rely on manual coding of online discussion transcripts, which is a costly and time consuming process. There are several efforts underway to enable the automated classification of online discussion messages using supervised machine learning, which would enable the real-time analysis of interactions occurring within online learning communities. This paper investigates the importance of incorporating features that utilise the structure of on-line discussions for the classification of "cognitive presence" – the central dimension of the Community of Inquiry framework focusing on the quality of students' critical thinking within online learning communities. We implemented a Conditional Random Field classification solution, which incorporates structural features that may be useful in increasing classification performance over other implementations. Our approach leads to an improvement in classification accuracy of 5.8% over current existing techniques when tested on the same dataset, with a precision and recall of 0.630 and 0.504 respectively.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 89115
Item Type: Conference Paper
Refereed: Yes
Additional URLs:
Keywords: Text Classification, Conditional Random Fields, Community of Inquiry, Online Learning, HERN
ISSN: 1611-3349
Subjects: Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > ARTIFICIAL INTELLIGENCE AND IMAGE PROCESSING (080100) > Natural Language Processing (080107)
Australian and New Zealand Standard Research Classification > INFORMATION AND COMPUTING SCIENCES (080000) > LIBRARY AND INFORMATION STUDIES (080700) > Social and Community Informatics (080709)
Australian and New Zealand Standard Research Classification > EDUCATION (130000) > SPECIALIST STUDIES IN EDUCATION (130300) > Educational Technology and Computing (130306)
Divisions: Current > Schools > School of Information Systems
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: Copyright 2015 Springer
Deposited On: 15 Oct 2015 04:16
Last Modified: 18 Mar 2016 05:04

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page