Using textual analysis with Concept Inventories to identify root causes of misconceptions
Goncher, Andrea, Boles, Wageeh, & Jayalath, Dhammika (2014) Using textual analysis with Concept Inventories to identify root causes of misconceptions. In 2014 IEEE Frontiers in Education Conference Proceedings, 2014 IEEE, Madrid, Spain, pp. 71-74.
Engineers must have deep and accurate conceptual understanding of their field and Concept inventories (CIs) are one method of assessing conceptual understanding and providing formative feedback. Current CI tests use Multiple Choice Questions (MCQ) to identify misconceptions and have undergone reliability and validity testing to assess conceptual understanding. However, they do not readily provide the diagnostic information about students’ reasoning and therefore do not effectively point to specific actions that can be taken to improve student learning. We piloted the textual component of our diagnostic CI on electrical engineering students using items from the signals and systems CI. We then analysed the textual responses using automated lexical analysis software to test the effectiveness of these types of software and interviewed the students regarding their experience using the textual component. Results from the automated text analysis revealed that students held both incorrect and correct ideas for certain conceptual areas and provided indications of student misconceptions. User feedback also revealed that the inclusion of the textual component is helpful to students in assessing and reflecting on their own understanding.
Impact and interest:
Citation counts are sourced monthly from and citation databases.
These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.
Citations counts from theindexing service can be viewed at the linked Google Scholar™ search.
Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.
|Item Type:||Conference Paper|
|Keywords:||Concept inventories, telecommunications engineering, formative assessment, conceptual understanding|
|Subjects:||Australian and New Zealand Standard Research Classification > ENGINEERING (090000) > OTHER ENGINEERING (099900) > Engineering not elsewhere classified (099999)
Australian and New Zealand Standard Research Classification > EDUCATION (130000) > CURRICULUM AND PEDAGOGY (130200) > Science Technology and Engineering Curriculum and Pedagogy (130212)
|Divisions:||Current > Schools > School of Electrical Engineering & Computer Science
Current > QUT Faculties and Divisions > Science & Engineering Faculty
|Copyright Owner:||Copyright IEEE 2014|
|Copyright Statement:||Unless otherwise noted on the first page of each paper, IEEE copyrights all papers.|
|Deposited On:||19 Nov 2014 05:35|
|Last Modified:||28 Mar 2015 23:45|
Repository Staff Only: item control page