Short answer versus multiple choice examination questions for first year chemistry

Mullen, Kathleen & Schultz, Madeleine (2012) Short answer versus multiple choice examination questions for first year chemistry. International Journal of Innovation in Science and Mathematics Education, 20(3), pp. 1-18.

View at publisher (open access)

Abstract

Multiple choice (MC) examinations are frequently used for the summative assessment of large classes because of their ease of marking and their perceived objectivity. However, traditional MC formats usually lead to a surface approach to learning, and do not allow students to demonstrate the depth of their knowledge or understanding. For these reasons, we have trialled the incorporation of short answer (SA) questions into the final examination of two first year chemistry units, alongside MC questions. Students’ overall marks were expected to improve, because they were able to obtain partial marks for the SA questions. Although large differences in some individual students’ performance in the two sections of their examinations were observed, most students received a similar percentage mark for their MC as for their SA sections and the overall mean scores were unchanged. In-depth analysis of all responses to a specific question, which was used previously as a MC question and in a subsequent semester in SA format, indicates that the SA format can have weaknesses due to marking inconsistencies that are absent for MC questions. However, inclusion of SA questions improved student scores on the MC section in one examination, indicating that their inclusion may lead to different study habits and deeper learning. We conclude that questions asked in SA format must be carefully chosen in order to optimise the use of marking resources, both financial and human, and questions asked in MC format should be very carefully checked by people trained in writing MC questions. These results, in conjunction with an analysis of the different examination formats used in first year chemistry units, have shaped a recommendation on how to reliably and cost-effectively assess first year chemistry, while encouraging higher order learning outcomes.

Impact and interest:

2 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

176 since deposited on 28 Oct 2012
19 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 54356
Item Type: Journal Article
Refereed: Yes
Keywords: Multiple choice examinations, summative assessment, short answer questions, HERN
ISSN: 2200-4270
Subjects: Australian and New Zealand Standard Research Classification > EDUCATION (130000) > SPECIALIST STUDIES IN EDUCATION (130300) > Education Assessment and Evaluation (130303)
Divisions: Current > Schools > School of Chemistry, Physics & Mechanical Engineering
Current > QUT Faculties and Divisions > Science & Engineering Faculty
Copyright Owner: Copyright 2012 Institute for Innovation in Science and Mathematics Education
Deposited On: 28 Oct 2012 22:38
Last Modified: 31 Oct 2012 04:27

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page