Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System

Schultz, Madeleine (2011) Sustainable assessment for large science classes : non-multiple choice, randomised assignments through a Learning Management System. Journal of Learning Design, 4(3), pp. 50-62.

View at publisher


This paper reports on the development of a tool that generates randomised, non-multiple choice assessment within the BlackBoard Learning Management System interface. An accepted weakness of multiple-choice assessment is that it cannot elicit learning outcomes from upper levels of Biggs’ SOLO taxonomy. However, written assessment items require extensive resources for marking, and are susceptible to copying as well as marking inconsistencies for large classes. This project developed an assessment tool which is valid, reliable and sustainable and that addresses the issues identified above. The tool provides each student with an assignment assessing the same learning outcomes, but containing different questions, with responses in the form of words or numbers. Practice questions are available, enabling students to obtain feedback on their approach before submitting their assignment. Thus, the tool incorporates automatic marking (essential for large classes), randomised tasks to each student (reducing copying), the capacity to give credit for working (feedback on the application of theory), and the capacity to target higher order learning outcomes by requiring students to derive their answers rather than choosing them. Results and feedback from students are presented, along with technical implementation details.

Impact and interest:

Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

470 since deposited on 13 Jul 2011
22 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 42619
Item Type: Journal Article
Refereed: Yes
Additional URLs:
Keywords: online assessment, non-multiple choice, Assessment; large classes; learning management system; computerised testing; randomised testing, HERN
ISSN: 1832-8342
Subjects: Australian and New Zealand Standard Research Classification > EDUCATION (130000) > EDUCATION SYSTEMS (130100) > Higher Education (130103)
Divisions: Past > Schools > Chemistry
Past > QUT Faculties & Divisions > Faculty of Science and Technology
Copyright Owner: Copyright © 2011 Madeleine Schultz
Deposited On: 13 Jul 2011 22:48
Last Modified: 14 Jul 2011 15:04

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page