Alternate destinies for survey items destined for the island of misfit toys: An analysis of teachers' perceptions of NAPLAN

Harbaugh, Allen & Thompson, Greg (2013) Alternate destinies for survey items destined for the island of misfit toys: An analysis of teachers' perceptions of NAPLAN. In AARE 2013 International Conference of The Australian Association for Research In Education, 1-5 December 2013, Hilton Adelaide Hotel, Adelaide, S.A.

View at publisher (open access)

Abstract

This is a methodological paper describing when and how manifest items dropped from a latent construct measurement model (e.g., factor analysis) can be retained for additional analysis. Presented are protocols for assessment for retention in the measurement model, evaluation of dropped items as potential items separate from the latent construct, and post hoc analyses that can be conducted using all retained (manifest or latent) variables. The protocols are then applied to data relating to the impact of the NAPLAN test. The variables examined are teachers’ achievement goal orientations and teachers’ perceptions of the impact of the test on curriculum and pedagogy. It is suggested that five attributes be considered before retaining dropped manifest items for additional analyses.

(1) Items can be retained when employed in service of an established or hypothesized theoretical model.

(2) Items should only be retained if sufficient variance is present in the data set.

(3) Items can be retained when they provide a rational segregation of the data set into subsamples (e.g., a consensus measure).

(4) The value of retaining items can be assessed using latent class analysis or latent mean analysis.

(5) Items should be retained only when post hoc analyses with these items produced significant and substantive results.

These suggested exploratory strategies are presented so that other researchers using survey instruments might explore their data in similar and more innovative ways. Finally, suggestions for future use are provided.

Impact and interest:

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

Full-text downloads:

46 since deposited on 05 Aug 2015
33 in the past twelve months

Full-text downloads displays the total number of times this work’s files (e.g., a PDF) have been downloaded from QUT ePrints as well as the number of downloads in the previous 365 days. The count includes downloads for all files if a work has more than one.

ID Code: 86166
Item Type: Conference Paper
Refereed: Yes
Keywords: survey instruments, confirmatory factor analysis, latent class analysis
Subjects: Australian and New Zealand Standard Research Classification > EDUCATION (130000) > OTHER EDUCATION (139900) > Education not elsewhere classified (139999)
Divisions: Current > QUT Faculties and Divisions > Faculty of Education
Copyright Owner: Copyright 2013 [Please consult the author]
Deposited On: 05 Aug 2015 00:08
Last Modified: 06 Aug 2015 05:10

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page