Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers

Ahern, Tracey, Gardner, Anne, Gardner, Glenn E., Middleton, Sandy, & Della, Phillip (2013) Development and interrater reliability testing of a telephone interview training programme for Australian nurse interviewers. Nurse Education Today, 33(5), pp. 470-474.

View at publisher



Background The final phase of a three phase study analysing the implementation and impact of the nurse practitioner role in Australia (the Australian Nurse Practitioner Project or AUSPRAC) was undertaken in 2009, requiring nurse telephone interviewers to gather information about health outcomes directly from patients and their treating nurse practitioners. A team of several registered nurses was recruited and trained as telephone interviewers. The aim of this paper is to report on development and evaluation of the training process for telephone interviewers.

Methods The training process involved planning the content and methods to be used in the training session; delivering the session; testing skills and understanding of interviewers post-training; collecting and analysing data to determine the degree to which the training process was successful in meeting objectives and post-training follow-up. All aspects of the training process were informed by established educational principles.

Results Interrater reliability between interviewers was high for well-validated sections of the survey instrument resulting in 100% agreement between interviewers. Other sections with unvalidated questions showed lower agreement (between 75% and 90%). Overall the agreement between interviewers was 92%. Each interviewer was also measured against a specifically developed master script or gold standard and for this each interviewer achieved a percentage of correct answers of 94.7% or better. This equated to a Kappa value of 0.92 or better.

Conclusion The telephone interviewer training process was very effective and achieved high interrater reliability. We argue that the high reliability was due to the use of well validated instruments and the carefully planned programme based on established educational principles. There is limited published literature on how to successfully operationalise educational principles and tailor them for specific research studies; this report addresses this knowledge gap.

Impact and interest:

0 citations in Scopus
Search Google Scholar™

Citation counts are sourced monthly from Scopus and Web of Science® citation databases.

These databases contain citations from different subsets of available publications and different time periods and thus the citation count from each is usually different. Some works are not in either database and no count is displayed. Scopus includes citations from articles published in 1996 onwards, and Web of Science® generally from 1980 onwards.

Citations counts from the Google Scholar™ indexing service can be viewed at the linked Google Scholar™ search.

ID Code: 56563
Item Type: Journal Article
Refereed: Yes
Additional URLs:
DOI: 10.1016/j.nedt.2012.05.001
ISSN: 1532-2793 (online) 0260-6917 (print)
Subjects: Australian and New Zealand Standard Research Classification > MEDICAL AND HEALTH SCIENCES (110000) > NURSING (111000)
Divisions: Current > QUT Faculties and Divisions > Faculty of Health
Current > Schools > School of Nursing
Copyright Owner: Copyright 2012 Elsevier Ltd.
Deposited On: 21 Jan 2013 22:55
Last Modified: 28 Nov 2013 01:46

Export: EndNote | Dublin Core | BibTeX

Repository Staff Only: item control page