Implementation fidelity and pupil achievement in book reading: variation between regions, local authorities and schools

Research output: Contribution to journalArticle

1 Citation (Scopus)
5 Downloads (Pure)

Abstract

Implementation fidelity or integrity is a key variable in evidence-based interventions, but is rarely assessed by student response or over a long period. This study related implementation fidelity in independent book reading to tested reading achievement over a year. The sample of 852,295 students in 3243 primary and secondary schools was reduced by schools providing incomplete data and the discarding of mid-year data. Achievement was measured pre-post by STAR Reading, a computerised item-banked adaptive test of reading accuracy and comprehension. Implementation fidelity was measured by variables from the computerised Accelerated Reader (AR) software, which analyses comprehension of a real book the student has chosen by a quiz. Results compared key variables for the four regions of the UK, local authorities and best performing schools. Computerised methods offer an interesting alternative to teacher behaviour for investigating implementation and outcomes. This study showed stronger links between implementation and outcomes at an individual level than when all data is aggregated, and that student response is at least as good an implementation index as teacher behaviour. The implications for practice, policy and future research were outlined.
Original languageEnglish
Number of pages22
JournalResearch Papers in Education
Early online date16 May 2017
DOIs
Publication statusE-pub ahead of print - 16 May 2017

Fingerprint

pupil
school
teachers' behavior
comprehension
student
quiz
integrity
primary school
secondary school
evidence

Keywords

  • implementation fidelity
  • implementation integrity
  • book reading
  • reading achievement
  • United Kingdom
  • regions
  • local authorities
  • primary schools
  • secondary schools

Cite this

@article{a285c44b2ba94a39880efa5f3a2dcb3c,
title = "Implementation fidelity and pupil achievement in book reading: variation between regions, local authorities and schools",
abstract = "Implementation fidelity or integrity is a key variable in evidence-based interventions, but is rarely assessed by student response or over a long period. This study related implementation fidelity in independent book reading to tested reading achievement over a year. The sample of 852,295 students in 3243 primary and secondary schools was reduced by schools providing incomplete data and the discarding of mid-year data. Achievement was measured pre-post by STAR Reading, a computerised item-banked adaptive test of reading accuracy and comprehension. Implementation fidelity was measured by variables from the computerised Accelerated Reader (AR) software, which analyses comprehension of a real book the student has chosen by a quiz. Results compared key variables for the four regions of the UK, local authorities and best performing schools. Computerised methods offer an interesting alternative to teacher behaviour for investigating implementation and outcomes. This study showed stronger links between implementation and outcomes at an individual level than when all data is aggregated, and that student response is at least as good an implementation index as teacher behaviour. The implications for practice, policy and future research were outlined.",
keywords = "implementation fidelity, implementation integrity, book reading , reading achievement, United Kingdom, regions, local authorities, primary schools, secondary schools",
author = "Keith Topping",
note = "No funding info",
year = "2017",
month = "5",
day = "16",
doi = "10.1080/02671522.2017.1329340",
language = "English",
journal = "Research Papers in Education",
issn = "0267-1522",
publisher = "Taylor & Francis",

}

TY - JOUR

T1 - Implementation fidelity and pupil achievement in book reading

T2 - variation between regions, local authorities and schools

AU - Topping, Keith

N1 - No funding info

PY - 2017/5/16

Y1 - 2017/5/16

N2 - Implementation fidelity or integrity is a key variable in evidence-based interventions, but is rarely assessed by student response or over a long period. This study related implementation fidelity in independent book reading to tested reading achievement over a year. The sample of 852,295 students in 3243 primary and secondary schools was reduced by schools providing incomplete data and the discarding of mid-year data. Achievement was measured pre-post by STAR Reading, a computerised item-banked adaptive test of reading accuracy and comprehension. Implementation fidelity was measured by variables from the computerised Accelerated Reader (AR) software, which analyses comprehension of a real book the student has chosen by a quiz. Results compared key variables for the four regions of the UK, local authorities and best performing schools. Computerised methods offer an interesting alternative to teacher behaviour for investigating implementation and outcomes. This study showed stronger links between implementation and outcomes at an individual level than when all data is aggregated, and that student response is at least as good an implementation index as teacher behaviour. The implications for practice, policy and future research were outlined.

AB - Implementation fidelity or integrity is a key variable in evidence-based interventions, but is rarely assessed by student response or over a long period. This study related implementation fidelity in independent book reading to tested reading achievement over a year. The sample of 852,295 students in 3243 primary and secondary schools was reduced by schools providing incomplete data and the discarding of mid-year data. Achievement was measured pre-post by STAR Reading, a computerised item-banked adaptive test of reading accuracy and comprehension. Implementation fidelity was measured by variables from the computerised Accelerated Reader (AR) software, which analyses comprehension of a real book the student has chosen by a quiz. Results compared key variables for the four regions of the UK, local authorities and best performing schools. Computerised methods offer an interesting alternative to teacher behaviour for investigating implementation and outcomes. This study showed stronger links between implementation and outcomes at an individual level than when all data is aggregated, and that student response is at least as good an implementation index as teacher behaviour. The implications for practice, policy and future research were outlined.

KW - implementation fidelity

KW - implementation integrity

KW - book reading

KW - reading achievement

KW - United Kingdom

KW - regions

KW - local authorities

KW - primary schools

KW - secondary schools

U2 - 10.1080/02671522.2017.1329340

DO - 10.1080/02671522.2017.1329340

M3 - Article

JO - Research Papers in Education

JF - Research Papers in Education

SN - 0267-1522

ER -