An examination of bias in oral reading fluency: differential effects across race, gender, and socioeconomic status

Recent legislation allowing educational agencies to use Response to Intervention (RTI) in determining whether a child has a specific learning disability, coupled with a focus on large-scale testing and accountability resulted in the increasing use of curriculum based measurement (CBM) as a tool for understanding students' progress towards state standards, particularly in reading through the use of oral reading fluency measures. Extensive evidence of oral reading fluency's predictability of reading comprehension exists, but little research on differential effects across racial, gender, and socioeconomic subgroups is available. This study investigated racial, gender, and socioeconomic bias in DIBELS Oral Reading Fluency (DIBELS ORF) probes predictive and concurrent relationship with MAP reading comprehension scores for African American and Caucasian students. Participants were 834 second through fifth grade students in a school district located in a southeastern US state. The dataset consisted of student fall and spring DIBELS ORF scores and spring MAP reading comprehension scores. Concurrent correlation results between spring DIBELS ORF and MAP reading comprehension scores were moderate to large and statistically significant across all grades and demographic groups; however, correlations between fall DIBELS ORF and MAP reading comprehension scores were generally weak. Stepwise multiple regression analyses were used to examine the best variable, or combination of variables, in predicting MAP reading comprehension scores. Models differed for each grade level; however, spring DIBELS ORF scores were always included, whether alone or in combination with demographic variables, in the best prediction model. Potthoff's procedure was used to simultaneously test for slope and intercept differences among regression equations to determine if DIBELS ORF scores from fall and spring differentially predicted MAP reading comprehension scores across demographic groups. Nine of 24 simultaneous contrasts demonstrated a significant effect; seven were related to race, one was related to gender, and one was related to socioeconomic status. Racial bias in predicting MAP reading comprehension performance from spring DIBELS ORF was found. Differential prediction among gender and SES groups was not consistent indicating little to no practical significance. Results are discussed in the context of practical implications of differential validity, both predictive and concurrent, and potential impact on disproportionality.