Effectiveness of Reading & Math Software (ERMS): Findings from Two Student Cohorts

The Effectiveness of Reading and Mathematics Software Products: Findings from Two Student Cohorts reports on the impacts on student achievement of a second year of use of selected software programs in 1st grade reading, 4th grade reading, 6th grade math, and algebra I. The evaluation found no significant difference in student achievement between the classrooms that used the technology products and the classrooms that did not use the technology products, in any of the four groups, in either the first or second year of use by teachers. Only one product, Leap Track in 4th grade, had a statistically significant positive effect on student achievement. The study also tested whether using any of the 10 software products increased student test scores. One product had a positive and statistically significant effect. Nine did not have statistically significant effects on test scores. Five of the insignificant effects were negative and four were positive. The study’s findings should be interpreted in the context of its design and objectives. It examined a range of reading and math software products in a range of diverse school districts and schools. But it did not study many forms of educational technology and it did not include many types of software products. How much information the findings provide about the effectiveness of products that are not in the study is an open question. Products in the study also were implemented in a specific set of districts and schools, and other districts and schools may have different experiences with the products. The findings should be viewed as one element within a larger set of research studies that have explored the effectiveness of software products.