Validity and Effectiveness Studies

Istation’s assessments and instruction are based on data from scientific and independent research studies that have proven Istation's effectiveness in elevating reading fluency and the product's applicability to the classroom.

Photo of a girl using Istation on a tablet device.

 

Independent Study: Istation

Usage Leads to Growth on the NWEA MAP
March 2021

This independent quasi experimental study  meets ESSA Tier 2 evidence standards. Students in schools that used Istation at the recommended levels had significantly greater gains on the NWEA MAP assessment when compared to similar, comparison students.  

Read the Study

 

Comparability of ISIP™ Reading Scores Across Alternate Backgrounds

August 2021

Comparability of ISIP™ Reading Scores Across Alternate Backgrounds (461KB)

This research evaluates whether student performance is comparable on the ISIP ER when the background changes color while keeping the content consistent. Results show that after controlling for prior achievement and ability level, having a new background slightly increased student performance. Effects varied by grade and subtest; however, all effect sizes were small. The most likely explanation is a novelty effect as the students were exposed to a background that was different than what they had been used to seeing on their monthly assessment.

Summer Slide Is Bad, COVID-19 Slide Is Even Worse: Online Assessment Perspective

April 2021

Summer Slide Is Bad, COVID-19 Slide Is Even Worse: Online Assessment Perspective (600KB)

This study uses a nationally stratified sample and a piecewise growth model to reveal that students had less growth and lower scores on the ISIP Reading and ISIP Math assessments in the 2020-2021 school year, which was impacted by the COVID-19 pandemic, than they did in previous years. The learning lags were evident in both reading and math, with math showing greater declines in learning growth. This research was presented at the National Council for Measurement in Education (NCME) 2021 virtual annual meeting.

Computer Adaptive Curriculum and Math Achievement: A Quasi Experimental Study

March 2021

Computer Adaptive Curriculum and Math Achievement: A Quasi Experimental Study

Students in the elementary grades had significantly more growth on the ISIP Math assessment when they also used the Istation Math curriculum for the recommended amount of time.

Learning Loss in Reading and Math in U.S. Schools Due to the COVID-19 Pandemic

March 2021

Learning Loss in Reading and Math in U.S. Schools Due to the COVID-19 Pandemic

This study examines students' achievement loss in reading and math due to COVID-19 pandemic school closures in Spring of 2020. Students had losses in both reading and math that varied by grade and type of school, and losses in math were greater than those in reading.

Independent Study: South Carolina Ready Assessment Predictability Study for Third and Fourth Grade

March 2021

SC-READY Predictability Study

The ISIP Reading scores for fall, winter, and spring are used to predict performance on the end-of-year South Carolina Ready assessment.

Independent Study: NWEA MAP Predictability Study for Third and Fourth Grade

March 2021

NWEA MAP Predictability Study

The ISIP Reading scores for fall, winter, and spring are used to predict performance on the NWEA MAP assessment in the spring.

Predictability Study for the ACT Aspire

March 2021

Linking the ACT Aspire Assessments to ISIP Reading and Math

ISIP Reading and ISIP Math are linked to the ACT Aspire end of year assessment. Proficiency projections are provided for students at the end of second grade and the middle of third grade to identify students that may need targeted intervention or differentiated instruction to increase the likelihood that the students will achieve the Ready or higher performance level. Cut points based on classification accuracy are provided for the third grade middle of the year scores.

COVID-19 Learning Loss in Texas

February 2021

COVID-19 Learning Loss in Texas

In Texas, students experienced greater learning losses in reading than in math due to school closures in Spring of 2020 related to the COVID-19 pandemic. Learning losses varied by grade and type of school, with learning losses more pronounced in lower-poverty schools than high-poverty schools.

COVID 19 Learning Loss and Online Learning

January 2021

Research Brief: Student Engagement in Online Learning During COVID-19 School Closures Predicts Lower Learning Loss in Fall 2021

Students who participated in online learning using Istation during the Spring of 2020 school closures due to the COVID 19 pandemic had higher achievement scores in the Fall of 2020 than students who did not engage in online learning. Students enrolled in higher poverty schools who engaged in online learning narrowed the achievement gap with students in lower poverty schools.

Istation Studies: Dyslexia Report

January 2021

Early Identification of the Risk of Dyslexia: Can the Istation Indicators of Progress (ISIP) Screen for Risk in Kindergarten through Third Grade? (624KB)

Students who are at risk of dyslexia respond well to effective treatment or therapy if they are caught early enough in their school careers. This research uses Istation’s Indicators of Progress, Early Reading (ISIP ER) to create risk factors based on patterns of strengths and weaknesses associated with a risk of dyslexia. Cut scores for specific subtests for Reading Comprehension, Spelling, and Alphabetic Decoding from ISIP ER are provided for first through third grades.

Linking ISIP™ Early Reading to STAAR for second and third grade students

October 2020

Linking ISIP™ Early Reading to STAAR for second and third grade students (470KB)

Using data from a large, diverse school district, this study provides proficiency projections for the end-of-year second grade and middle-of-year third grade ISIP ER scores. This study will help teachers identify students at risk of not achieving the STAAR Reading performance of Meets Grade Level or higher.

Predictability Study: Linking the Ohio AIR to ISIP Reading and Math

October 2020

Linking the Ohio AIR to ISIP

ISIP Reading and ISIP Math middle of the year scores for students in third through eighth grade are used to provide a proficiency projection for the end of year Ohio AIR assessment.

Independent Study: Predicting Student Performance on the third grade PARCC

June 2020

PARCC Predictability Study – 3rd Grade (216KB)

This study investigates the predictability of the ISIP ER on the Partnership for Assessment of Readiness for College and Careers (PARCC). Using data from a school district in the southwestern United States, this study demonstrates that ISIP ER Reading cut scores can predict the student's outcome on the PARCC. Cut points are provided for both the Fall and Winter benchmark periods.

Independent Study: Predicting Student Performance on the third grade ISAT

May 2020

Linking Istation ISIP Early Reading with the Idaho ISAT (128KB)

This study investigates the predictability of the ISIP ER on the Idaho Standards Achievement Test (ISAT). It provides evidence that the ISIP Reading cut scores can predict the student's outcome on the ISAT. Cut points are provided for the Winter benchmark period. Data were obtained from all students in the state of Idaho.

Independent Study: Istation usage leads to gains on the PARCC

April 2020

ELA Score Gains and Istation Usage (114KB)

The ISIP ER and Istation usage are positively associated with PARCC ELA scores. When students used Istation according to guidelines, they had increased scores on the English/Language Arts section of the PARCC assessment.

Independent Study: ISIP ER first and second grade scores are correlated with third grade PARCC performance

April 2020

PARCC Predictability Study – Longitudinal Analysis (78KB)

ISIP ER first and second grade scores are correlated with third grade PARCC performance, even after controlling for prior achievement and student demographics.

Independent Study: Predicting Second Graders Reading Achievement Using the ISIP™ ER

March 2020

Journal: Computers in the Schools

This study investigates the predictability of the ISIP ER for measuring second-grade students' overall and comprehension reading achievement on a standardized reading achievement test. Specifically, second-grade student scores for the ISIP ER and the Standardized Test for the Assessment of Reading (STAR Reading) in one state were examined. Linear regression analysis was conducted in Mplus to determine the predictability between the ISIP-ER and STAR Reading scores, identifying that both the ISIP-ER overall reading and comprehension scores in December predicted the standardized reading scores in Spring (May). Confidence intervals were estimated to identify the ISIP-ER cut scores that predict STAR Reading scores for all achievement levels. Overall, ISIP-ER shows promise as a universal screening tool for second-grade student yearly reading skills. To obtain a copy of the article, please contact locampbell@ucf.edu.

Istation Leads to Reading Growth for Early Elementary Students

January 2020

An Evaluation of Istation Curriculum on Student Reading Growth: A Quasi-Experimental Study Using Propensity Score Analysis (277KB)

Using a quasi-experimental research design to meet ESSA Tier 2 standards, this study demonstrates that the use of the Istation curriculum for 40 minutes per month leads to reading growth for students in Kindergarten through second grade.

Measuring the Predictability of ISIP Reading on Student's Virginia Standards of Learning (SOL) Scores: 3rd – 8th Grade Students

November 2019

Measuring the Predictability of ISIP Reading on Student's Virginia Standards of Learning (SOL) Scores: 3rd – 8th Grade Students (1101KB)

This study provides evidence that Istation's Indicators of Progress Early Reading (ISIP ER) and Advanced Reading (ISIP AR) scores can predict the Virginia Standards of Learning (VA SOL) year end scores for all achievement levels among 3rd to 8th grade students. Prediction Bands and Cut Scores are provided.

Independent Study: At-risk third grade students experience learning gains while using Istation at school and at home

October 2019

Journal of At-Risk Issues: Computer-Adaptive Reading to Improve Reading Achievement Among Third-Grade Students At Risk for Reading Failure (10,123 KB)

This study in the Journal of At-Risk Issues provides evidence regarding the benefits of using Istation to narrow achievement inequalities and increase opportunities for students who are at the greatest risk of reading failure. Students below the 20th percentile who were economically disadvantaged had the greatest gains on their ISIP-ER scores. Students who used Istation at home and at school for more than 30 minutes per week showed the greatest gains.

Measuring the Predictability of Istation’s Indicators of Progress (ISIP™) Early Reading scores on Renaissance STAR Reading®

June 2019

Measuring the Predictability of ISIP-ER scores on Renaissance STAR Reading® (556KB)

This study provides evidence that ISIP Reading cut scores can predict the STAR Reading Assessment (STAR) statewide examination scores for all achievement levels among first and second grade students. The study examined kindergarten, first, and second grade ISIP-ER scores (Overall Reading Ability and Reading Comprehension) and STAR Reading scores. Data were collected during the 2017-2018 school year. A simple linear regression analysis was conducted to determine the correlation of the STAR Reading Scaled scores and the ISIP-ER overall reading scores. ISIP-ER scaled scores had a strong correlate to the STAR scores. Predictability “bands” were computed to identify the ISIP-ER cut scores that predict STAR Reading scores for all achievement levels.

Linking the Colorado Measures of Academic Success English Language Arts (CMAS ELA) Assessments to ISIP™ Reading Assessments Grades 3 through 5

April 2019

ISIP™ Reading and Colorado Measures of Success English Language Arts Linking Study (1,490KB)

This study provides evidence that Istation’s Indicators of Progress (ISIP™) Reading cut scores can predict outcomes on the Colorado Measures of Academic Success (CMAS). This study uses 3rd through 5th grade ISIP Overall Reading Ability scores and CMAS English Reading scores. All data come from a school district in the state of Colorado. Multinomial logistic regression was used to calculate the probability that based on a student's middle-of-the year ISIP score, he or she will partially meet, approach, meet, or exceed expectations on the end-of-the-year CMAS. Probabilities are provided for all students, for students who are English Language Learners (ELL), and students who are not ELL. These results give teachers the opportunity to target students for intensive intervention in the middle of the year to increase their probability of meeting expectations on the CMAS.

Predictability Study of ISIP (Math and Reading) and Ohio AIR (Math and English Language Arts) Tests for 3rd – 8th Grade Students in the Youngstown City School District

July 2018

ISTATION ISIP™ AND OHIO AIR PREDICTABILITY STUDY (420KB)

This study provides evidence that Istation’s Indicators of Progress (ISIP™) Math and Reading scores can predict outcomes of the American Institutes for Research (AIR) exam in Ohio. This study uses data from the 2017-2018 school year for 3rd through 8th grade students and used simple linear regression to compare ISIP Overall Reading Ability scores with Ohio AIR English/Language Arts (ELA) scores and ISIP Math scores with Ohio AIR Math scores. Predictability "bands" were further computed by using the confidence interval (CI) approach to identify the ISIP cut scores that predict five performance levels. Results of the regression models show that the ISIP Reading measures are predictive of Ohio AIR ELA, and ISIP Math measures are predictive of the Ohio AIR Math assessment. The ISIP Overall Reading and Math ability cut scores to predict Ohio AIR performance levels Limited, Basic, Proficient, Accelerated, and Advanced are reported.

Independent Study: ISIP Español Validity Research Report for Kindergarten–5th grade

June 2018

Kindergarten through Grade 5 Report (3.1MB)

English Language Learners (ELLs) constitute 9.5% of the student population in the US, and of these students 77.1% are Spanish speakers (NCES, 2017). Istation Lectura Temprana (ISIP Español LT) and Lectura Avanzada (ISIP Español LA) assessments for kindergarten through grade 5 screen for Spanish language skills and help teachers identify whether students are on track for reaching Spanish language goals. This research examines the validity evidence between the ISIP Español LT and ISIP Español LA assessments and other assessment instruments including the Fast Bridge Spanish, Aprenda 3, PARCC, and Texas STAAR exams. The sample consisted of students in the southwestern United States who speak Spanish. Correlations were moderate to strong across all grades and assessments, and classification accuracy increased as the school year progressed.

Independent Study: ISIP Español Validity Research Report for Prekindergarten

June 2018

Prekindergarten Report (1.1MB)

Results from assessments such as the Istation Lectura Temprana (ISIP Español LT) can help educators identify whether students in prekindergarten are on track for reaching Spanish-language goals. There are very few universal Spanish screeners available for these young students, and this research evaluates the ISIP Español LT assessment. Data were collected in two school districts in Texas during the 2017-2018 school year. Concurrent validity and sensitivity analysis was conducted using the Fast Bridge Early Reading Spanish and the Spanish Individual Growth and Development Indicators (IGDIs Español) in the fall, winter, and spring semesters.

Predictability Study of ISIP Reading and Virginia Standards of Learning (SOL) for English Reading: 3rd – 5th Grade Students

May 2018

ISIP Reading and SOL Predictability Study (420KB)

This study provides evidence that Istation’s Indicators of Progress (ISIP™) Reading cut scores can predict outcomes of the Virginia Standards of Learning (SOL) for English Reading tests. This study uses 3rd through 5th grade ISIP Overall Reading Ability scores and SOL English Reading scores. All data come from one county in the state of Virginia and were collected in the 2016–2017 school year. Simple linear regression analysis was applied. Predictability “bands” were further computed by using the confidence interval (CI) approach to identify the ISIP Reading cut scores that predict SOL English Reading performance levels pass/proficient and pass/advanced. Results of a simple linear regression show that the ISIP Reading measures are predictive of SOL English Reading tests. The ISIP Overall Reading Ability cut scores to predict SOL English Reading performance levels pass/proficient and pass/advanced are reported.

Istation Assessments Predict Achievement Levels on Florida Standards Assessments

April 2018

Full Study (616KB)

Executive Summary (204KB)

A new research study from University of Central Florida shows that Istation’s reading assessment can predict the Florida Standards Assessment English Language Arts (FSA-ELA) statewide examination scores for all achievement levels among third grade students.

 

Predictability Study of ISIP Reading and Kansas Assessment Program: 3rd -6th Grade Students

November 2017 (389KB)
This study provides measurable evidence that the ISIP Reading measures are predictive of the Kansas Assessment Program's English Language Arts scores across grades 3 - 6. It indicates the ISIP assessments can be used as a prediction of how a student will perform on the Kansas ELA assessment. Predictability bands were computed to obtain ISIP cut scores to predict passing the Kansas ELA assessment. Data from 5226 students was collected from a school district in Kansas. ISIP Early Reading and ISIP Advanced Reading overall reading and comprehension scores and Kansas Assessment Program's English Language Arts scores from the 2016-2017 school year were compared.

Independent study on Istation using mixed-method, quasi-experimental design

October 2017
Technology versus teachers in the early literacy classroom: an investigation of the effectiveness of the Istation integrated learning system
Guided by Vygotsky’s social learning theory, this study reports a 24-week investigation on whether regular use of Istation, an integrated learning system used by approximately 4 million students in the United States, had an effect on the early literacy achievement of children in twelve kindergarten classrooms. A mixed-method, quasi-experimental design was constructed using propensity scores. Also investigated were the effects of the level of teacher literacy support on early literacy achievement and the interaction between Istation® use and the level of teacher literacy support. Results indicate that overall, Istation had a statistically significant effect on the literacy learning of the students in the study. Istation cannot provide the article in full as the copyright is held by the journal. The link will direct interested readers to the journal article. A free copy is available by searching the Education Resources Information Center (ERIC) and Academic Search Complete databases, available at most public or university libraries.

Predictability Study of ISIP Reading and STAAR Reading: Prediction Bands

September 2017 (135KB)
This study provided evidence that Istation’s Indicators of Progress (ISIP™) reading assessments’ cut scores can predict passing scores for the State of Texas Assessments of Academic Readiness (STAAR) reading tests. This study used ISIP Early Reading (3rd grade), ISIP Advanced Reading (4th–8th grade), and STAAR reading tests and applied simple linear regression analysis for each grade’s data. Predictability “bands” were further computed by using the confidence interval (CI) approach to obtain the ISIP reading cut score to predict passing STAAR reading tests. Results of a simple linear regression showed that the ISIP reading measures are highly predictive of STAAR reading scores.

STAAR Prediction Bands - Quick Guide (180KB)

Georgia Milestones Report

July 2016 (367KB)
This study provides measurable evidence that the ISIP Reading measures are predictive of the Georgia Milestone English Language Arts scores across grades 3 - 6. It indicates the ISIP assessments can be used as a prediction of how a student will perform on the Georgia Milestone assessment. Predictability bands were computed to obtain ISIP cut scores to predict passing the Georgia Milestone assessment. Data from 1275 students was collected from a school district in Georgia. ISIP Early Reading and ISIP Advanced Reading overall reading and comprehension scores and Georgia Milestone English Language Arts scores from the 2015-2016 school year were compared.

Istation Reading Leads to Growth for Florida Elementary Students

November 2015 (1.4MB)
This study, conducted by The Morgridge International Reading Center (MIRC) at the University of Central Florida (UCF), provides an analysis of students’ usage of the Istation reading program by locale, Title I status, grade, and academic level during the 2014-2015 school year. Findings show students who used Istation Home exhibited greater growth than students who exclusively used Istation at school; students in 4th and 5th grade in academic level 3 who needed the most academic intervention and demonstrated the greatest need of intervention exhibited a greater amount of growth than those students in academic level 2; on average, pre-K through 3rd grade students experienced growth in reading; of the participating schools, 79 percent were classified as Title I schools, which traditionally serve underserved students.

Istation Español Growth Study: Pre-Kindergarten to Third Grade

September 2014 (295KB)
This study provides a growth analysis of overall reading ability of Grades Pre-Kindergarten–3rd students from the 2013-2014 school year using Istation Español. Findings show that students using Istation Español make greater gains in overall reading ability as compared to those who do not use or used less Istation Reading en Español curriculum. This study also found that students at risk of reading failure make greater gains with sufficient amount of Istation Reading en Español curriculum usage.

Istation Reading Growth Study: Grades 1–8

July 2014 (341KB)
This study provides a growth analysis of overall reading ability of Grades 1-8 students from the 2013-2014 school year in the state of Texas. Findings show that students using Istation Reading make greater gains in overall reading ability as compared to those who do not use or used less Istation Reading curriculum. This study also found that students at risk of reading failure make greater gains with sufficient amount of Istation Reading curriculum usage.

Istation Reading Growth Study: Nationwide Data for Pre-Kindergarten and Kindergarten

June 2014 (258KB)
This study provides a nationwide growth analysis of early literacy skills in Pre-Kindergarten and Kindergarten students from the 2013-2014 school year. Findings show that students using Istation Reading make greater gains in early literacy skills as compared to those who do not use or used less Istation Reading curriculum. This study also found that students at risk of reading failure make greater gains with sufficient amount of Istation Reading curriculum usage.

Predictability Study of ISIP Reading and STAAR Reading: Prediction Bands

March 2014 (318KB)
This study provides evidence of the ability of ISIP Reading cut scores to predict passing the of STAAR across grades 3-8. Predictability bands were computed to obtain ISIP cut scores to predict passing STAAR. Data from 20,493 students was collected from the Garland Independent School District, in Garland, TX. ISIP Early Reading and ISIP Advanced Reading overall reading scores and STAAR Reading scores from the 2012-2013 school year were compared.

 

ISIP Reading versus STAAR Reading: The Predictability Study

January 2014 (2MB)
This study provides measurable evidence that the ISIP Reading measures are predictive of STAAR Reading scores across grades 3 - 8. It indicates the ISIP tests can be used as a prediction of how a student will score on STAAR. Data from 20,493 students was collected from the Garland Independent School District, in Garland, TX. ISIP Early Reading and ISIP Advanced Reading overall reading scores and STAAR Reading scores from the 2012-2013 school year were compared.

 

Independent Study

ISIP Validity and Reliability Research Report for Pre-K

March 15, 2010 (201KB)
During the 2009–10 school year, a study using ISIP, Istation’s Indicators of Progress, Early Reading assessment program was conducted in eleven pre-kindergarten classes from a large North Texas school district. Data were examined for concurrent validity with external measures, as well as internal consistency and test-retest reliability. Results show large to very large evidence of reliability and validity with regard to letter knowledge, vocabulary, phonemic awareness, and comprehensive reading ability for students in pre-kindergarten.

 

ISIP Early Reading Reliability and Validity Evidence

August 21, 2009 (289KB)
During the 2008–09 school year, a validity and reliability study using ISIP, Istation’s Indicators of Progress computer-adaptive reading assessment program, was conducted in five elementary schools from a North Texas school district. Data were examined for internal consistency, test‐retest reliability, concurrent validity with external measures, including DIBELS, TPRI, AND ITBS, and predictive validity with TAKS. Results show moderate to strong evidence of reliability and validity with regard to phonemic awareness, alphabetic knowledge, vocabulary, and reading comprehension.

 

ISIP Concurrent and Predictive Validity Study

April 16, 2007 (291KB)
In this study, concurrent validity information was gathered on ISIP (Istation's Indicators of Progress) kindergarten, first, second, and third grade benchmark assessments compared to Dynamic Indicators of Basic Early Literacy Skills kindergarten, first, second, and third grade benchmark assessments (DIBELS, Good, Kaminski, & Dill, 2002). Further, predictive validity information was gathered on ISIP third grade benchmarks compared to the Texas Assessment of Knowledge and Skills (TAKS) at third grade.

White Papers

These white papers detail the scientifically based methods that build the foundation of Istation's products.

Supporting SEL Through Tech: How blended learning can foster social-emotional development (2.0MB), Winter 2019

Predicting Student Performance on the Developmental Reading Assessment, 2nd Edition: An Independent Comparison of Two Different Tests
(1.4MB), March 2012
Results from an independent study using data gathered from K–5th grade students from the 2010–2011 school year in a large suburban district in Texas show (1) Istation's reading assessment, Istation's Indicators of Progress (ISIP), was moderately to highly correlated with the DRA2 and (2) Istation's ISIP was more highly correlated with the DRA2 than the Measures of Academic Progress (MAP) reading assessment was.

The effectiveness of Istation in a school: East Baton Rouge Parish School System (714KB), November 2011
This study describes the effects of using Istation in a single school. It compares performance at the beginning of the school year on EduSoft for English language arts with performance at the end of the school year on the same assessment for 1st through 5th grades. The results show a very dramatic increase in student performance at all levels, especially in 1st and 2nd grades.

Get 3 Steps to Accelerate Learning and Reimagine Intervention for Your School

The COVID-19 pandemic has been extremely disruptive to students’ learning. Even for students who could adequately access online and hybrid programs, wide and varied learning gaps emerged that will take time and effort to overcome.

Learn Why Measuring Oral Reading Fluency Is So Important

In today’s rapidly changing education landscape, leaders in the industry are embracing both technology and data to support educators and students in many ways. One of the basics of education is literacy, and oral reading fluency (ORF) is key to improving it. But why does this metric matter?

Interested in Learning More? Pilot Istation's Blended Learning Solutions

See results in 90 days with a free pilot of Istation's award-winning intervention program!

Pilot Istation's Blended Learning Solutions
20.Years.Badge.Small_4.5.18

8150 North Central Expy, Dallas, Texas 75206

1-866-883-READ (1-866-883-7323)

Copyright 2022 | Istation. All rights reserved.