Assessment in Action: How Interactive Video Transforms Learning for Striving Students

Framework

You're right, and I apologize for including elements you didn't actually study. Let me revise the Perspective or Theoretical Framework to accurately reflect what your research actually examined:
Perspective or Theoretical Framework:
This research integrates several complementary theoretical frameworks to examine how interactive video with embedded assessment affects student achievement. Our design is fundamentally grounded in Mayer and Moreno's (2003) multimedia learning theory, which establishes that combining visual and auditory information reduces cognitive load while enhancing information processing. This theoretical principle directly informed our methodological approach to analyzing Edpuzzle's interactive video platform, where students engage with multimedia content enhanced by embedded assessment.
The study's longitudinal approach across two academic years builds upon Hopkins et al. (2016) findings on spaced retrieval practice, allowing us to investigate whether consistent engagement with embedded assessments correlates with improved achievement outcomes over time. We operationalized this through our usage dosage categories, comparing different levels of implementation to determine threshold effects—a direct application of retrieval practice theory in authentic classroom settings.
Our examination of the alignment between quiz scores within Edpuzzle and external standardized literacy assessments extends Vural's (2013) research on question-embedded video learning tools. By establishing correlations between in-platform performance and independent academic measures, we tested the theoretical proposition that embedded assessments accurately capture meaningful learning rather than merely measuring engagement. This approach addresses what Brame (2016) identified as a critical need to validate the effectiveness of interactive video features across diverse educational contexts.
The second phase of our research, which implemented a quasi-experimental design with Edpuzzle Original Math videos for grades 3-5, draws from Wise's (2019) framework for learning analytics. By comparing treatment and delayed implementation groups, we moved beyond correlation to examine causal relationships between interactive video with embedded assessment and student achievement. This design directly tests the theoretical proposition that properly designed interactive video content can significantly impact learning outcomes when consistently implemented.
By integrating these theoretical perspectives—multimedia learning, retrieval practice, embedded assessment validation, and implementation analytics—our research bridges cognitive science principles with practical implementation factors, providing evidence-based insights into how and why interactive video assessment impacts student achievement.

Methods

The study is a quasi-experimental examination of the impact of Edpuzzle Original Math videos on student achievement among 3rd- to 5th-grade students during the 2024-2025 school year. Treatment and comparison groups were established within a single California school district, with baseline equivalence confirmed through statistical testing. Hedges' g values between groups were within the What Works Clearinghouse (WWC) range for equivalence (< 0.25 standard deviations). As these differences exceeded 0.05, pretest scores were included as covariates in all impact estimation models, consistent with WWC standards for statistical adjustments.
The sample included students from multiple schools within the district, with balanced distribution between treatment and comparison classrooms. To ensure implementation fidelity, educators in treatment classrooms received professional development on integrating interactive video with embedded assessment into their math instruction. Implementation monitoring and district-leader encouragement (including pizza parties to high usage classrooms) were placed throughout the winter and spring. Student achievement was measured using both the NWEA MAP assessment (administered at three time points: Fall, Winter, and Spring) and California state standardized tests (CAASPP), providing multiple validated measures of academic outcomes.
Additional mixed-methods data collection included: (1) teacher surveys regarding perceptions of learning effectiveness and engagement and (2) interviews with educational leaders representing diverse roles within the district. This comprehensive approach allowed us to triangulate findings across quantitative achievement data and qualitative implementation experiences.

While the study was happening, we partnered with the school district to look back on learning from the previous year across all grades and subject areas. This correlational study with 2,913 students examines relationships between Edpuzzle usage metrics and standardized assessment outcomes. Statistical analyses included correlations and regressions controlling for student characteristics including baseline scores, economic status, gender, ethnicity, and English language status, allowing us to isolate the relationship between interactive video engagement and academic achievement.

Results

ESSA Tier 2 Study (Edpuzzle Original Math Videos)
The quasi-experimental study of Edpuzzle Original Math videos demonstrated significant positive effects on student achievement. Students in treatment classrooms showed greater growth on the NWEA MAP Math assessment compared to students in comparison classrooms. The effect size (Hedges' g) was 0.24, approaching the threshold for what the WWC considers a substantively important effect. This effect was particularly notable given the relatively short implementation period.
When examining state standardized test results (CAASPP), treatment students were significantly more likely to meet or exceed grade-level standards compared to control group peers (p < 0.05). Statistical analyses controlling for pretest scores, demographic factors, and prior achievement revealed that the intervention had differential effects across student subgroups. Economically disadvantaged students in the treatment group showed gains that were approximately 1.5 times larger than the overall treatment effect, suggesting the intervention was particularly beneficial for this population.
Teacher survey data revealed several implementation factors associated with stronger outcomes. Consistent implementation (2.5+ days per week) was significantly correlated with higher student achievement gains (r = 0.38, p < 0.01). Additionally, classrooms where teachers reported using the embedded assessment data to inform subsequent instruction showed stronger effects than those who used the videos without reviewing the assessment data (Δ = 0.18 standard deviations).
ESSA Tier 3 Study (Correlational Analysis)
The correlational study with 2,913 students demonstrated strong relationships between Edpuzzle performance and standardized assessment outcomes. Across grades 3-11, there was a positive, significant relationship between performance on Edpuzzle assignments and scores on both Star and CAASPP Math and Reading assessments.
For CAASPP assessments, students who scored higher on Edpuzzle assignments were more likely to achieve higher achievement levels. In 8th grade ELA, students in CAASPP Level 1 had an Edpuzzle grade average 29 points lower than students in CAASPP Level 4. Similar patterns were observed across grade levels and subjects, with consistently strong correlations between Edpuzzle performance and standardized assessment achievement.
To address potential selection bias, partial correlations were conducted controlling for student characteristics including baseline scores, economic status, gender, ethnicity, and English language status. All partial correlations remained positive and statistically significant after accounting for these covariates, ranging from r = 0.12 to 0.31. The robustness of these correlations after controlling for individual differences suggests the generalizability of findings to the broader student population.
Usage analysis revealed that students in high-usage classrooms (those with consistent Edpuzzle implementation) were significantly more likely to be proficient in both math and ELA compared to students in low-usage classrooms. Notably, the highest usage was found among older students (grades 8 and 9), especially in STEM subjects.
A key finding across both studies was that student performance was more consistent among classrooms using Edpuzzle Originals compared to teacher-created content, suggesting that professionally developed content with strategic embedded assessments may provide time savings for teachers plus learning benefits.

Importance

This research addresses critical gaps in understanding how interactive video with embedded assessment can be implemented effectively at scale to address persistent achievement gaps. The findings contribute to both theoretical understanding of multimedia learning with formative assessment and practical knowledge about implementation factors that influence outcomes.
A particularly significant contribution is the comparative performance of professionally developed Edpuzzle Original skills-aligned content versus teacher-created videos. With educators facing unprecedented time constraints and the proliferation of AI-generated educational content of variable quality, our research highlights the continued importance of expertly designed instructional materials. The improved student math performance observed with Edpuzzle Originals suggests that professionally developed content with strategically placed embedded assessments provides reliable learning benefits while reducing teacher workload.
This finding has broad implications for educational technology development and implementation. The most effective edtech products appear to be those offering a dual approach: empowering teachers with creation tools when they have the expertise and time, while also providing ready-made, research-validated content developed by subject matter experts. This balanced approach acknowledges both teacher autonomy and the reality of limited preparation time in most educational settings.
Furthermore, our research on implementation factors—particularly the significance of consistent usage patterns and strategic integration with classroom instruction—provides actionable guidance for schools deploying interactive video tools. By identifying specific threshold effects for implementation frequency and highlighting the importance of using assessment data to inform instruction, these studies move beyond simple efficacy questions ("Does it work?") to address the more nuanced reality of classroom implementation ("How and when does it work best, and for whom?").
For ISTE attendees, these findings provide evidence-based criteria for evaluating educational technology products, emphasizing the importance of tools that offer both creation flexibility and high-quality, ready-made content, validated through rigorous research methodologies aligned with ESSA standards.

References

Brame, C. J. (2016). Effective educational videos: Principles and guidelines for maximizing student learning from video content. CBE—Life Sciences Education, 15(4), es6.
Hopkins, R. F., Lyle, K. B., Hieb, J. L., & Ralston, P. A. S. (2016). Spaced retrieval practice increases college students' short- and long-term retention of mathematics knowledge. Educational Psychology Review, 28(4), 853-873.
Mayer, R. E., & Moreno, R. (2003). Nine ways to reduce cognitive load in multimedia learning. Educational Psychologist, 38(1), 43-52.
Vural, O. F. (2013). The impact of a question-embedded video-based learning tool on e-learning. Educational Sciences: Theory and Practice, 13(2), 1315-1323.
Wise, A. F. (2019). Learning analytics: Using data-informed decision-making to improve teaching and learning. In O. O. Adesope & A. G. Rud (Eds.), Contemporary technologies in education (pp. 119-143). Palgrave Macmillan.