Self-regulated learning and treatment effect heterogeneity in educational interventions : a formal model and simulation study

Date

2023-04-18

Authors

Schuetze, Brendan Alexander

Journal Title

Journal ISSN

Volume Title

Publisher

Abstract

Research has shown that many interventions or field experiments in education result in effects that are either non-significant or conventionally considered small. Perhaps more concerningly, the interventions with the largest sample sizes and strongest grant-funding support tend to show the smallest effects, with an average of only one-twentieth of a standard deviation of benefit across the entire sample. It appears that few, if any, educational interventions have large or uniform effects across student populations. Rather, it is commonly observed that only small sub-samples of students benefit from any one educational intervention. As a result, educational researchers have called for a “heterogeneity revolution” that will illuminate these sources of variation in treatment effects across sub-populations. Given the recency of these calls, there are many open questions about how to best model sources of variation. At present, most analyses of heterogeneity in education use relatively crude analyses, focused on demographic factors, such as socio-economic status or cultural background, as potential moderators of effects. Though demographic factors are not moderators of interventions in-and-of-themselves (they are proxy variables), there is little existing educational theory to explain this heterogeneity in terms of fundamental self-regulated learning processes known to underlie educational success.

I propose a formal model of intervention effectiveness grounded in self-regulated learning called the Learning Production Function. This model allows for evaluating the joint effects of motivational, cognitive, and metacognitive interventions on populations of learners differing in terms of motivation, learning speed, metacognitive accuracy, and prior knowledge. Given this model, I conduct a simulation study. Using this simulation to model different intervention-student combinations, I answer questions such as: “which groups of learners would benefit from motivational interventions?” and “why do large effects of study strategies in laboratory studies fail to translate to self-regulated learning contexts?” This model advances the field’s understanding of different classes of educational interventions, why they work, who they benefit, and how to best combine interventions to help both at-risk and high-achieving student populations. Furthermore, this present dissertation improves upon educational theories by moving beyond “box and arrow” linear mediation models to more formalized understanding of the effects of educational interventions.

Description

LCSH Subject Headings

Citation