Collaborative Math Learning Facilitated by an Intelligent Agent

Provider: OKO Labs

Program Description

OKO’s Let’s Talk is a collaborative math game in which an AI facilitator guides small groups of students through problems and prompts them to discuss their reasoning. In this study, 4th and 5th graders used it to practice fractions, and teachers were asked to run 20-minute sessions twice a week for two weeks.

Findings
  • Promising results: Students’ fractions scores rose 7% from pre- to post-assessment (p = .006), and students reported significantly less math anxiety at the end of the study (p = .019).
  • Classrooms used OKO on 5.3 days on average (range 2 to 8), with sessions averaging 13.9 minutes.
  • In an exploratory look by grade, fourth graders’ fractions scores rose 11% (significant), while fifth graders’ rose 2% (not significant).
  • No cost data were reported. There was no comparison group.
  • Without a comparison group, the gains cannot be attributed to OKO. The sample was small and the study lasted only two weeks.
Research PartnerWestEd
Study Year2023-24
Study Location3 charter schools in Georgia and 1 public school in Tennessee
Modality AI Platform with Small-Group Collaboration
Study DesignPre-Post (no comparison group)
Total Sample299 students of 10 teachers (268 in the final analysis)
Characteristics of Treatment GroupNot reported
SubjectMath
Grades4, 5
Average Actual Dosage5.3 days of use; 13.9 minutes per session
Scheduled DosageTwo 20-minute sessions per week for two to three weeks


Stay Connected!

Learn What’s Working for Students

Get the latest from Accelerate, including news, insights, and updates on our work.

Subscribe
Captcha