Provider: OKO Labs
Program Description
OKO’s Let’s Talk is a collaborative math game in which an AI facilitator guides small groups of students through problems and prompts them to discuss their reasoning. In this study, 4th and 5th graders used it to practice fractions, and teachers were asked to run 20-minute sessions twice a week for two weeks.
Findings
- Promising results: Students’ fractions scores rose 7% from pre- to post-assessment (p = .006), and students reported significantly less math anxiety at the end of the study (p = .019).
- Classrooms used OKO on 5.3 days on average (range 2 to 8), with sessions averaging 13.9 minutes.
- In an exploratory look by grade, fourth graders’ fractions scores rose 11% (significant), while fifth graders’ rose 2% (not significant).
- No cost data were reported. There was no comparison group.
- Without a comparison group, the gains cannot be attributed to OKO. The sample was small and the study lasted only two weeks.
| Research Partner | WestEd |
| Study Year | 2023-24 |
| Study Location | 3 charter schools in Georgia and 1 public school in Tennessee |
| Modality | AI Platform with Small-Group Collaboration |
| Study Design | Pre-Post (no comparison group) |
| Total Sample | 299 students of 10 teachers (268 in the final analysis) |
| Characteristics of Treatment Group | Not reported |
| Subject | Math |
| Grades | 4, 5 |
| Average Actual Dosage | 5.3 days of use; 13.9 minutes per session |
| Scheduled Dosage | Two 20-minute sessions per week for two to three weeks |