Worked example 5: English story (60 s)

Recording AA_b68b3349-… · grade 2 · age 7 · enumerator #49 · window 1083–1108 s of the session, 60-s clock from the child's first word at 1083.4 s

How to read this page. Section 1 is the printed text the child had in front of them, numbered in reading order. Section 2 is the 60-second clip, timed from the child's first word. Section 3 is what the speech-to-text service typed from that clip; the microphone hears the enumerator too, so prompts like "shabash" can appear between the child's words. Section 4 has one row per scorer with a colour chip for every printed word: the enumerator row is the live tablet marking, the official score; the baseline row is the first automatic method, which matches transcript words to printed words by spelling; each model row is that model's own judgement from the audio or from the transcript. Red where the enumerator has green means the scorer flagged too much; green where the enumerator has red means it waved a mistake through; grey means skipped or never reached; faded means no verdict. "Attempted" is the furthest word reached. Section 5's "difference from enumerator" is each scorer's correct count minus the enumerator's: near zero is good, a large positive number is too lenient, a large negative number too harsh. Section 6 is the second human's re-listen.

1. What the child was supposed to read

1. imran 2. woke 3. up 4. early 5. for 6. school 7. today 8. his 9. class 10. was 11. planting 12. trees 13. he 14. took 15. a 16. small 17. plant 18. in 19. a 20. bag 21. the 22. teacher 23. asked 24. imran 25. to 26. show 27. the 28. class 29. how 30. to 31. plant 32. it 33. imran 34. dug 35. a 36. hole 37. put 38. the 39. plant 40. in 41. the 42. soil 43. and 44. put 45. water 46. in 47. it 48. the 49. teacher 50. was 51. happy 52. with 53. his 54. work 55. his 56. friends 57. clapped 58. for 59. him

The study export holds only right/wrong flags, not the text itself, so this text was reconstructed from 30 children's reads with an LLM; a word or two of it may itself be wrong, which would show up as the same "mistake" in every scorer's row.

2. The child's audio

Play the 60-second clip (Drive, Taleemabad accounts)
8 kHz classroom recording from the May 2026 study, upsampled. Folder: worked-examples clips

3. What the speech-to-text service heard

m p r a s t l o r p u p c a r y l e o r o s t h o l

whisper-1 forced to English · 26 words inside the 60-s window. The enumerator's own words (prompts, "shabash") are included when they fall inside the window.

4. Every scorer's verdict on every word

read correctly wrong skipped or not reached no verdict

Enumerator (tablet, live)
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 5 attempted in 60 s (words after the 60-second point are grey: the export records 0 for both "correct" and "never reached", so they are only known up to the attempted count)
Baseline: speech-to-text + spelling alignment
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
2 correct of 59 attempted; 0 extra words the child said are ignored
Gemini 3.1 Pro · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
20 correct of 20 attempted · model note: The child spells out each word before pronouncing it correctly. Reads up to 'bag'.
Gemini 3.8 Flash · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
5 correct of 7 attempted · model note: The child spelled words letter-by-letter, omitting the whole-word pronunciation for the first two words before reading words 3-7 correctly a…
Gemini 3.5 Flash-Lite · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 1 attempted · model note: The child attempted only one word and mispronounced it.
Gemini 2.5 Flash · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
6 correct of 6 attempted · model note: The child stopped reading after 15 seconds.
GPT audio · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
The model returned no usable answer for this window (its reply was not in the requested format).
GPT audio mini · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
59 correct of 59 attempted · model note: All words were read correctly.
MiMo 2.5 · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 59 attempted · model note: Child struggles significantly; attempts all words but pronunciation is largely incorrect or unrecognizable (sounds like 'an/an', 'I', 'it', …
Nemotron omni · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
59 correct of 59 attempted · model note: Child read all words correctly.
Voxtral small · audio
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
59 correct of 59 attempted · model note: The child read the entire text correctly.
Claude Sonnet 5 · transcript
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 26 attempted · model note: Transcript consists of disconnected letter/sound fragments not matching the printed words; treated as 26 unintelligible/incorrect attempts f…
GPT-5 mini · transcript
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 26 attempted · model note: Transcript contains non-word tokens; first 26 printed words were attempted (no clear correct readings), remaining words were not attempted.
Gemini 3 Flash · transcript
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
1 correct of 6 attempted · model note: The child struggled significantly, attempting to sound out letters or mispronouncing the first few words before stopping.
DeepSeek 3.2 · transcript
imranwokeupearlyforschooltodayhisclasswasplantingtreeshetookasmallplantinabagtheteacheraskedimrantoshowtheclasshowtoplantitimrandugaholeputtheplantinthesoilandputwaterinittheteacherwashappywithhisworkhisfriendsclappedforhim
0 correct of 1 attempted · model note: The transcript 'm p r a s t l o r p u p c a r y l e o r o s t h o l' does not correspond to any recognizable words from the text; it appears…

5. The counts

ScorerWords correctWords attempted (furthest word reached)Difference from enumerator (correct)Difference (attempted)
Enumerator05+0+0
Baseline: speech-to-text + alignment259+2+54
Gemini 3.1 Pro · audio2020+20+15
Gemini 3.8 Flash · audio57+5+2
Gemini 3.5 Flash-Lite · audio01+0-4
Gemini 2.5 Flash · audio66+6+1
GPT audio · audio——no usable answer—
GPT audio mini · audio5959+59+54
MiMo 2.5 · audio059+0+54
Nemotron omni · audio5959+59+54
Voxtral small · audio5959+59+54
Claude Sonnet 5 · transcript026+0+21
GPT-5 mini · transcript026+0+21
Gemini 3 Flash · transcript16+1+1
DeepSeek 3.2 · transcript01+0-4

6. The second human

The second human (fareeda) re-listened: on the correct count the reviewer agreed with the enumerator; on the attempted count the reviewer agreed with the enumerator; on orf_reading_sentences_eng the reviewer agreed with the enumerator; the enumerator followed the protocol.