Worked example 4: Urdu story (60 s)

How to read this page. Section 1 is the printed text the child had in front of them, numbered in reading order. Section 2 is the 60-second clip, timed from the child's first word. Section 3 is what the speech-to-text service typed from that clip; the microphone hears the enumerator too, so prompts like "shabash" can appear between the child's words. Section 4 has one row per scorer with a colour chip for every printed word: the enumerator row is the live tablet marking, the official score; the baseline row is the first automatic method, which matches transcript words to printed words by spelling; each model row is that model's own judgement from the audio or from the transcript. Red where the enumerator has green means the scorer flagged too much; green where the enumerator has red means it waved a mistake through; grey means skipped or never reached; faded means no verdict. "Attempted" is the furthest word reached. Section 5's "difference from enumerator" is each scorer's correct count minus the enumerator's: near zero is good, a large positive number is too lenient, a large negative number too harsh. Section 6 is the second human's re-listen.

اج بلال اپنی والد کی ساتہ دریا دریایی جہلم کی کناری گیا وہاں ٹہنڈی ہوا چل رہی تہی اور پانی اہستہ بہہ رہا تہا بلال نی کشتی کو حرکت کرتی دیکہا اس نی اس کی والد نی اسی بتایا کہ دریا ہماری ملک کی لیی اہم ہی واپسی پر بلال نی خودکشی کی لیی پتہر جمع کیی اور مسکراتا رہا وہ بہت خوش بہی تہا

The second human (muddasir) re-listened: on the correct count the reviewer agreed with the enumerator; on the attempted count the reviewer agreed with the enumerator; on orf_reading_sentences_urd the reviewer agreed with the enumerator; the enumerator followed the protocol.