Worked example 10: Urdu word list (60 s)

How to read this page. Section 1 is the printed text the child had in front of them, numbered in reading order. Section 2 is the 60-second clip, timed from the child's first word. Section 3 is what the speech-to-text service typed from that clip; the microphone hears the enumerator too, so prompts like "shabash" can appear between the child's words. Section 4 has one row per scorer with a colour chip for every printed word: the enumerator row is the live tablet marking, the official score; the baseline row is the first automatic method, which matches transcript words to printed words by spelling; each model row is that model's own judgement from the audio or from the transcript. Red where the enumerator has green means the scorer flagged too much; green where the enumerator has red means it waved a mistake through; grey means skipped or never reached; faded means no verdict. "Attempted" is the furthest word reached. Section 5's "difference from enumerator" is each scorer's correct count minus the enumerator's: near zero is good, a large positive number is too lenient, a large negative number too harsh. Section 6 is the second human's re-listen.

مچہلی بازار پانی کباب گہر قلم یہ کیا پڑہا ہی یہ کیا پڑہا ہی بستہ کمرہ استاد اسکول باغ پہر اگی پہر کرسی میز کاپی گایڈ کیا کیا دوسرا کیا یہ کیا پڑہا ہی روٹی درخت یہ کیا پڑہا ہی اسکول اگی اسکول دوست اگی ون اینڈ گین نہیں یہ کیا ہی بہایی بات باپ ماں ٹہیک ہی ٹہیک ہی ٹہیک ہی کہا جوتا کپڑا گیند کہیل کہیل اگی پڑہتی ہیں درخت سیر

The second human (fareeda) re-listened: on the correct count the reviewer disagreed with the enumerator; on the attempted count the reviewer disagreed with the enumerator; the enumerator followed the protocol. Reviewer comment: “The student read approximately 50 words, with around 7 observable misreadings. Based on audio review, the student’s performance appears higher than recorded, and the enumerator’s entries are inconsistent with observed attempts and correct responses. Therefore, the recorded data is considered inaccurate from the monitoring perspective.”