Reading counts: machine vs enumerator per subtask, with window-failure split
| subtask | n | window_fail_pct | n_ok | r | MAE | bias | within3 | within5 |
|---|---|---|---|---|---|---|---|---|
| idwrd_eng | 137 | 28 | 98 | 0.93 | 5.9 | -4.7 | 47 | 60 |
| idwrd_urd | 157 | 12 | 138 | 0.97 | 5.9 | -5.5 | 43 | 57 |
| letterid_eng | 170 | 62 | 64 | 0.95 | 11.7 | -5.5 | 14 | 16 |
| letterid_urd | 154 | 84 | 25 | 0.71 | 11.4 | -11.1 | 24 | 28 |
| orf_eng | 109 | 20 | 87 | 0.97 | 5.6 | -2.0 | 43 | 64 |
| orf_urd | 137 | 24 | 104 | 0.98 | 10.4 | -9.6 | 29 | 35 |
| pw_eng | 132 | 24 | 100 | 0.24 | 2.2 | -0.3 | 70 | 91 |