Establishment of which of the following is most important in ensuring that the results of any diagnostic test of speech or language are replicable?

• A. Content validity
• B. Interjudge reliability
• C. Split-half reliability
• D. Face validity

Answer: (B)

Replicability of diagnostic test results in speech and language hinges on consistency between evaluators. Different clinicians observing, rating, or scoring the same behaviors should reach similar conclusions when the scoring criteria are clear and applied the same way. This consistency across judges is interjudge reliability, and it is what makes results reproducible across different examiners and settings.

Content validity is about whether the test covers all the relevant aspects of the construct being measured, not how consistently different raters apply it. Face validity concerns whether the test appears to measure what it claims to measure, which doesn’t guarantee consistent scoring. Split-half reliability looks at the internal consistency of the test items—how well the items on the test relate to each other—rather than how different evaluators rate performance.

To strengthen interjudge reliability, use standardized procedures, detailed scoring rubrics, and training to calibrate raters. Then check agreement with statistics like percent agreement, Cohen’s kappa, or intraclass correlation.