What term describes the consistency of test results across different examiners?

Prepare for the ETS Form 1 Exam. Use flashcards and multiple choice questions with hints and explanations. Ace your exam with confidence!

Multiple Choice

What term describes the consistency of test results across different examiners?

Explanation:
Consistency of scoring across different examiners is measured by interjudge reliability. When multiple examiners evaluate the same response, you want their judgments to align, so the score reflects the respondent’s performance rather than any single scorer’s bias or interpretation. Interjudge reliability captures that agreement, and it’s especially important for performance-based or subjective assessments where scoring involves judgment calls. If raters apply the criteria similarly, you’ll see high agreement, which can be quantified with statistics like Cohen’s kappa for categorical ratings or intraclass correlation for continuous scores. In contrast, content validity asks whether the items cover the intended material, not how consistently different raters score them. Test-retest reliability looks at whether the same person would receive similar scores if they took the test again later. Face validity is about whether the test appears appropriate at face value, not about scorer agreement.

Consistency of scoring across different examiners is measured by interjudge reliability. When multiple examiners evaluate the same response, you want their judgments to align, so the score reflects the respondent’s performance rather than any single scorer’s bias or interpretation. Interjudge reliability captures that agreement, and it’s especially important for performance-based or subjective assessments where scoring involves judgment calls. If raters apply the criteria similarly, you’ll see high agreement, which can be quantified with statistics like Cohen’s kappa for categorical ratings or intraclass correlation for continuous scores.

In contrast, content validity asks whether the items cover the intended material, not how consistently different raters score them. Test-retest reliability looks at whether the same person would receive similar scores if they took the test again later. Face validity is about whether the test appears appropriate at face value, not about scorer agreement.

Subscribe

Get the latest from Passetra

You can unsubscribe at any time. Read our privacy policy