Data collected for program evaluation that involves observations, interviews or making judgments and involves more than one person assigning the ratings independently must build in measures of which of the following?
A)construct validity
B)internal consistency
C)inter-rater reliability
D)test-retest

Question

Quizplus · Accepted Answer

Inter-rater reliability is the extent to which different raters or evaluators produce consistent ratings or judgments of the same phenomena, and is crucial when data is collected through observations, interviews, or judgments. Having more than one person assign the ratings independently and measuring the agreement among them helps to ensure the accuracy and consistency of the data, avoiding biases or idiosyncratic views that could affect the evaluation results. Construct validity refers to the extent to which a measurement tool or assessment captures the construct or theoretical concept it intends to measure, and is more related to the quality of the tool itself than to the data collected. Internal consistency and test-retest, on the other hand, are measures of the reliability of a measurement tool or assessment over time or across items or sections of the same assessment, and are less related to the evaluation of the program as a whole.

Data Collected for Program Evaluation That Involves Observations, Interviews or Making