Deck 11: Planning the Intervention Effect Evaluations

Question 1

Evaluation users should be involved with evaluation to:

A) judge the utility of the evaluation design.
B) know strengths and weaknesses of the evaluation.
C) identify differences in criteria for judging evaluation quality.
D) learn about methods.
E) All of these are correct.

Answer 1

E

Question 2

Which of the following goes beyond merely documenting that the objectives were met by quantifying the extent to which the interventions seem related to changes observed or measured among program recipients?

A) Outcome documentation evaluation
B) Outcome assessment evaluation
C) Outcome interpretation evaluation
D) Outcome progression evaluation

Answer 2

B

Question 3

Which of the following results from minimizing natural flaws associated with doing evaluations that might otherwise diminish the evaluator's ability to identify the amount of effect of the program?

A) Rigor
B) Quality
C) Accuracy
D) Precision

Answer 3

A

Question 4

Which of the following contributes to the difficulty in finding any effect from a program intervention? Select all that apply.

A) Having a weak or ineffective intervention
B) Having measures with low validity
C) Having measures with low reliability
D) Having low coverage

Question 5

The goal of evaluation is social accounting and program or policy decision making, and the goal of ________________ is to generate new knowledge for prediction.

Question 6

Techniques used to collect data are called ________________.

Question 7

A community agency wanted to know if its school condom distribution program was having an effect on rates of sexually transmitted diseases among teens. The only available and relevant secondary data was collected a few years prior, but the stakeholders did not believe that this data reflected their community. In addition, the local school board denied evaluators access to its students to collect evaluation data. Therefore, the program staff was forced to restate its question to focus on the number of students who received free condoms from the program over the past year. The revised evaluation question is what type of evaluation?

Question 8

Under what circumstance would missing data have only a minimal effect on the analysis and subsequent findings?

Question 9

State whether each of the following examples is an issue of reliability or validity:

A) Data entry errors
B) Only one reading taken by one evaluator for the data point in a study that uses blood pressure as one of the indicators
C) Administration of a food frequency questionnaire to a 7-year-old
D) A Likert scale survey question whose only options are "agree" and "disagree"

Question 10

Provide the correct example of measures of inputs or outputs for each term.
-Mediating variable

Question 11

Provide the correct example of measures of inputs or outputs for each term.
-Unit of observation

Question 12

Provide the correct example of measures of inputs or outputs for each term.
-Sensitivity

Question 13

Provide the correct example of measures of inputs or outputs for each term.
-Ordinal variable

Question 14

Provide the correct example of measures of inputs or outputs for each term.
-Interval variable

Question 15

Provide the correct example of measures of inputs or outputs for each term.
-Moderating variable

Question 16

Provide the correct example of measures of inputs or outputs for each term.
-Nominal variable