Deck 6: Outcome Evaluation

Question 1

Which of the following is used to determine whether a program, project, or policy has been effective and met its intended goals?

A) Program evaluation
B) Program implementation
C) Outcome evaluation
D) Program effectiveness

Answer 1

C

Question 2

Which of the following measures the impact of a program by applying it to the treatment group, withholding it from the control group, and then measuring what happened as a result of the experiment?

A) Experimental group
B) Classical experimental design
C) Control group
D) Quasi-experimental design

Answer 2

B

Question 3

Which of the following is concerned with whether or not the program intervention and program outcomes are related?

A) Statistical conclusion validity
B) Construct validity
C) Internal validity
D) External validity

Answer 3

A

Question 4

Which of the following is concerned with whether or not the program intervention really did cause a change in program outcomes?

A) Statistical conclusion validity
B) Construct validity
C) Internal validity
D) External validity

Question 5

Which of the following is concerned with the adequacy of the operational definition of program outcomes and other measurements in the program evaluation that track program interventions?

A) Statistical conclusion validity
B) Construct validity
C) Internal validity
D) External validity

Question 6

Which of the following is concerned with the generalizability of program findings to other settings?

A) Statistical conclusion validity
B) Construct validity
C) Internal validity
D) External validity

Question 7

Which of the following is concerned with the adequacy of presentation of key evaluation features in the research report?

A) Descriptive validity
B) External validity
C) Internal validity
D) Construct validity

Question 8

Which type of design attempts to maintain some measure of experimental rigor and control over relevant variables other than the treatment by some method except random assignment?

A) Classical experimental design
B) Experimental group
C) Quasi-experimental design
D) Control group

Question 9

Which of the following clearly indicates that random assignment was not used to construct it?

A) Comparison group
B) Experimental group
C) Control group
D) Self-drop group

Question 10

Which of the following is created when people in a study are released or diverted elsewhere, thus effecting the results of the study?

A) Comparison group
B) Experimental group
C) Control group
D) Self-group group

Question 11

Which of the following is used to create treatment and comparison groups by using the likelihood of observed characteristic in the groups and balancing the groups in terms of these observed characteristics?

A) Experimental group
B) Propensity score matching
C) Quasi-experimental design
D) Classical experimental group

Question 12

Design features of a study where comparisons between performance are made with the same group pre-test and post-test to the experimental treatment are known as:

A) Experimental group
B) Quasi-experimental design
C) One-group time-series design
D) Before-and-after design

Question 13

Which of the following makes use of pre-test and post-test but also features more frequent measures taken before and after the introduction of the treatment variable?

A) Experimental group
B) Quasi-experimental design
C) One-group time-series design
D) Before-and-after design

Question 14

Which of the following describes the require?ment that the program response must precede the decline in the problem?

A) Causal time order
B) Validity
C) Reliability
D) Coherence

Question 15

The determination of whether any other factors were responsible for the program outcomes is known as:

A) Program integrity
B) ARIMA
C) Validity
D) Eliminating rival causal hypotheses

Question 16

Measures of program effectiveness are needed to help determine if the program was able to meet the needs of its target population.

Question 17

Efficiency measures gauge how quickly the program was implemented.

Question 18

The key feature of the classical experimental design is that the groups are selected at random from a pool of candidates from the target population that the program is designed to serve.

Question 19

The purpose of random assignment is to guarantee that the two groups are equal and alike in every aspect except for their exposure to the program.

Question 20

Changing the instrument (or measurements) used between the pre-test and post-test will improve program effectiveness.

Question 21

If any factors other than random assignment played a role in the assignment of individuals to the experimental and control groups, selection bias is in play.

Question 22

Contamination of data occurs when the program evaluator remains in control of the experiment and neither the experimental nor the control groups are exposed to the treatment.

Question 23

Reactive effect of pre-testing is when a pre-test ensures the lack of sensitivity of the research subjects.

Question 24

The reactive effect of experimental procedures is when the experiment is a treatment in and of itself if the subjects become aware of the fact that they are being studied.

Question 25

The quasi-experimental design attempts to ensure the similarity of the treatment and comparison groups and requires that only the experimental group is involved in the program.