Deck 14: Evaluation Approaches and Designs

Question 1

The degree to which a program, activity, or service is tailored to the priority population is called

A) justification.
B) consumer orientation.
C) inclusion.
D) interaction.

Answer 1

consumer orientation.

Question 2

The presence of any confounding factors in the environment that may affect program participation or initial results is known as

A) dose.
B) reach.
C) support.
D) context.

Answer 2

context.

Question 3

Which of the following is NOT an example of an element of process evaluation?

A) Fidelity
B) Capacity
C) Response
D) Context

Answer 3

Capacity

Question 4

Qualitative, in-depth interviews with individuals who understand the priority population are called

A) informal interviews.
B) substantive interviews.
C) key-informant interviews.
D) targeted-individual interviews.

Question 5

Which of the following is the type of bar or line chart that displays a program's time line or project schedule?

A) Gantt chart
B) Protocol Check sheet
C) Qualitative Circles
D) Program Forms

Question 6

Which of the following is NOT a qualitative method commonly used in evaluation?

A) Historical analysis
B) Time-series
C) Case studies
D) Nominal group process

Question 7

Which one of the four premises below applies to using control groups in social program evaluation?

A) Individuals should not be restricted to the status-quo
B) Individuals should not be informed of the purpose in order to avoid bias
C) Individuals should be informed when they will be subjected to ineffective or harmful programs
D) Individuals have a right to new services, and random selection gives all a chance to participate

Question 8

A ________ analysis can to determine the profit received from the dollars invested in the program.

A) cost-identification
B) cost-benefit
C) cost-utility
D) cost-objective

Question 9

When individuals cannot be randomly assigned to an experimental or control group, this nonequivalent group may be formed.

A) Experimental group
B) Intervention group
C) Control group
D) Comparison group

Question 10

Which of the following designs would be considered the gold standard to limit internal and external threats of validity?

A) Non-Experimental
B) Quasi Experimental
C) Experimental pretest /posttest design
D) Experimental Posttest design

Question 11

A threat to internal validity that involves the increased in strength due motor unit recruitment (meaning the body increases strength due to more muscle fibers being recruited by the nervous system and not muscle mass gain) is considered

A) maturity.
B) testing.
C) instrumentation.
D) selection.

Question 12

A threat to external validity that occurs when attitudes projected onto individuals cause them to act in a certain way is called the

A) Hawthorne effect.
B) placebo effect.
C) social desirability effect.
D) expectancy effect.

Question 13

Process evaluation focuses on making changes during the program to improve the quality of the program.

Question 14

Pilot testing involves collecting baseline data prior to the program implementation that will be compared with posttest data to measure the effectiveness of the program.

Question 15

The quantitative approach is inductive.

Question 16

The only effective way to combine quantitative and qualitative evaluation methods is to use qualitative methods to help develop quantitative measures and instruments.

Question 17

Quasi-experimental methods are much less stressful on program participants than experimental methods.

Question 18

A good example of observation in evaluation design would be pretests and posttests.

Question 19

The design O₁ X O₂ is a diagram of a quasi-experimental pretest posttest design.

Question 20

The threat to internal validity called attrition refers to having participants leave the study between pretest and posttest.

Question 21

A study wherein participants, planners, nor evaluators know which group participants are in is called a triple blind study.

Question 22

List five questions you should ask yourself before choosing an evaluation design.

Question 23

List three examples of potential threats to internal validity.

Question 24

What is a major method to control for threats to internal validity?

Question 25

Four threats to external validity are

Question 26

List and describe the three types of blinding.