Deck 7: Evaluating

Question 1

Evaluation is used to determine all the following except:

A) if the program was effective.
B) if the program did what it was intended to do.
C) if the program used resources wisely.
D) if the program warrants expansion.

Answer 1

D

Question 2

If the planning committee wants to know the impact of implementation on program effectiveness, which evaluation would provide this information?

A) Outcome evaluation
B) Process evaluation
C) Impact evaluation
D) Summative evaluation

Answer 2

B

Question 3

To determine if the program objectives were met, the planning committee would conduct which type of evaluation?

A) Formative evaluation
B) Summative evaluation
C) Process evaluation
D) Progress evaluation

Answer 3

B

Question 4

The difference between short-term and long-term outcome evaluation lies in:

A) when they are done.
B) who is responsible for conducting them.
C) the length of time each take to analyze.
D) the type of data collected.

Question 5

Short-term changes occurring from program participation are determined by:

A) calculating the difference between pre- and posttest data.
B) observing participants at the final program session.
C) interviewing program presenters.
D) conducting participant and presenter focus groups.

Question 6

Which type of evaluation would provide evidence to verify the changes that occurred resulted from the program?

A) Process
B) Outcome
C) Impact
D) Confirmatory

Question 7

Non-experimental evaluation designs:

A) provide evidence that changes in the program participants were caused by the program.
B) use non-random sample control groups.
C) rely on observation to determine program effectiveness.
D) determine the extent participants learned the information or have a skill addressed by the program.

Question 8

When using the CDC's Framework for Program Evaluation in Public Health, it's critical to:

A) select from among the 30 standards to meet those that most strongly align with the program.
B) complete all the steps of the framework and to complete them in order.
C) use an experimental design for the evaluation.
D) collect quantitative data from the entire population of program participants.

Question 9

If the intent is to give every program participant an equal chance at being included in the evaluation sample, which sampling method would be used?

A) Purposive sampling
B) Random sampling
C) Chance sampling
D) Quota sampling

Question 10

If 60 people enroll for a program that consists of four sessions, and an average of 45 people attend each session, and those attending the fourth session are asked to participate in the evaluation, this is an example of:

A) convenience sampling.
B) average sampling.
C) self-selection sampling.
D) stratified random sampling.

Question 11

Confidence level refers to:

A) the certainty of the accuracy of data analysis.
B) the percent of time the sample results would match the results from the entire population of program participants.
C) the extent to which results can be validated.
D) the degree of trust the planning committee has in the evaluation sample to answer honestly.

Question 12

A margin of error of 3% means:

A) the evaluation results might be off by 3%.
B) there is a 3% chance the results are incorrect.
C) 97% of the participants completed the evaluation accurately.
D) 97% of the results are accurate.

Question 13

A 95% confidence level with a 5% margin of error means:

A) 95% of the time, the sample and population results differ by no more than 5%.
B) 95% of the results are accurate, while 5% are inaccurate.
C) 95% of the participants completed the evaluation honestly, while 5% did not.
D) 95% of the planning committee trusts the evaluation results, while 5% do not.

Question 14

A critical factor contributing to the accuracy of the evaluation results from the sample is:

A) the type of data collected.
B) the method used to collect data from the sample.
C) when the data are collected.
D) the size of the sample.

Question 15

To validate that changes in the participant group resulted from the program:

A) a control group is needed.
B) the sample used is larger than what is used.
C) involvement in the evaluation is restricted to those who attended all program sessions.
D) data collection is done by in-person interview.

Question 16

Using an experimental design to conduct an evaluation entails all the following except:

A) creating a control group.
B) piloting the program before implementation.
C) using random sampling techniques.
D) collecting pretest and posttest data.

Question 17

A sample is used for an evaluation when it's not possible to include the entire population of program participants.

Question 18

If a sample is representative of the population, the evaluation results will reflect the results that would have been generated if the entire population had participated in the evaluation.

Question 19

A standard sample size is 100.

Question 20

Results of an impact evaluation provide the evidence needed for making decisions about program continuation, revision expansion, or replication.