Question 1

Which of the following is not correct with respect to process evaluations?

Accepted Answer

This statement is not correct as process evaluations do not guarantee a direct link between program implementation and outcome measures, but they can provide valuable information on the processes involved in achieving outcomes.

Question 2

If the number of subjects in a program is small, statistical tests can detect only very large program effects of differences in outcome measures between the two groups.This illustrates the problem of _____.

Accepted Answer

Statistical conclusion validity refers to the extent to which statistical tests are able to detect true differences between groups. In the case of small sample sizes, statistical tests may only be able to detect very large program effects, making it difficult to draw conclusions about the effectiveness of the program.

Question 3

Program evaluation differs from policy analysis with respect to _____.

Accepted Answer

Program evaluation focuses on evaluating the effectiveness and efficiency of an existing program, while policy analysis is concerned with identifying potential policy options and their potential impacts before implementation. Therefore, program evaluation occurs after a policy has been implemented, while policy analysis occurs beforehand. This difference in timing is the primary way in which program evaluation differs from policy analysis. Cost, time, and stakeholder involvement are considerations in both program evaluation and policy analysis but are not unique differences between the two.

Question 4

Program goals represent _____.

Accepted Answer

Program goals represent the desired outcomes that a program intends to achieve. Empirical indicators are the measurable data that are used to determine whether or not the program has achieved its goals. Inputs are the resources that are used to implement the program, and standards are the criteria that are used to evaluate the program's success or failure.

Question 5

In the home detention studies used in your text as examples of randomized studies, the authors concluded that _____.

Accepted Answer

The authors of the home detention studies concluded that randomization does not control for variation in treatment integrity and program delivery, suggesting that other measures should be taken to ensure consistency in these areas. They did not specifically mention that randomization allows for generalization or reliability.

Question 6

Policy analysis searches for _____.

Accepted Answer

The answer of Policy analysis searches for _____.
...

Question 7

The relationship between policy analysis and program evaluation is best characterized as _____.

Accepted Answer

Policy analysis and program evaluation are closely related. Policy analysis sets goals and objectives, while program evaluation tests the achievement of these goals and objectives. Both rely upon clearly specified goals and objectives. Therefore, both A and B are correct. There is a strong relationship between policy analysis and program evaluation. Option D is incorrect.

Question 8

Any public policy discussion involves politics.Which of the following is not accurate with respect to ethics and the political aspects of applied research?

Accepted Answer

While there are formal codes of accepted ethical conduct for researchers, there is no formal code of accepted political conduct. Therefore, option B is not accurate.

Question 9

Relating to randomization, which of the following statements is inaccurate?

Accepted Answer

When exceptions to random assignment are made, bias can enter the selection process, as certain factors may influence whether someone is assigned to the experimental or control group. Therefore, statement B is inaccurate.

Question 10

Randomized experiments for evaluation purposes require which of the following?

Accepted Answer

Randomized experiments require a sufficient number of subjects in both the experimental and control groups, which depends on the case flow. The other options are not necessary requirements for randomized experiments, although they may be desirable in certain situations.

Question 11

With regard to evaluation designs, which of the following statements is not accurate?

Accepted Answer

Controlled variation in treatment is actually necessary to evaluate the effectiveness of a program. This allows researchers to identify which components of the program are most effective and can be replicated in other contexts. Uncontrolled variation in treatment, on the other hand, can make it difficult to attribute outcomes to the program itself. Variation in levels of treatment can also threaten validity, as it may lead to unequal exposure to the independent variable among study groups. Varying degrees of participation by clients can impact outcomes, as those who are more engaged in a program may experience greater benefits.

Question 12

Dr.Smith is interested in implementing a program that is designed to reduce the recidivism rates of property offenders.He selects two state prisons and, with the blessing of the Department of Corrections, begins the programs in the main state prison for males and a female institution that is nearby.Which design would be best for Dr.Smith to use?

Accepted Answer

Given the context, a non-equivalent groups design is most suitable because Dr. Smith is working with two pre-existing groups (male and female prisoners in different institutions) where random assignment to treatment and control conditions is not feasible. This design allows for comparison between groups that are not randomly assigned.

Question 13

Problem analysis, coupled with scientific realism, helps public officials use:

Accepted Answer

Problem analysis, coupled with scientific realism, helps public officials to select and assess alternative courses of action based on the research findings. It allows them to make evidence-based decisions and choose the most effective policy options. While research can also be used to measure the effects of policies and determine which program to start, these options do not fully capture the comprehensive use of problem analysis and scientific realism.

Question 14

Randomization may not be appropriate for assignment of people to treatment or programs for all of the following reasons except _____.

Accepted Answer

Agency support is not a reason why randomization may not be appropriate for assignment of people to treatment or programs, but practical, ethical, and legal reasons may make it necessary to use alternative assignment methods.

Question 15

Problem solving is a fundamental tool in problem-oriented policing and involves which one of the following analytic steps?

Accepted Answer

The answer of Problem solving is a fundamental tool in...

Question 16

Policy analysis is used to _____.

Accepted Answer

Policy analysis is a process of evaluating existing policies, identifying problems, and developing alternative courses of action. The objective is to make informed decisions about policies and programs that are based on evidence and analysis, rather than ideology or intuition. Hence, policy analysis is used to help design alternative courses of action.

Question 17

Treatment integrity is _____.

Accepted Answer

The answer of Treatment integrity is _____.
...

Question 18

Scientific realism is rooted in the principle that:

Accepted Answer

The answer of Scientific realism is rooted in the principle...

Question 19

What can be said about the relationship between process evaluations and impact assessments?

Accepted Answer

Process evaluations and impact assessments are both important components of program evaluation. While process evaluations monitor program implementation, impact assessments measure a program's effects. Process evaluations can provide valuable information that can be used to interpret results from an impact assessment. Therefore, A) is the best choice. B) is incorrect because impact assessments do measure a program's effects. C) is incorrect because process evaluation can be used in interpreting outcomes. D) is incorrect because there is a relationship between the two evaluations.

Question 20

When dealing with stakeholders a researcher should be aware of all of the following except _____.

Accepted Answer

It's not appropriate for a researcher to get particularly friendly with stakeholders as this may compromise the integrity of the research. The researcher should maintain a professional and objective relationship with all stakeholders.

Quiz 10: Evaluation Research and Problem Analysis