Question 1

What would a minority impact statement tell us about a potential policy alternative?

Accepted Answer

It would inform us whether this alternative has the potential to differentially impact minority groups.

Question 2

What type of work is forward-looking and helps us solve anticipated problems?

Accepted Answer

Policy analysis

Question 3

What type of evaluation helps understand whether we have theory failure or implementation failure in a program that is not working?

Accepted Answer

Process evaluation

Question 4

How does a black box evaluation differ from a clear box?

Accepted Answer

The answer of How does a black box evaluation differ...

Question 5

Why would a one-group before-after design be less desirable for a program evaluation?

Accepted Answer

The answer of Why would a one-group before-after design be...

Question 6

Why is feedback critical when evaluating policies and programs?

Accepted Answer

The answer of Why is feedback critical when evaluating policies...

Question 7

Which of the following is the broadest?

Accepted Answer

A policy is a broad set of principles or guidelines that provide a framework for decision-making and action within an organization or government. It is more comprehensive than a program, project, or objective.

Question 8

Which of the following is a type of program evaluation?

Accepted Answer

Process evaluation is a type of program evaluation that focuses on the implementation process of a program or intervention. Content analysis is a research method used to analyze qualitative data, not specifically related to program evaluation. Unit of analysis refers to the level at which data is analyzed, and evaluability analysis is a pre-evaluation tool used to determine whether a program can be effectively evaluated.

Question 9

In the classic system model used to explain policy development, ______ hopefully lead to desirable outcomes or impacts?

Accepted Answer

In the classic system model, inputs are the resources put into the policy development process, activities are the actions taken to create the policy, and alternative approaches are considered. However, the ultimate goal is to produce outputs that will hopefully lead to desirable outcomes or impacts. Therefore, the best choice is C, outputs.

Question 10

In the system model of policy development, we must generate ____________ and then consider whether changes are necessary.

Accepted Answer

Feedback is necessary to evaluate the effectiveness of a policy and determine if changes are needed.

Question 11

Sam works with an agency to observe a program as it is being implemented. She compares the current implementation procedures to what the agency wrote on their proposal to see if they are handling implementation properly. Sam is currently doing a ____________.

Accepted Answer

Sam is monitoring the implementation process to ensure proper execution of the program. This is an example of process evaluation, which focuses on understanding how a program or policy is being implemented and if it is being implemented as intended. Outcome evaluation, on the other hand, assesses the effectiveness of the program or policy in achieving its intended outcomes. Policy analysis is a broader term that refers to the study of public policies and their impact. Ex ante evaluation is a type of evaluation that is conducted before a program or policy is implemented to assess its potential effects.

Question 12

Tanya was asked to study a court-ordered anger management program to see if participants are less likely to recidivate than a similar group of students who do not participate in anger management. In this situation, Tanya is doing a ____________.

Accepted Answer

Tanya's study is focused on determining the outcomes of the anger management program, specifically if it leads to a lower likelihood of recidivism. Therefore, she is conducting an outcome evaluation.

Question 13

Rueben is on a committee tasked with making a recommendation to the county about what to do with inmates. The jail is 100% full, and the committee needs to decide whether to build a new jail, expand the existing one, or recommend making more use of community corrections alternatives. In this case, Rueben and his colleagues are doing a _______________.

Accepted Answer

Rueben and his committee are conducting a policy analysis as they are examining the different options available to address the issue of overcrowding in the jail. A process evaluation would focus on how well a program or process is being implemented, while an outcome evaluation would assess the effectiveness of the chosen solution. An impact evaluation would focus on the broader societal effects of the chosen solution.

Question 14

What type of evaluation would allow researchers to get some information about how the program was implemented?

Accepted Answer

Gray box evaluation would allow researchers to gather some information about how the program was implemented. This type of evaluation involves some knowledge about the program but not complete understanding of all the details. It is more open than black box evaluation but less detailed than clear box evaluation. This type of evaluation is useful in determining the strengths and weaknesses of a program's implementation. Evaluability assessment is a type of pre-evaluation that assesses if the program is ready to be evaluated.

Question 15

Researchers who are unsure if they should evaluate a program might want to do a(n) ______ first.

Accepted Answer

An evaluability assessment is a tool used to determine if a program is ready to be evaluated. It involves reviewing program documentation, speaking with program staff, and assessing the feasibility and readiness of an evaluation. This helps researchers make informed decisions about whether or not to conduct an evaluation and can also identify potential challenges to conducting an evaluation. Therefore, option D is the best choice.

Question 16

After a systematic review, there is evidence that _________, a technique that involves analysis of crime locations and extra attention given to those areas is an effective policing practice.

Accepted Answer

The technique described in the question, which involves analysis of crime locations and extra attention given to those areas, is known as hotspots policing. A systematic review has found evidence that this practice is effective, making option C the correct answer. Reactive policing refers to responding to crimes after they have occurred, whereas intelligence-led policing involves using data analysis and intelligence to prevent crime. Combative policing is not a recognized term in policing practices.

Question 17

The ________ is an organization that encourages the production of systematic reviews so we can learn what works in criminal justice.

Accepted Answer

The Campbell Collaboration is specifically focused on promoting the production of systematic reviews in order to determine effective practices in criminal justice, among other fields. The Academy of Criminal Justice Sciences and the American Society of Criminology are broader organizations focused on all aspects of criminal justice research and education, while the National Institute of Justice is a government agency focused on funding and conducting research on criminal justice issues.

Question 18

Policy analysis and program evaluation are types of what kind of research?

Accepted Answer

Policy analysis and program evaluation are both examples of applied research, which focuses on solving practical problems and addressing specific issues or challenges. This type of research is typically conducted in real-world settings and involves designing, implementing, and evaluating interventions or programs aimed at achieving specific outcomes or objectives. While some applied research may involve exploratory or descriptive methods, the ultimate goal is to inform decision making and improve the effectiveness of policies or programs.

Question 19

If, when evaluating a program, you find you did everything correctly but the outcome was negative, you have what is called ____________________.

Accepted Answer

Theory failure occurs when the underlying assumptions or theories guiding the program's design and expected outcomes are incorrect, leading to negative results despite correct implementation.

Question 20

Policy analysis is an evaluation of a program to find whether it is producing the desired outcomes.

Accepted Answer

The answer of Policy analysis is an evaluation of a...

Quiz 12: Policy Analysis and Program Evaluation