Question 1

A cost-benefit analysis compares the monetary cost of operating a program to the

Accepted Answer

A cost-benefit analysis compares the monetary cost of operating a program to the monetary equivalent of the benefits provided by the program. Intangible benefits and costs may be considered in the analysis, but they must be translated into monetary terms in order to be compared to the program's monetary cost. Staff resistance to the time it takes to implement the program is not a factor in a cost-benefit analysis.

Question 2

A ________ analysis compares the dollar cost of operating a program to the dollar benefits that occur when objectives are achieved.

Accepted Answer

A cost-benefit analysis is a technique used to compare the costs of operating a program to the benefits that are achieved through the program. This analysis helps decision-makers determine whether the benefits of a program outweigh the costs, and whether the program should be continued or modified in some way. By comparing the costs and benefits in dollar terms, decision-makers can make informed decisions about how best to allocate resources and achieve program objectives.

Question 3

A ________ analysis compares the cost of a program to the size of its outcomes.

Accepted Answer

A cost-effectiveness analysis compares the cost of a program to the size of its outcomes. It is different from a cost-benefit analysis, which compares the costs of a program to the monetary value of its outcomes. Program utilization and null result are not related to analyzing program costs and outcomes.

Question 4

Instrumental utilization of the results of evaluation research occurs when the results

Accepted Answer

Instrumental utilization of evaluation research occurs when the results are directly used for making decisions or solving problems. Option A is an example of conceptual utilization, option C is an example of symbolic utilization, and option D is an example of political utilization.

Question 5

Dr. Smith uses the results of a program evaluation to influence a policy maker's thinking about an issue, even though he does not expect it will directly influence any upcoming decisions. He has engaged in _________ utilization of the evaluation results.

Accepted Answer

Dr. Smith's utilization is conceptual because he is using the evaluation results to influence the policymaker's thinking about an issue, rather than directly informing a decision.

Question 6

Dr. Char tells a policy maker about the results of his evaluation research because the findings can be used to address political attacks levied at a program. This is an example of ________ utilization of evaluation results.

Accepted Answer

Persuasive utilization of evaluation results occurs when findings are used to influence or convince stakeholders, including addressing political attacks against a program.

Question 7

The conceptual utilization of the results of evaluation research occurs when the results

Accepted Answer

Conceptual utilization of evaluation research refers to the use of research results to influence the thinking of policy makers on issues. While evaluation research can be used to improve future research designs, this is not considered conceptual utilization. Additionally, using research results as evidence to defend a political position is not a form of conceptual utilization, as the focus is on influencing policy rather than advancing knowledge.

Question 8

The persuasive utilization of evaluation research occurs when the results

Accepted Answer

The answer of The persuasive utilization of evaluation research occurs...

Question 9

Evaluation research is perceived by decision makers to be relevant when it

Accepted Answer

Evaluation research is perceived by decision makers to be relevant when it addresses the needs of all stakeholder groups. This is because stakeholder groups are the ones who are affected by the program or policy being evaluated, and they need to be able to trust that the evaluation is fair and accurate in order to make informed decisions about the program or policy.

Question 10

Evaluation research is perceived by decision makers to be true when it

Accepted Answer

Valid results are a key factor in decision makers perceiving evaluation research as true. While addressing the needs of stakeholder groups and aiding in program development are important, without valid results the evaluation research may not be considered trustworthy. Including multiple independent variables can strengthen the research design, but it is not the most important factor in decision makers perceiving the research as true.

Question 11

Evaluation research is perceived by decision makers to be useful when it

Accepted Answer

Evaluation research is perceived to be useful when it provides information that helps in program development (choice B) and focuses on dependent variables that policy-makers see as important (choice C). By meeting both of these criteria, evaluation research can be seen as valuable by decision makers. Additionally, addressing the needs of all stakeholder groups (choice A) is also important, but it is not necessarily a criteria solely focused on by decision makers in evaluating research.

Question 12

_______ evaluation research addresses the needs of all stakeholders.

Accepted Answer

Relevant evaluation research is designed to meet the needs of all stakeholders, including program staff, funders, and participants. The goal is to produce information that is useful to everyone involved in the program, and to ensure that the program is producing the desired outcomes. True, high utility, and cost-effective evaluation research are also important, but they do not necessarily address the needs of all stakeholders in the same way that relevant evaluation research does.

Question 13

______evaluation research produces valid results.

Accepted Answer

Validity is a crucial aspect of evaluation research, as it ensures that the results accurately measure what they are intended to measure. While relevance, utility, and cost-effectiveness are important considerations, they do not guarantee the validity of the research findings.

Question 14

_____ evaluations are carried out even though no one has any intention of applying the results to the program.

Accepted Answer

Ritual evaluations are carried out as a traditional practice or to satisfy external requirements even though the results may not be utilized to improve the program.

Question 15

Ritual evaluations

Accepted Answer

Ritual evaluations are characterized by their performance for the sake of process rather than for the application of their findings to improve or change a program. They are often done to fulfill a requirement or expectation without the intention to use the results constructively.

Question 16

Conflict between stakeholders and evaluators can be reduced by

Accepted Answer

Openly discussing sources of potential conflict can help to address and mitigate any concerns or misconceptions from stakeholders about the evaluation process. This can lead to increased trust and understanding between stakeholders and evaluators, ultimately reducing the likelihood of conflict. Waiting until the program evaluation is designed before involving stakeholders (A) can result in stakeholders feeling excluded from the process and not having their needs and perspectives fully considered. Dismissing stakeholders as not knowing as much as they think they do (B) can be disrespectful and may limit valuable insights and feedback from the people that the program is meant to serve. Deemphasizing the benefits for stakeholders (D) can reduce motivation and engagement in the evaluation process.

Question 17

In evaluation research, difference scores

Accepted Answer

Difference scores are used to assess change in before and after measures, making answer A correct. While they can also be used to identify individual clients who did or did not benefit (answer B) and indicate the utility of the results (answer C), these are not the primary purposes for which difference scores are used in evaluation research.

Question 18

The reliability of a difference score INCREASES as

Accepted Answer

A) The reliability of the measure being assessed is a fundamental factor in determining the reliability of difference scores. More reliable measures produce more reliable difference scores.

B) The correlation between the pretest scores and the difference scores is a factor that can affect the reliability of difference scores. If the correlation between the pretest scores and the difference scores is high, the reliability of the difference scores is increased.

C) The correlation between the pretest scores and the posttest scores is also a factor that can affect the reliability of difference scores. When the correlation between the two is zero, the reliability of difference scores is highest.

Therefore, the reliability of a difference score increases as a function of all of the above - A, B, and C.

Question 19

The reliable change index

Accepted Answer

The reliable change index is used to determine whether non-chance change has occurred and provides a standard way of defining clinically significant change. It is a commonly used statistical method in both research and clinical settings. While it may provide information that is theoretically useful, its primary purpose is to determine meaningful change in a practical sense. It has also been extensively tested in field research.

Question 20

In which of the following measures is a person's difference score divided by the standard error of the difference?

Accepted Answer

The reliable change index (RCI) is a measure used in psychological assessment to determine whether the change in an individual's scores on two different tests is statistically significant. It is calculated by dividing the difference score between the two tests by the standard error of the difference. Therefore, the RCI is the measure in which a person's difference score is divided by the standard error of the difference.

Quiz 16: Evaluation Research