Question 1

Evaluators who report negative findings about a program will usually be respected by stakeholders as competent and honest,provided that their methodology is reasonable.

Accepted Answer

False

Question 2

In order to foster the eventual utilization of an evaluation,one of the steps evaluators should take is to

Accepted Answer

In order to foster the eventual utilization of an evaluation, it is important to involve stakeholders throughout all phases of the evaluation. This allows for buy-in from those who will ultimately be using the evaluation results and ensures that the evaluation meets their needs and addresses their concerns. Excluding stakeholders or withholding information from them could undermine the credibility and usefulness of the evaluation. Therefore, choice C is the best option.

Question 3

Agency administrators who ask in-house program evaluators to assess their program's effectiveness are likely to

Accepted Answer

Agency administrators may have a vested interest in the outcomes of the evaluations of their programs, often hoping for positive results to justify the program's continuation or expansion. This expectation can subtly or overtly influence the evaluation process, even if not explicitly stated.

Question 4

If a rigorous experimental assessment of program outcome finds that a program is not effective in attaining its goals,then there is no need to evaluate the program's implementation.

Accepted Answer

Even if a program is found to be ineffective in attaining its goals through a rigorous experimental assessment of program outcome, it is still important to evaluate its implementation in order to identify potential areas for improvement or to determine if the program was being implemented as intended. Evaluation of implementation can help to inform modifications or adjustments to the program in order to increase its effectiveness in the future.

Question 5

In order to maximize scientific objectivity,program evaluators should avoid involving stakeholders in planning an evaluation.

Accepted Answer

Involving stakeholders in planning an evaluation can actually enhance scientific objectivity by helping evaluators to consider a wider range of perspectives and potential biases. However, it is important to ensure that the input of stakeholders is balanced and does not unduly influence the design or results of the evaluation.

Question 6

A major disadvantage of the community forum approach to needs assessment is the representativeness of the opinions expressed.

Accepted Answer

The community forum approach relies on community members to attend and participate in the forum, which may not accurately represent the full range of opinions or needs within the community. Hence, it is a major disadvantage of this approach.

Question 7

Agency administrators and practitioners are likely to encourage maximum scientific rigor in evaluations of program outcome,irrespective of the funding implications.

Accepted Answer

Agency administrators and practitioners may sometimes prioritize funding and resource considerations over maximum scientific rigor in evaluations, as rigorous evaluations can be costly and may not always yield favorable results for continued funding.

Question 8

Which of the following is true about the impact of managed care on program evaluation?

Accepted Answer

Managed care has increased the extent to which vested interests are involved in program evaluations because it emphasizes cost control, efficiency, and accountability, leading stakeholders to have a heightened interest in the outcomes of these evaluations.

Question 9

One criticism of goal attainment evaluations deals with the often fuzzy link between program mission statements and operational indicators of program outcome.

Accepted Answer

This statement is true. The link between program mission statements and operational indicators of program outcome can be unclear or difficult to measure, which can present a challenge when using goal attainment evaluations.

Question 10

External evaluators may not be objective and independent of stakeholder influences in the way they design,carry out,and report their evaluations.

Accepted Answer

External evaluators may be influenced by the stakeholders who hired them or by their own biases and perspectives, which can affect the objectivity and independence of their evaluations. It is important to carefully select external evaluators who have the necessary expertise and experience and to establish clear guidelines and expectations for their work to help ensure the integrity of the evaluation process.

Question 11

An importanactor to consider in planning for the eventual feasibility and utilization of an evaluation is whether commitment to all aspects of the evaluation is obtained in advance from intended information users and other stakeholders.

Accepted Answer

Obtaining commitment from intended information users and stakeholders in advance is essential to ensure the success and utilization of an evaluation. Without their commitment, the evaluation may not be valued, used, or have an impact on decision-making.

Question 12

Because the rates under treatment approach to needs assessment only looks at those currently utilizing services,it is vulnerable to underestimating the true extent of need.

Accepted Answer

The statement is true. The rates only reflect those who are already receiving treatment and do not take into account those who may have a need but are not accessing services for various reasons.

Question 13

Which of the following statements is NOT true about the utilization of program evaluation findings?

Accepted Answer

While clear and obvious policy implications are likely to increase the chances of utilization, it is not a guarantee that the findings will always be used. Other factors such as political climate, availability of resources, and competing priorities can also play a role in the utilization of program evaluation findings.

Question 14

Agency staff members who initially approve of a program evaluation design may nevertheless fail to comply closely with its research protocol throughout the study.

Accepted Answer

This is because unforeseen factors such as workload, competing priorities, and staff turnover can affect the level of adherence to the research protocol. It is important for evaluators to monitor and address any deviations from the protocol to ensure the validity and reliability of the evaluation results.

Question 15

External evaluators,as compared to In-house evaluators,are likely to:

Accepted Answer

External evaluators may face challenges in accessing program information and personnel due to their position outside the organization, unlike in-house evaluators who are part of the organization and typically have easier access to such resources.

Question 16

Which of the following statements is true about the goal attainment model of program evaluation?

Accepted Answer

The goal attainment model of program evaluation does emphasize the importance of clear program goals, but a common problem is that these goals may be stated in vague terms that are difficult to operationalize and measure. This can make it challenging to determine whether the program has actually achieved its goals. The model does not necessarily emphasize qualitative methods over experimental or quasi-experimental designs, and it may involve measuring multiple indicators of success. Cost-effectiveness analysis and cost-benefit analysis are both methods of assessing the economic value of program outcomes, but neither is required by the goal attainment model specifically.

Question 17

Which of the following statements is true about evaluation for program planning?

Accepted Answer

The answer of Which of the following statements is true...

Question 18

Which of the following statements is/are true about program evaluation?

Accepted Answer

Program evaluation can apply to many diverse research designs and methods, such as qualitative and quantitative research, experimental and non-experimental designs, process and outcome evaluations, and more. It is not limited to assessing a program's effectiveness or implementation and it is not restricted to one particular research method.

Question 19

Which of the following statements is true about monitoring program implementation?

Accepted Answer

Monitoring program implementation is important to ensure that the program is being implemented as designed and to identify any problems in implementation that may be affecting the program's outcomes. If a program is not implemented properly, it may result in unsuccessful outcomes. Therefore, monitoring program implementation is essential before conducting an outcome evaluation. Options A, C, and D are incorrect statements.

Question 20

Which of the following statements is true about logic models?

Accepted Answer

Logic models portray program components graphically, including inputs, activities, outputs, and outcomes. They are often theory-based and are sometimes required by funding sources as part of grant applications. They also focus on program outcomes in addition to program components.

Quiz 14: Program Evaluation