Question 1

Your organization hires you to conduct a formative evaluation of a new informatics intervention. Which areas would you focus on in a formative evaluation?

Accepted Answer

A formative evaluation is an assessment of how well a program is being implemented. Intervention fidelity, implementation quality, and types of personnel are areas that would be focused on in formative evaluation. Results of the formative evaluation are used as feedback to the program for continuous improvement.

Question 2

Of the following, which of these steps in the CDC's six-step program evaluation framework comes first?

Accepted Answer

The CDC's six-step program evaluation framework is (1) engage stakeholders; (2) describe the program; (3) focus the evaluation design; (4) gather credible evidence; (5) justify conclusions; and (6) ensure use and share lessons learned.

Question 3

Which list includes the three levels of theory relevant to evaluation?

Accepted Answer

The three levels of theory relevant to evaluation are scientific theories, implementation models, and program theories. The other choices are either not theories or are specific theories, not levels of theory.

Question 4

You decide to base the evaluation plan of your informatics project on the theory of planned behavior. Which constructs will you use to develop your measurements?

Accepted Answer

The theory of planned behavior focuses on the ability to predict intentions and behavior as a function of beliefs about the value of an outcome, the likelihood that the outcome will occur given the behavior, beliefs about the expectations of others, and self-efficacy beliefs about the personal ability to engage in the activity.

Question 5

The stages of change identified in diffusion of innovation theory are:

Accepted Answer

The stages of change identified in the diffusion of innovation theory are knowledge, persuasion, decision, implementation, and confirmation. The stages of change are one way to understand and evaluate how the change has occurred.

Question 6

If you choose to evaluate an informatics intervention by examining the impact on a clinician's ability to think ahead about future events, which level of situation awareness would you be measuring?

Accepted Answer

Projections are expectations of outcomes in the future. Projections are driven by implicit theories and knowledge about the causal mechanisms underlying events.

Question 7

UTAUT is a theory of:

Accepted Answer

The unified theory of acceptance and use of technology (UTAUT) assesses factors associated with effective use.

Question 8

You decide to interview all the key stakeholders involved in an informatics intervention as part of the planning process. Together you identify the resources available, the likely barriers, and the short-term and long-term objectives. Which kind of theoretical model are you using?

Accepted Answer

Program theory models consist of the implicit ideas and beliefs of key stakeholders. A logic model is a representation of components and mechanisms of the program. Basically, a logic model is a systematic and visual way to present and share your understanding of the relationship among the resources you have to operate your program, the activities you plan, and the changes or results you hope to achieve.

Question 9

In a social network analysis, each node is usually a(n):

Accepted Answer

The patterns of connection between people in a social network analysis (SNA) are displayed as a visual network of nodes and lines. Nodes are individuals, and lines are interactions between them.

Question 10

Ethnography requires which of the following? (Select all that apply.)

Accepted Answer

Ethnography is derived from the field of anthropology. It is a means to understand a population by immersing oneself into its culture by reading documents, performing multiple interviews and observations, and if possible, living and working among the community being studied.

Quiz 4: Models, Theories, and Research for Program Evaluation