Deck 16: More on Research Design

Question 1

A case study involves training followed by post training measurement.

Answer 1

True

Question 2

Case study,relational research,and the one-group pretest-post-test design are all examples of experimental research designs.

Answer 2

False

Question 3

History refers to the unrelated events that can occur during the training process that influence the training measurements.

Answer 3

True

Question 4

A case study research design:

A)Is easy to use to evaluate training
B)Is questionable since there is no pre-training information
C)Measures only results
D)Is very commonly used to evaluate training

Question 5

Which of the following factors affects internal validity by the degree to which criterion instruments may measure different attributes of an individual at two different points in time?

A)Instrumentation
B)Testing
C)Differential investigation
D)Experimental mortality

Question 6

The validity of a program design is judged on a continuum from high to low.

Question 7

External validity compares one organization's results to those of similar size organizations.

Question 8

Relational research involves measuring two or more variables to see if they are measuring the same thing.

Question 9

Which of the following is NOT a form of research design validity?

A)Internal
B)External
C)Statistical conclusion
D)Statistical initial

Question 10

Internal validity can be affected by all of the following,EXCEPT:

A)History
B)Maturation
C)Differential selection
D)Statistical abnormality

Question 11

Statistical power is the probability of concluding there is a difference between the training and the control groups when such a difference actually exists.

Question 12

Differential selection refers to:

A)Gaining job experience
B)The effect of a pretest on a post-test score
C)Differential loss of respondents from various groups
D)Using different procedures to select individuals for experimental and control groups

Question 13

Which of the following is true of nonexperimental research designs?

A)They are highly vulnerable to threats to internal validity
B)They are highly vulnerable to threats to external validity
C)They are the best way to assess HRD program effectiveness
D)It is the most common design used by HRD programs

Question 14

In which of the following designs does a researcher take multiple measures on the variables of interest before and after training?

A)Nonequivalent control group design
B)Time series design
C)Post-test-only with control design
D)One-group pretest-post-test design

Question 15

Testing refers to:

A)Gaining job experience
B)The effect of a pretest on a post-test score
C)Differential loss of respondents from various groups
D)Using different procedures to select individuals for experimental and control groups

Question 16

A quasi-experimental research design could be:

A)A non-equivalent control group
B)A time series
C)A pre post-test
D)Both A and B are quasi-experimental designs

Question 17

Internal validity deals with the question of whether something besides the training program have caused the observed change to occur.

Question 18

Maturation refers to:

A)Gaining job experience
B)The effect of a pretest on a post-test score
C)Differential loss of respondents from various groups
D)Using different procedures to select individuals for experimental and control groups

Question 19

An HRD professional should select a research design that is the lowest cost to the organization.

Question 20

Sackett and Mullen begin their analysis of non-experimental research design by asking the question "How much change has occurred?"

Question 21

How is statistical power affected by the formation of control groups?

A)It is reduced by dividing a limited number of participants equally into a training group and a control group
B)It is increased by dividing a limited number of participants equally into a training group and a control group
C)It is reduced by not using a control group and putting the same limited number of participants into the training group
D)It is not affected by the formation of control groups

Question 22

Relational research typically involves the use of what type of statistical measurement?

A)Regression
B)Correlation
C)A t-test
D)A z-test

Question 23

To control costs while increasing statistical power Yang et.al.recommend

A)Training more people
B)Placing more people in the control group
C)Using only desired results
D)None of the above

Question 24

In order to deal with the effect of developing attitudes that may be the result of the pre-training measure rather than the training,which of the following evaluation designs could be used?

A)Post-test-only with control design
B)Pretest-post-test with control design
C)Solomon four-group design
D)Nonequivalent control group design

Question 25

According to the text what is true about experimental design evaluations:

A)They are easy to use in almost any organization
B)They are cheaper to do than case studies
C)They should be the only method used for evaluating HRD programs
D)They are difficult to use due to organizational constraints