Question 1

A case study involves training followed by post training measurement.

Accepted Answer

A case study involves both training and post-training measurement to evaluate the effectiveness of the training program.

Question 2

Case study,relational research,and the one-group pretest-post-test design are all examples of experimental research designs.

Accepted Answer

Case study and relational research are non-experimental research designs, while the one-group pretest-post-test design is a quasi-experimental research design.

Question 3

History refers to the unrelated events that can occur during the training process that influence the training measurements.

Accepted Answer

True

Question 4

A case study research design:

Accepted Answer

A case study research design is questionable for evaluating training because it lacks pre-training information, making it difficult to draw accurate conclusions about the effectiveness of the training. Case studies focus on individual cases, which may not be representative of the larger population. Therefore, using case studies alone to evaluate training may not provide a complete picture of the effectiveness of the training program.

Question 5

Which of the following factors affects internal validity by the degree to which criterion instruments may measure different attributes of an individual at two different points in time?

Accepted Answer

Instrumentation refers to changes in the measuring instrument or criterion used to assess the dependent variable, and can lead to a lack of consistency in the measurement and affect the internal validity of a study. If the criterion instrument used to measure an individual at two different points in time measures different attributes, then the results may not accurately reflect changes in the intended construct. Testing refers to the effect of taking a pretest on the subsequent scores on the posttest, differential investigation refers to differences in the groups being studied, and experimental mortality refers to the loss of participants during the course of the study.

Question 6

The validity of a program design is judged on a continuum from high to low.

Accepted Answer

The validity of a program design can be judged on a continuum, with some designs being considered highly valid and others being less valid.

Question 7

External validity compares one organization's results to those of similar size organizations.

Accepted Answer

External validity refers to the extent to which research findings can be generalized to other populations and settings, not just organizations of similar size.

Question 8

Relational research involves measuring two or more variables to see if they are measuring the same thing.

Accepted Answer

Relational research involves studying the relationships between two or more variables to determine if and how they are related, not if they are measuring the same thing.

Question 9

Which of the following is NOT a form of research design validity?

Accepted Answer

There is no such thing as "Statistical initial" validity. The other answer choices are all valid forms of research design validity. Internal validity refers to the accuracy of the study in terms of measuring what it intends to measure. External validity refers to the extent that the results of the study can be generalized to a larger population. Statistical conclusion validity refers to the accuracy of the statistical analysis and whether the conclusions drawn are supported by the data.

Question 10

Internal validity can be affected by all of the following,EXCEPT:

Accepted Answer

Statistical abnormality is not a factor that affects internal validity. History, maturation, and differential selection are all potential threats to internal validity, as they can impact the reliability of the results and the accuracy of the conclusions drawn from the study.

Question 11

Statistical power is the probability of concluding there is a difference between the training and the control groups when such a difference actually exists.

Accepted Answer

This is the correct definition of statistical power.

Question 12

Differential selection refers to:

Accepted Answer

Differential selection refers to the process where different procedures or criteria are used to select participants for experimental and control groups, which can introduce bias into an experiment.

Question 13

Which of the following is true of nonexperimental research designs?

Accepted Answer

Nonexperimental research designs, which include correlational and descriptive designs, are highly vulnerable to threats to internal validity. This is because these designs do not involve manipulating an independent variable and random assignment to conditions, making it difficult to establish cause-and-effect relationships and rule out alternative explanations for observed relationships between variables. While nonexperimental designs can still be useful in HRD research, they should be used with caution and researchers should take steps to mitigate threats to internal validity.

Question 14

In which of the following designs does a researcher take multiple measures on the variables of interest before and after training?

Accepted Answer

In a time series design, multiple measures on the variables of interest are taken before and after the training. This allows the researcher to track changes over time and determine if any observed changes are a result of the intervention or due to other factors. The other designs listed do not involve multiple measures before and after training.

Question 15

Testing refers to:

Accepted Answer

Testing refers to the effect of a pretest on a post-test score. A pretest may influence the response of the participant in the post-test, thereby influencing the outcomes of the study. This is known as the testing effect. The other options (A, C, and D) do not accurately describe the concept of testing.

Question 16

A quasi-experimental research design could be:

Accepted Answer

Both a non-equivalent control group and a time series are types of quasi-experimental research designs. A non-equivalent control group involves comparing two groups that are not randomly assigned, while a time series involves measuring the same group multiple times before and after an intervention. Both designs lack the control and randomization associated with true experimental designs, making them quasi-experimental.

Question 17

Internal validity deals with the question of whether something besides the training program have caused the observed change to occur.

Accepted Answer

Internal validity specifically refers to the degree to which a training program can be credited for observed changes in behavior or performance, without other factors contributing to the change.

Question 18

Maturation refers to:

Accepted Answer

Maturation in research refers to the natural changes that occur over time as individuals gain experience or develop. It is not related to pretest-posttest scores, differential loss of respondents, or selection procedures.

Question 19

An HRD professional should select a research design that is the lowest cost to the organization.

Accepted Answer

The HRD professional should select a research design that is most appropriate and effective for the research question, regardless of cost. The quality and accuracy of the research findings are more important than the cost of the design.

Question 20

Sackett and Mullen begin their analysis of non-experimental research design by asking the question "How much change has occurred?"

Accepted Answer

Sackett and Mullen do begin their analysis of non-experimental research design by asking the question "How much change has occurred?" in order to determine the effectiveness of an intervention or treatment.

Quiz 16: More on Research Design