Deck 10: Experimental Research

Question 1

Which of the following is NOT classified as a true experimental design

A)the one-group pretest-posttest design
B)The Solomon four-group design
C)the factorial design
D)the multiple experimental group with one control group design

Answer 1

A

Question 2

In experimental research, random assignment:

A)refers to the use of probability samples for selection of subjects.
B)uses chance to equalize the experimental and control groups.
C)involves matching subjects in the experimental group with subjects in the control group on selected variables.
D)refers to chance measurement error that may distort the findings of experiments.

Answer 2

B

Question 3

The threat to the internal validity of experiments that is called "maturation" is best defined as:

A)changes occurring within experimental subjects that are due to the passage of time.
B)subjects becoming familiar with measuring devices used in experiments after they have been administered repeatedly.
C)the tendency for extremely mature experimental subjects to regress toward the mean of the group over time.
D)historical changes that occur between administration of the pretest and the posttest.

Answer 3

A

Question 4

In the language of experimentation, a "pretest" refers to:

A)the measurement of the independent variable before it is applied to subjects.
B)a measure of the dependent variable before subjects are exposed to the independent variable.
C)the random assignment of subjects to experimental and control conditions.
D)the extent of extraneous variability that exists before exposure of subjects to the independent variable.

Question 5

In an experiment, teachers' judgments are used to measure the amount of misbehavior among students. The teachers are more likely to judge a given behavior as misbehavior at the posttest than they are at the pretest. This example most clearly illustrates which threat to the internal validity of the experiment

A)testing
B)instrumentation
C)history
D)statistical regression

Question 6

Which of the following experimental designs is (are)capable of controlling ALL of the threats to internal validity

A)the Solomon four group design
B)the "classic" experimental design
C)the posttest only control group design
D)all of the answers represent experimental designs that are capable of controlling all of the threats to internal validity

Question 7

A problem with using random assignment to produce equivalence between an experimental and a control group is that:

A)it doesn't work well without matching. b.it increases the amount of extraneous variability.
C)it reduces the internal validity of the experiment.
D)it can yield nonequivalent groups on occasion.

Question 8

In experimental research, the independent variables:

A)are the same as the experimental stimulus.
B)are the same as extraneous variability.
C)have a value that is dependent on the value of the dependent variables.
D)are experienced only by the control group.

Question 9

What most clearly distinguishes experiments from other types of research is that:

A)experiments involve controlled observation and the manipulation of the value of variables.
B)experiments are based on asking people to answer questions about their beliefs and their behavior.
C)experiments are conducted in artificial settings where aspects of the natural environment are simulated.
D)experiments assess the effect of independent variables on dependent variables.

Question 10

Experimental designs that are the weakest in terms of controlling the threats to internal validity are called:

A)true experimental designs.
B)hyper experimental designs.
C)pre-experimental designs.
D)quasi experimental designs.

Question 11

In experimental research, the experimental group:

A)is the same as the control group.
B)is exposed to the experimental stimulus.
C)is created to control for extraneous variables.
D)experiences only the dependent variables.

Question 12

The major advantage of true experimental designs over pre-experimental designs is the former's ability to:

A)bring the control of experiments to nonexperimental settings.
B)control the threats to external validity.
C)be used in field experiments rather than only laboratory experiments.
D)control the threats to internal validity.

Question 13

In an experiment, the control group:

A)is exposed to both the experimental and control conditions in sequence.
B)experiences the control condition.
C)experiences the independent variable.
D)is used to reduce internal validity.

Question 14

Which of the following might an experimental design lack, resulting in its classification as a pre-experimental design

A)an experimental stimulus
B)an independent variable
C)random assignment to conditions
D)a design would have to lack all of these in order to be classified as a pre-experimental design

Question 15

Which of the following experimental designs not only controls all of the threats to internal validity but also allows the effects of history and maturation to be measured

A)the Solomon four group design
B)the posttest only control group design
C)the pretest posttest control group design with randomization
D)none of the experimental designs in the answers can do this

Question 16

A researcher attempts to evaluate the impact of a safety-training program that is intended to increase the use of helmets by child bicyclists. About the same time that the training program takes place, the local news media runs a front-page story about a five-year old whose life was saved by wearing a helmet. This case most clearly illustrates the internal validity threat of:

A)history.
B)maturation.
C)testing.
D)statistical regression.

Question 17

Which of the following are the two methods used in experiments to ensure that the experimental and control groups are equivalent

A)pretesting and matching b.extraneous variability and experimental variability
C)random assignment and matching
D)random assignment and pretesting

Question 18

The variation in the dependent variable that is produced by the independent variable is called:

A)extraneous variability.
B)systematic error variability.
C)experimental variability.
D)random error variability.

Question 19

Which of the following is NOT a potential threat to the internal validity of experiments

A)maturation
B)statistical regression
C)multiple treatment effects
D)selection

Question 20

The one threat to internal validity that the "classic" experimental design cannot control is:

A)attrition due to voluntary quitting.
B)history that results from things external to the experimental setting.
C)maturation on the part of the experimental subjects.
D)testing that results from weaknesses in the measurement devices.

Question 21

One of the advantages of experiments over other research designs is that experiments:

A)reduce the likelihood of experimenter effects occurring.
B)offer researchers access to large samples of people.
C)offer researchers the most advantageous position from which to infer causal relationships between variables.
D)give researchers access to people, such as the deceased, who are inaccessible to other forms of research.

Question 22

Which of the following is NOT an advantage of experiments

A)They are the best research designs for establishing causal relationships.
B)They are ideal for studying large, representative samples of people.
C)Laboratory experiments in particular are relatively inexpensive to conduct.
D)Many experimental designs are longitudinal.

Question 23

Which of the following would be an example of "gender insensitivity" in research

A)failing to report the sex ratio of the subjects in an experiment
B)analyzing the data from an experiment separately for males and females
C)not including gender as one of the independent variables in an experiment
D)assigning people to experimental and control groups randomly by gender

Question 24

The example of the horse Clever Hans is used by the text to illustrate which phenomenon

A)replication in research
B)random assignment to experimental and control groups
C)experimenter's expectations
D)gender insensitivity

Question 25

Which threat to internal validity is controlled by the multiple time series design but not by the other time series designs

A)statistical regression
B)maturation
C)multiple testing effects
D)history

Question 26

Experiments could collect data through the use of:

A)surveys.
B)available data.
C)direct observation of behavior.
D)all of the answers represent ways that data could be collected for experiments.

Question 27

The term "external validity" in experiments refers to:

A)the extent to which causal inferences made in an experiment can be generalized beyond the experimental setting.
B)whether the independent variable actually produces the effect that it appears to have on the dependent variable.
C)the extent to which the design approximates a true experimental design.
D)the elimination of experimenter effects.

Question 28

The study of police response to domestic violence cases discussed in Research in Practice 10.2 illustrates the point that:

A)experiments cannot be conducted outside of the confines of the laboratory.
B)field experiments can be used to find solutions to human service problems.
C)the results of small group experiments in laboratories can be generalized to solve human service problems.
D)quasi experimental designs have great utility in solving human service problems.

Question 29

As it relates to experimental research, "gender insensitivity" refers to:

A)the failure of researchers to treat the effects of gender as a variable.
B)the common practice of reporting findings for females only.
C)the occasional harsh treatment of female subjects by some researchers.
D)the failure to include enough male subjects in experiments.

Question 30

All of the following are disadvantages of experiments EXCEPT:

A)they are inflexible.
B)randomization can be difficult to carry out.
C)researchers have more control in experiments.
D)it may be difficult to generalize the results

Question 31

All of the following are advantages of experiments over other research designs EXCEPT:

A)experiments can be less costly than other research designs.
B)the sampling done in experiments makes the results more generalizable than is the case with other research designs.
C)it is more logical to infer causal relationships in experiments than in other research designs.
D)researchers in experiments have more control over variables and events than in other research designs.

Question 32

Which of the following is NOT one of the threats to the external validity of experiments discussed in the text

A)unrepresentative samples
B)reactive effects of testing
C)statistical regression
D)multiple treatment interference

Question 33

The multiple experimental groups with one control group design is used to:

A)approximate the control of experiments in nonexperimental situations.
B)assess the interaction effects of more than one independent variable.
C)assess the effects of differing amounts or intensities of a single independent variable or treatment.
D)control threats to external validity.

Question 34

In the long run, according to the text, the external validity of experiments can be best established:

A)by using true experimental designs.
B)through replication.
C)by conducting field experiments.
D)only in carefully conducted laboratory experiments.

Question 35

Which of the following was NOT recommended by the text as a way to enhance the external validity of experiments

A)conduct laboratory experiments rather than field experiments
B)conduct field experiments rather than laboratory experiments
C)replicate findings
D)use complex experimental designs to reduce the threat of multiple-treatment interference

Question 36

A double-blind experiment is one in which:

A)a pre-experimental design is used.
B)no hypotheses are stated before the data is collected.
C)neither the subjects nor the experimenter know who is in the control group.
D)the subjects do not know who is in the control group but the experimenter does.

Question 37

The text describes a field experiment conducted to assess the impact over years of "stand your ground" laws on justifiable homicide rates. This study used which kind of experimental design

A)multiple time series design
B)different group time series design
C)Solomon four-group design
D)factorial design

Question 38

The threat to external validity posed by multiple-treatment interference can be reduced through experimental designs in which:

A)experimental groups experience the independent variables in every possible sequence or combination.
B)only one independent variable is used.
C)a double-blind situation is used to reduce experimenter expectations.
D)reactivity is decreased through replication.

Question 39

If we wanted to assess through an experimental design the effect of race and age working together on a person's propensity toward substance abuse, we would probably select which type of experimental design

A)a Factorial design
B)the Solomon four group design
C)the "classic" experimental design
D)the multiple experimental group with one control group design

Question 40

Which of the following is a quasi experimental design

A)the Solomon four group design
B)the static group comparison
C)the time series design
D)the posttest only control group design

Question 41

Diagram the Solomon four group experimental design. Discuss the advantages and disadvantages of this design as compared with the other true experimental designs.

Question 42

Define and discuss the importance of control groups and control variables in experimental research.

Question 43

Describe matching, randomization, and blocking as methods to achieve equivalence between experimental and control groups. Discuss the advantages and disadvantages of each.

Question 44

Identify the threats to the external validity of experiments. Also discuss why they are threats.

Question 45

Diagram the One Group Pretest Posttest pre-experimental design and indicate its weaknesses on internal validity.

Question 46

Identify and describe the threats to the internal validity of experiments. Also describe why they are threats.

Question 47

Diagram a Factorial Design containing four groups and indicate the reasons for using factorial designs.

Question 48

Diagram the Time Series quasi experimental designs and evaluate them on their ability to control threats to internal validity.

Question 49

What are the advantages and disadvantages of experiments as a research design

Question 50

Discuss the issues associated with minority participation in social science experiments.