Deck 5: Experimental and Quasi-Experimental Designs

Question 1

Construct validity refers to generalizing from what we observe and measure to the real-world things in which we are interested.

Answer 1

True

Question 2

The independent variable in a classical experiment must be a ratio level variable.

Answer 2

False

Question 3

Which of the following is true regarding random assignment to groups?

A)"all other things being equal"
B)"use your best guess"
C)"it is close enough for government work"
D)"you are never 100% sure, so don't worry about it"

Answer 3

A

Question 4

In the classical experiment subjects are measured on the independent variable before the experiment begins and again after the dependent variable has been manipulated by the researcher.

Question 5

Which of the following is not a central feature of the classical experiment?

A)variables
B)time order
C)concepts
D)groups

Question 6

There may be legal reasons why randomization cannot be used in criminal justice research to assign subjects to either a control group or an experimental group.

Question 7

Which of the following is an inaccurate statement?

A)The independent and dependent variables must be operationally defined for the purposes of experimentation.
B)The independent and dependent variables are most often operationally defined before the experiment begins.
C)It is possible for the independent and dependent variables to be operationally defined after a wide variety of observations are made.
D)The independent and dependent variables can never be operationally defined after a wide variety of observations occur.

Question 8

Which of the following is least accurate?

A)Experimentation is appropriate for hypothesis testing.
B)Experiments are well suited to research involving well-defined concepts.
C)Experiments cannot be used in the study of criminal justice policy because they require a hypothesis to test.
D)Experiments are appropriate for evaluation research.

Question 9

Which of the following is most accurate?

A)Experiments can be used only in scientific inquiry.
B)Experiments involve only observing the consequences .
C)Experiments can be used in scientific and nonscientific human inquiry.
D)Experiments involve the researcher taking action but they are unconcerned with the consequences of that action.

Question 10

Construct validity is concerned with the ability to generalize from the results of the experimental group to the control group.

Question 11

Which of the following is not considered a threat to internal validity in an experimental design?

A)maturation
B)instrumentation
C)randomization
D)statistical regression

Question 12

The defining feature of an experiment lies in the control of the independent variable by the experimenter.

Question 13

The main reason that experiments in criminal justice are so easy to complete is that the researcher need only secure one experimental and one control group for any project.

Question 14

Which example below is not a random assignment to experimental groups?

A)Assigning numbers to subjects, put corresponding numbers in a hat and pull out numbers placing the first subject in the experimental group and the second subject in the control group and continue until all numbers are used.
B)Ask subjects whether they prefer to be in the experimental group or the control group, then assign subjects based on their preference.
C)Flip a coin assigning subjects to the control group and to the experimental group.
D)Use a random number generator after assigning numbers to your subjects.

Question 15

Which of the following is true concerning independent and dependent variables in classical experiments?

A)A variable can be an independent in one experiment and dependent in another.
B)Once a variable is designated as an independent variable in one experiment, it can never be used as a dependent variable in another.
C)A classical experiment examines the effect of a dependent variable on an independent variable.
D)An independent variable in a classical experiment is viewed as the effect because it is dependent upon another variable.

Question 16

The threat of statistical regression is a concern any time the researcher begins with subjects who exhibit extreme values on the dependent variable.

Question 17

Which of the following is an accurate example of threats to internal validity of experiments?

A)subjects dropping out of an experiment
B)selecting a random sample
C)both a & b are threats to internal validity
D)none of the above

Question 18

Which of the following is a concern when selecting subjects for an experiment?

A)the manner in which subjects will be selected
B)what variables will be selected
C)the sample to which the results will apply
D)level of measurement

Question 19

Experimentation is an approach to research best suited for exploration.

Question 20

In case-oriented research, a great number of cases are examined in order to understand a small number of variables.

Question 21

You have just completed the LSAT and scored 112.Your roommate, who is no smarter than you, took the LSAT with you and scored 165.You were so upset with your score that you decided to take the test again and you convinced your roommate to take it with you for moral support.You both received scores on the second exam of 150.What accounted for the differences in scores?

A)statistical regression
B)testing
C)instrumentation
D)experiment mortality

Question 22

An interrupted time-series design can be very useful in what type of research?

A)applied research
B)exploratory research
C)descriptive research
D)double-blind research

Question 23

Shortening the time between pretest and posttest or perhaps even offering cash payments to participants in an experiment are techniques that may be used to ________________.

A)limit diffusion
B)decrease experimental mortality
C)decrease the effects of instrumentation
D)control threats to testing

Question 24

The threat of history refers to _____.

A)some subjects who have had history classes and others who have not
B)the realization that some subjects have learned from history while others have not
C)events external to the experiment that will impact the results
D)the fact that only current, relevant subjects need be studied

Question 25

Which of the following would be an example of selection bias?

A)volunteers
B)random assignment to experimental and control groups
C)matching on experimental and comparison groups
D)a double blind experiment.

Question 26

Which of the following would not be an example of experimental mortality?

A)A subject deciding that he/she does not want to participate any longer.
B)Inmates in an experiment at the state maximum security prison being moved to a minimum state prison.
C)Police officers participating in a quasi-experiment designed to measure job satisfaction changing careers.
D)Experimental subjects who stay in an experiment until it is completed.

Question 27

Random assignment to experimental and control groups should reduce the threats to _____.

A)instrumentation
B)maturation
C)generalizability
D)small sample

Question 28

Experimental mortality is also known as ________.

A)selection
B)regression
C)attrition
D)relevance

Question 29

What can help rule out the threats to internal validity in an experimental design?

A)proper selection and assignment of subjects to groups
B)large sample size
C)small sample size
D)nothing can rule out threats to internal validity

Question 30

_______________ are two dimensions of generalizability.

A)Construct validity and external validity
B)Compensatory rivalry and external validity
C)Construct validity and compensatory rivalry
D)Internal validity and diffusion

Question 31

When using a nonequivalent-groups design, the researcher will handle subject assignment to groups by _________________.

A)random assignment to experimental and control groups
B)allowing subjects to pick which group they want to be in
C)matching subjects in the experimental group to those in the comparison group
D)using cohort studies

Question 32

Which of the following statements is accurate?

A)Threats to internal validity are increased by carefully controlling conditions.
B)Threats to internal validity are decreased by carefully controlling conditions.
C)Threats to generalizability of research findings in experiments are unrelated to internal validity
D)Threats to the sample to which the results will apply

Question 33

Graduates majoring in criminal justice and graduates majoring in psychology from the State University were part of a study to assess employment success of those receiving their degrees in May 2002.Six months after graduation (November 2002)a questionnaire was sent out asking about their job seeking success.What type of design is this?

A)a double-blind experiment
B)a non-equivalent groups design
C)a time-series design
D)a cohort design

Question 34

What technique can be used to help reduce the threat to experimental mortality?

A)increasing the sample size
B)decreasing the sample size
C)shorten the time between the pretest and the posttest
D)select only subjects who are female

Question 35

Maturation as a threat to internal validity in experiments refers to _____.

A)some subjects are older than others
B)as people grow and change, results can be impacted
C)only subjects over the age of 21 are mature enough to be part of an experiment
D)no correlation between cause and effect variable

Question 36

In Widom's study of the effects of child abuse and its impact upon later criminal offenses, she selected a sample of children with court records of being abuse victims and gathered a comparison group that were matched on gender, race, age and socioeconomic status.The technique used in this case was ____________________________.

A)individual matching
B)aggregate matching
C)randomization
D)creaming

Question 37

A questionnaire is sent to 1,000 police departments in Florida and gathers information on the number of sick days officers use after being involved in a shooting incident.This is an example of what type of research?

A)variable-oriented research
B)case-oriented research
C)quasi-experimental design
D)cohort design

Question 38

External validity in an experimental design refers to _____.

A)the researcher's ability to be sure that they are measuring what they think they are measuring
B)the lack of concern with issues internal to the study
C)the ability to apply findings to other populations
D)instrumentation

Question 39

If randomization is not possible, what should the researcher do?

A)do nothing
B)use the classical design
C)use a quasi-experimental design
D)Randomization is always possible.

Question 40

Neither the subjects nor the researcher can identify which group is the control group and which is the experimental group.Which design does this describe?

A)cross-sectional
B)double-blind
C)a blind experiment
D)of no value

Question 41

_____________________ refers to the ability to take findings from an experiment and apply them to the real world.

Question 42

Crime hot spots are areas where crime reports, calls for police service, or other measures of crime are especially common.Police in departments with a good analytic capability routinely identify hot spots and launch special tactics to reduce crime in these areas.What kinds of validity threats should researchers be especially attentive to in studying the effects of police interventions on hot spots?

Question 43

Instead of making one pre-test and one post-test measure, the _______________ makes a longer series of observations before and after introducing an experimental treatment.

Question 44

Give two (2)specific examples of research where a quasi-experimental design would be more appropriate than a classical experiment.Why would each of your examples not fit the classical experiment model?

Question 45

An example of variable-oriented research is the _________________ design.

Question 46

When there is a study of a large number of variables that are associated with a small number of cases or subjects, the researcher is engaged in __________________________ research.

Question 47

Explain the classical experiment in terms of the following:
Independent and dependent variables
Pre-testing and Post-testing
Experimental and Control groups

Question 48

The main reason why ____________ is used to select subjects for control and experimental groups in a classical experiment is that the groups will be statistically equivalent.

Question 49

Describe an experimental design to test the causal hypothesis that D.A.R.E.reduces drug use.Is your experimental design feasible? Why or why not?

Question 50

When referring to whether results from experiments conducted in one setting would be obtained in other settings, our main concern is one of _______________________.

Question 51

Identify and discuss at least five (5)threats to internal validity in experimental designs.Include in your answer ways of controlling for each of the threats you identify.

Question 52

A(n)_________________________ experiment guards against experimenters' tendency to prejudge results by eliminating the possibility of either the researcher or the subjects knowing which group is the control and which group is the experimental.

Question 53

Explain the role of randomization in classical experiments.

Question 54

Explain why experimentation is not well suited for the purposes of description and exploration.

Question 55

When random assignment to experimental and control groups is not possible, the researcher may be forced to use a(n)_____________________ design.

Question 56

Creaming, or skimming the best risks off the top to be incorporated in an experiment, is a threat to _________________ validity.

Question 57

Experiments are often conducted in public health research where a distinction is made between an efficacy experiment and an effectiveness experiment.Efficacy experiments focus on whether a new health program works under ideal conditions;effectiveness experiments test the program under typical conditions that health professionals encounter in their day-to-day work.Discuss how efficacy experiments and effectiveness experiments reflect concerns about internal validity threats on the one hand and generalizability on the other.

Question 58

In a classical experiment, the researcher uses a(n)____________________ to offset the effects of the experiment itself.