Deck 10: Observation, Case Studies, Archival Research, and Meta-Analysis

Question 1

Which of the following is an advantage that observational methods have over tightly controlled experimental procedures?

A) There is greater construct validity in both naturalistic and structured observational methods than in tightly controlled experimental procedures.
B) Observational methods have minimal ethical concerns as compared to tightly controlled experimental methods.
C) There is greater generalizability in both naturalistic and structured observational methods than in tightly controlled experimental procedures.
D) Observational methods are vulnerable to participant reactivity, which is not the case in tightly controlled experimental methods.

Answer 1

There is greater generalizability in both naturalistic and structured observational methods than in tightly controlled experimental procedures.

Question 2

Which of the following options is the best description of concealment?

A) It involves hiding the presence of the observer and any recording equipment to prevent individuals from changing their natural behavior.
B) It involves hiding the presence of recording equipment but not the presence of a human observer to prevent individuals changing their natural behavior.
C) It involves hiding the purpose of the study from individuals who are being observed to prevent them from changing their natural behavior.
D) It involves hiding the researcher's records of observed behavior from individuals who are being observed to prevent them from changing their natural behavior.

Answer 2

It involves hiding the presence of the observer and any recording equipment to prevent individuals from changing their natural behavior.

Question 3

Julie is a developmental psychologist who is interested in studying young children's helping behavior in a playroom setting. Her lab is set up to resemble a playroom containing toys and child-sized furniture. Adjacent to the "playroom" is a room for Julie and her research assistants to observe the behavior of children who participate in their study. There is a one-way mirror installed on the wall that separates the playroom from the observation room, as a strategy dealing with:

A) habituation.
B) reactivity.
C) ethical concerns.
D) construct validity.

Answer 3

reactivity.

Question 4

In ________________________________ research, the researcher manipulates the setting to a greater extent than in naturalistic observational studies.

A) archival
B) case study
C) meta-analysis
D) structured observational

Question 5

Piaget's theory of cognitive development was partly based on the _________________
Observation of his infant son.

A) experimental
B) naturalistic
C) concealed
D) cross-sequential

Question 6

refer to the abstract below.
The abstract below is taken from the 2013 issue of the journal Education and Treatment of Children. The authors of the paper examined whether children with autism can be conditioned and taught to use eye contact. Instructors are advised to use the reference below to retrieve the original abstract for their use.
Carbone, V. J., O'Brien, L., Sweeney-Kerwin, E. J., & Albert, K. M. (2013). Teaching eye contact to children with autism: A conceptual analysis and single case study. Education and Treatment of Children, 36(2), 139-159.

-Which of the following is a reasonable assumption that the researchers are making about conclusions of past literature that points to the importance of this case study?

A) Children with autism also learn through social connections and visual input.
B) Children with autism do not necessarily need to learn through visual input.
C) The learning mechanisms in children with autism are fundamentally different from the learning mechanisms in typically developing children.
D) Children with autism do not learn from auditory input.

Question 7

refer to the abstract below.
The abstract below is taken from the 2013 issue of the journal Education and Treatment of Children. The authors of the paper examined whether children with autism can be conditioned and taught to use eye contact. Instructors are advised to use the reference below to retrieve the original abstract for their use.
Carbone, V. J., O'Brien, L., Sweeney-Kerwin, E. J., & Albert, K. M. (2013). Teaching eye contact to children with autism: A conceptual analysis and single case study. Education and Treatment of Children, 36(2), 139-159.

-Many of the sessions in this case study were videotaped and analyzed. What would be the best procedure for coding the data?

A) The data should be coded by at least two observers together in discussion.
B) The data should be coded by at least two observers independently, but later discussed to resolve any inconsistencies.
C) The data should be coded by at least two observers independently, and analyzed without any discussion regardless of agreement.
D) The data can be coded by only one individual because this is a case study.

Question 8

refer to the abstract below.
The abstract below is taken from the 2013 issue of the journal Education and Treatment of Children. The authors of the paper examined whether children with autism can be conditioned and taught to use eye contact. Instructors are advised to use the reference below to retrieve the original abstract for their use.
Carbone, V. J., O'Brien, L., Sweeney-Kerwin, E. J., & Albert, K. M. (2013). Teaching eye contact to children with autism: A conceptual analysis and single case study. Education and Treatment of Children, 36(2), 139-159.

-Which of the following is not a valid reason to employ the design that the authors chose?

A) Conditioning procedures may harm the child, and little is known about the consequences of this treatment.
B) The researchers were hoping to achieve a large amount of quantitative data to statistically test the outcomes of the treatment.
C) The chosen design might have been the more cost effective.
D) Withholding a potentially beneficial treatment comes with ethical considerations.

Question 9

Which of the following reasons is not an argument that supports coding qualitative data?

A) It can make summarizing the data easier.
B) It can allow for the use of statistical tests more suitable for quantitative data.
C) It can lead to richer data with more details.
D) It simplifies the data.

Question 10

Archival research often provides researchers with __________________________ than conducting a single study.

A) a larger sample size
B) reduced statistical power
C) greater control over the questions asked
D) more ethical challenges

Question 11

Meta-analyses often draw directly on which of the following statistics in order to form conclusions?

A) Sample size across studies
B) The level of significance in the findings across studies
C) Effect sizes across studies
D) Confidence intervals of the relevant findings across studies

Question 12

Which of the following methods of sampling benefits the most from the use of some type of recording technology to track all types of behaviors?

A) Specimen record
B) Time sampling
C) Event sampling
D) Coding record

Question 13

In observational studies, researchers often use concealment to deal with the problem of reactivity. What is necessary on the researcher's part in order for concealment to be properly executed?

A) Deception
B) Double blind design
C) Manipulation checks
D) Control group manipulation

Question 14

Which of the following is a valid criticism of observational methods in psychological research?

A) Because they are not real experiments, observational methods are not considered real science.
B) Because they do not involve a lab setting, observational methods are not publishable in peer-reviewed journals, and thus do not provide generalizable science.
C) Because they involve very little manipulation on the researcher's part, and do not generally employ random assignment, observational methods rarely yield data supporting causal relationships.
D) Because the data is generally qualitative in nature, observational methods do not yield data that can be analyzed with inferential statistics and do not meet the rigor that psychological scientists require.

Question 15

Which of the following describes a disadvantage of archival research?

A) Archival research usually contains a large amount of data from a relatively representative sample.
B) Archival research is exempted from review from most Institutional Review Boards.
C) Archival research contains data that is limited what has already been collected.
D) Archival research is often open for researchers to access.

Question 16

When conducting a meta-analysis, which of the following statements is true?

A) Meta-analyses should include studies of all types, including those of high and low quality to capture the entire scientific repertoire.
B) Meta-analyses should contain an equal number of studies reporting significant and non-significant results so as to avoid biases in the forthcoming analyses.
C) Meta-analyses should have strict criterions for inclusion, and only include high-quality studies.
D) Meta-analyses should only include statistically significant findings because researchers conducting these analyses are primarily interested in the size of effects that were found. This allows researchers to gauge whether or not the findings are reliable.

Question 17

The file-drawer problem influences the results of a meta-analysis by:

A) reducing its statistical power.
B) reducing construct validity.
C) decreasing the quality of published studies.
D) decreasing the accuracy of the standardized effect size.

Question 18

The textbook discussed several examples of case studies. In what way was the study of H.M. most different from other case studies such as the one about Nadia?

A) H.M. was an adult, whereas Nadia was a child, and therefore the study of H.M. came with fewer ethical concerns.
B) H.M. could not consolidate new memories, and therefore might not have been vulnerable to feeling bored and fatigued from repeated sessions with an experimenter or researcher.
C) H.M. had a rare tumor, which made the findings non-generalizable to non-clinical populations.
D) The data obtained from H.M. were mostly through naturalistic observations, whereas the data generated from studying Nadia were mostly through a microgenetic approach.

Question 19

Jessica is interested in studying how popular leaders behave towards members of their team, as compared to leaders who are unpopular. She is especially interested in examining this behavior in a business context and obtaining high external validity. Which of the following methods is best suited to her goals?

A) Case study
B) Meta-analysis
C) Experimental study run in a laboratory setting
D) Structured observation

Question 20

In a study by Rosengren, Schein, and Gutiérrez (2010), scale errors committed by children between the ages of 18 and 29 months were recorded while they were at play in a laboratory preschool. The researchers placed miniature replica toys in the preschool classroom during specific time periods to increase the likelihood of observing scale errors. This study is an example of a:

A) naturalistic observational design.
B) case study design.
C) structured observational design.
D) single-subject experimental design.

Question 21

Recorded video data of an observational study does not offer the advantage of:

A) more accurate coding.
B) greater reliability in coding.
C) less variability in coding.
D) fewer problems of participant reactivity.

Question 22

In a meta-analysis, articles that ________________ should be excluded.

A) have different sample sizes
B) report non-significant results
C) are low on internal validity
D) are not in peer-reviewed journals

Question 23

Janet is deeply interested in examining the phenomenon of self-imposed social isolation (i.e., hikikomori). She wants to investigate the possible causes for this phenomenon. After doing a brief literature search, she finds several case studies on individuals with hikikomori and numerous media articles reporting on these case studies. Which of the following is the best step for Janet to obtain a list of potential triggers of the behavior?

A) Read the media articles, since the journalists have already summarized and evaluated the case studies.
B) Contact a researcher who had conducted one of the case studies and interview the researcher about the subject.
C) Read all the case studies and identify common factors that the case subjects shared.
D) Read only the case studies that were reported on by the media, since these case studies must have been most impactful.

Question 24

The General Social Survey contains demographic and attitudinal data collected from respondents over a few decades. Researchers have used this data set to explore the relation between income inequality and happiness. This is an example of:

A) archival research.
B) meta-analysis.
C) case study.
D) naturalistic observational design.

Question 25

If a comprehensive record of all initiated psychological experiments and their results can be maintained, this would greatly reduce:

A) the need for case studies.
B) the file-drawer problem.
C) participant bias.
D) non-significant findings.

Question 26

Observational methods are research methods that do not have rules or structure.

Question 27

Only structured observational methods can lead to any useful theory in psychology, because naturalistic observation is not systematic.

Question 28

The most common way of conducting naturalistic observation is for the researcher to enter a setting of interest and wait for any interesting behavior to appear.

Question 29

Structured observation is most useful after the researcher has done some preliminary work on the phenomenon of interest.

Question 30

Structured observations offer researchers high external validity.

Question 31

In the specimen record approach of coding, all of the behaviors in a given time period are recorded.

Question 32

An advantage of the case study method is that it allows researchers to obtain rich data.

Question 33

Most studies based on archival data do not require approval of the Institutional Review Board.

Question 34

When researchers come up with research questions, they are sometimes able to use existing data to answer those questions.

Question 35

Case study data allow researchers to use complex statistical techniques.

Question 36

A drawback of archival research is that the data available might not directly answer your research questions.

Question 37

If only a single study has been done on your topic of interest, it is too early for a meta-analysis.

Question 38

Effect size can only be measured when you have more than one study.

Question 39

Meta-analysis allows researchers to better evaluate the existence or strength of a psychological phenomenon as compared to a single study.

Question 40

The results of a meta-analysis are always unbiased because they take into account the findings of multiple studies.

Question 41

Explain what is meant by "reactivity" in observational methods and define two strategies to reduce the effect of reactivity.

Question 42

Angela is interested in how children of different ages use tools in the environment to solve problems. She is deciding between using naturalistic observation and structured observation for her study. Describe the advantages and disadvantages of each method.

Question 43

Describe the process of meta-analysis. What is a potential challenge to the validity of meta-analysis, and what steps can be taken in response?

Question 44

What are the advantages of conducting a meta-analysis on existing research, as compared to designing and conducting an empirical study?

Question 45

Briefly explain what is meant by archival research. Describe two advantages and a disadvantage of archival research.