Question 1

Which of the following features of a study are aspects of "naturalness?"

Accepted Answer

A,D

Question 2

How is time primarily used in terms of category systems?

Accepted Answer

Time is primarily used in category systems to assess behaviors within a specified unit of time (A) and behaviors with duration of time (B). Therefore, choices A and B are correct and option D covers both. Choice C, assessing behaviors after performed a given number of times, does not directly relate to the use of time in category systems.

Question 3

Using an _____(a)_____ system of categorizing ensures (at least to some degree) that we will note most, if not all, potentially relevant event or behaviors. _____(b)_____ categorization systems have fewer details recorded for any given event or behavior.

Accepted Answer

D

Question 4

Bales' 12-category interaction process analysis (IPA) would be considered a more _____(a)_____ system. Caldwell's 65-category APPROACH coding scheme would be considered a more _____(b)_____ system.

Accepted Answer

Bales' 12-category IPA is a more basic and simplified system that focuses on a smaller set of categories, making it less extensive. Caldwell's 65-category APPROACH coding scheme, on the other hand, is more complex and covers a wider range of categories, making it more extensive.

Question 5

Dalton and Elanor are preparing an initial coding scheme for an upcoming field observation of people's behaviors in shopping malls. When developing their coding scheme, all of the following statements are true, EXCEPT:

Accepted Answer

It is not necessary to make sure that each category has a similar number of levels. The focus should be on developing categories that accurately capture the behaviors of interest in the setting being observed. The level of intensity needed will depend on the research question and the level of detail required in the data analysis.

Question 6

Researchers assessed the interrater reliability of their pilot study coding scheme, and found that its reliability was lacking. What are some ways they could enhance the reliability of their category system or coding scheme? (circle all that apply)

Accepted Answer

B) Predefining the units of observation ensures that all raters are looking for the same things, which can improve consistency and reliability in coding. D) Focusing only on observable events or behaviors reduces the subjectivity involved in coding, which can also enhance reliability by minimizing the room for interpretation or inference.

Question 7

Three researchers wanted to determine the interrater reliability of their field observations regarding aggressiveness of dog encounters at the dog park. Specifically, for each dog-pair, the researchers noted the breeds (or suspected breeds) of each dog, and how aggressive the dogs' first interaction was (1 = not at all aggressive; 5 = moderately aggressive, 10 = they got into a fight). To determine the interrater reliability of their aggressiveness observations, which of the following techniques would be most appropriate and yield the highest (reliable) reliability value?

Accepted Answer

Intraclass correlation is the most appropriate technique for determining interrater reliability of continuous data, such as the ratings of aggressiveness on a scale of 1-10. Cohen's kappa and Fleiss' kappa are better suited for nominal data, such as identifying the breeds of dogs. Therefore, choice C (intraclass correlation) would yield the highest reliability value.

Question 8

Which of the following would be an example of a unit of observation?

Accepted Answer

All of the options listed can be considered units of observation, as they are all specific actions or occurrences that can be observed and recorded.

Question 9

Naturalistic observational studies offer which of the following benefits?

Accepted Answer

The answer of Naturalistic observational studies offer which of the...

Question 10

Maurice and Nora are planning an observational study, and trying to decide on how involved they will be in the observational setting. To avoid influencing people's responses by being present, they decide to use the experience sampling method (ESM) to obtain systematic observations. Their choice of involvement in the naturalistic setting would be considered:

Accepted Answer

Maurice and Nora are using the experience sampling method (ESM), which involves obtaining systematic observations without direct interaction with the participants. This type of observation is considered a form of partial participatory observation, as they are still involved in the naturalistic settings but do not directly interact with the participants in order to avoid influencing their responses. "Going native" refers to the observer becoming too involved in the setting to the point where their observations may become biased, non-participatory observation involves the observer not being involved in the naturalistic setting at all, and archival research involves using pre-existing data sources rather than directly observing people in a naturalistic setting.

Question 11

Which of the following would be considered non-participatory observation? (circle all that apply)

Accepted Answer

Archival research involves analyzing existing data, not interacting with subjects. Being hidden in a secret room and using mirrors to observe people are both forms of non-participatory observation as the observer does not interact with or influence the subjects.

Question 12

You are a research assistant in a developmental psychology program, and tasked with observing children's expression of feelings and emotions, on the playground, to other children and adults. How intensive or extensive would your categorization system be? In your response, (a) explain and justify why you would use a primarily intensive or extensive category system, and (b) provide an example for how five units of observation would be categorized in your system (i.e., provide 5 examples of behavior or other units of observation that would be noted in your categorization system - are those observations hierarchically or laterally organized?).

Accepted Answer

The answer of You are a research assistant in a...

Question 13

You are interested in the phenomenon of "basking in reflected glory," where people tend to affiliate themselves with successful others (e.g., wearing sports paraphernalia), without any personal connection to those successful others, in the hope that some of this success or others' positive attributions will "reflect onto them." Describe one way in which you could investigate this phenomenon with an extremely high degree of naturalness. Then, describe one way in which you could investigate this phenomenon with a very low degree of naturalness. How would they differ? In your response, be sure to indicate (a) the different features of a study that determine the extent to which it is considered "natural," (b) how those features would be manifested in studies of high and low naturalness, and (c) the specific ways in which you would alter those features for your specific examples to obtain high and low naturalness.

Accepted Answer

The answer of You are interested in the phenomenon of...

Question 14

You do not want to "go native" in an upcoming observational study because you fear your in-person presence will unduly influence people's daily behaviors and internal states. Describe two methods of partial participatory observation and two methods of non-participatory observation. Provide an example for each type of partial- and non-participatory observation.

Accepted Answer

The answer of You do not want to "go native"...

Question 15

For some reason, you are fascinated with dog parks, and want to conduct a systematic observational study of the dynamics of people's behavior while at the dog park. What are the important factors to consider when designing your study? For example, given that you want the study to be very naturalistic, you would want to ensure that the behaviors being exhibited are an existing part of people's repertoire, that the setting is not perceived by park goers to be artificially constructed for the purposes of research, and that any "treatments" are such that park goers would have experienced these discrete events with or without the presence of a researcher. Besides the degree of "naturalness," what are three of the factors that one must consider when designing a naturalistic observational study? In your response, be sure to (a) describe each of the three factors; (b) explain the different considerations for each factor, and the benefits and drawbacks to these considerations; and (c) provide an example for how each factor would manifest in the context of observation of the dog park (i.e., what would your decision regarding each factor look like had you actually conducted the observational study?).
Answer template:
Factors or dimensions to consider:
a. observer involvement in the natural setting
b. how extensive or intensive will the coding scheme be
c. will they use qualitative, quantitative, or both types of coding
d. how will they classify the unit of observation.

Accepted Answer

The answer of For some reason, you are fascinated with...

Question 16

What are the three dimensions or facets of "naturalness?"

Accepted Answer

The answer of What are the three dimensions or facets...

Question 17

What are some issues that may arise when conducting a participatory observation study?

Accepted Answer

The answer of What are some issues that may arise...

Question 18

Describe what is meant by the intensity-extensity distinction in coding systems. In which instances might a researcher adopt one approach over the other, and with what consequences?

Accepted Answer

The answer of Describe what is meant by the intensity-extensity...

Question 19

What is Cohen's kappa? How is agreement or reliability between coders determined?

Accepted Answer

The answer of What is Cohen's kappa? How is agreement...

Question 20

Can a research laboratory (where participants would typically participate in psychological experiments) be an appropriate setting for naturalistic observation? In what situations might this be applicable? Why would a researcher want to use a laboratory as the preferred setting to observe "natural" behavior? What would be an example of two studies where the only difference between them is that one utilizes naturalistic observation to assess the dependent measure, and the other uses an "unnatural" (e.g., written self-report) measure to assess the same dependent construct? Does naturalistic observation primarily involve indirect assessments of the constructs we are trying to measure - why or why not? Could there be a situation where the participant is knowingly interacting with the experimenter in a laboratory setting, but the data being collected is still considered "natural behavior?"

Accepted Answer

The answer of Can a research laboratory (where participants would...

Quiz 12: Systematic Observational Methods

Which of the following features of a study are aspects of "naturalness?"

How is time primarily used in terms of category systems?

Using an ___(a) _ system of categorizing ensures (at least to some degree) that we will note most, if not all, potentially relevant event or behaviors. _(b) ___ categorization systems have fewer details recorded for any given event or behavior.

Bales' 12-category interaction process analysis (IPA) would be considered a more ___(a) _ system. Caldwell's 65-category APPROACH coding scheme would be considered a more _(b) ___ system.

Dalton and Elanor are preparing an initial coding scheme for an upcoming field observation of people's behaviors in shopping malls. When developing their coding scheme, all of the following statements are true, EXCEPT:

Researchers assessed the interrater reliability of their pilot study coding scheme, and found that its reliability was lacking. What are some ways they could enhance the reliability of their category system or coding scheme? (circle all that apply)

Which of the following would be an example of a unit of observation?

Naturalistic observational studies offer which of the following benefits?

Which of the following would be considered non-participatory observation? (circle all that apply)

What are the three dimensions or facets of "naturalness?"

What are some issues that may arise when conducting a participatory observation study?

Describe what is meant by the intensity-extensity distinction in coding systems. In which instances might a researcher adopt one approach over the other, and with what consequences?

What is Cohen's kappa? How is agreement or reliability between coders determined?

Quiz 12: Systematic Observational Methods

Which of the following features of a study are aspects of "naturalness?"

How is time primarily used in terms of category systems?

Using an _____(a) _____ system of categorizing ensures (at least to some degree) that we will note most, if not all, potentially relevant event or behaviors. _____(b) _____ categorization systems have fewer details recorded for any given event or behavior.

Bales' 12-category interaction process analysis (IPA) would be considered a more _____(a) _____ system. Caldwell's 65-category APPROACH coding scheme would be considered a more _____(b) _____ system.

Dalton and Elanor are preparing an initial coding scheme for an upcoming field observation of people's behaviors in shopping malls. When developing their coding scheme, all of the following statements are true, EXCEPT:

Researchers assessed the interrater reliability of their pilot study coding scheme, and found that its reliability was lacking. What are some ways they could enhance the reliability of their category system or coding scheme? (circle all that apply)

Which of the following would be an example of a unit of observation?

Naturalistic observational studies offer which of the following benefits?

Which of the following would be considered non-participatory observation? (circle all that apply)

What are the three dimensions or facets of "naturalness?"

What are some issues that may arise when conducting a participatory observation study?

Describe what is meant by the intensity-extensity distinction in coding systems. In which instances might a researcher adopt one approach over the other, and with what consequences?

What is Cohen's kappa? How is agreement or reliability between coders determined?

Using an ___(a) _ system of categorizing ensures (at least to some degree) that we will note most, if not all, potentially relevant event or behaviors. _(b) ___ categorization systems have fewer details recorded for any given event or behavior.

Bales' 12-category interaction process analysis (IPA) would be considered a more ___(a) _ system. Caldwell's 65-category APPROACH coding scheme would be considered a more _(b) ___ system.