Deck 15: Survey Research

Question 1

Name the two purposes of surveys. Briefly describe a study that uses each of these purposes.

Answer 1

No Answer

Question 2

Distinguish between sample surveys and convenience surveys.

Answer 2

No Answer

Question 3

Distinguish between open-ended and closed-ended survey questions. Explain why a researcher would choose one type over the other when constructing a survey.

Answer 3

No Answer

Question 4

Describe three factors a researcher should consider when wording survey questions.

Question 5

Describe one of the ways in which researchers can assess how well potential respondents understand survey questions.

Question 6

What are double-barreled questions? Give an example of one.

Question 7

What are leading questions and loaded questions? Give an example of each.

Question 8

Give an example of a survey question that makes an unfounded assumption.

Question 9

What is a sensitive question? Describe two factors that make survey questions sensitive.

Question 10

How might the sensitivity of a question affect people's responses to it? Describe two steps researchers can take to avoid these effects.

Question 11

What is meant by the term "level of measurement"? Name and define the levels of measurement from highest to lowest.

Question 12

What is the most important difference between interval and ratio levels of measurement?

Question 13

Explain how the difference between interval and ratio levels of measurement affects the interpretation of group differences based on those levels of measurement.

Question 14

Explain the relationship between level of measurement and the use of statistical tests.

Question 15

What is the robustness of a statistic?

Question 16

Explain how a measure's ecological validity is related to its level of measurement. Give an example.

Question 17

Describe the two methods of comparative scaling. What three conditions must be met to achieve reliable and valid results using this procedure?

Question 18

Describe the characteristics of an itemized rating scale.

Question 19

What are graphic rating scales and how are they scored?

Question 20

Describe the characteristics of an itemized rating scale.

Question 21

What factors should be considered in determining the number of scale points used for a numerical rating scale?

Question 22

Describe two advantages of using intermediate anchors for a numerical rating scale.

Question 23

Explain how preliminary research using open-ended questions can be used to improve the content validity of itemized rating scales.

Question 24

Describe two advantages of using multi-item scales.

Question 25

Describe the process of developing a Likert scale.

Question 26

Name three advantages of using a Likert scale compared to other types of scales.

Question 27

What is reverse scoring?

Question 28

Describe the process of developing a Thurstone scale. Give two reasons why a Thurstone rating scale is rarely used.

Question 29

What is a Guttman scale? Why are Guttman scales rarely used?

Question 30

What is a semantic differential scale and why is it widely used?

Question 31

What is response bias and how does it relate to measurement error?

Question 32

What is scale ambiguity and how does it produce response bias?

Question 33

What is category anchoring and how does it affect people's responses to scale items?

Question 34

What are estimation biases? Give an example.

Question 35

What are primacy and recency effects? When is each most likely to affect responses?

Question 36

Define social desirability response bias and name the two forms it can take.

Question 37

What is the acquiescence response bias and what steps can a researcher take to reduce the possibility that this bias is operating?

Question 38

What is the extremity response bias? Why is it difficult to control?

Question 39

What are cultural response sets? How might they affect interpretation of research results?

Question 40

What is the reference group effect?

Question 41

Explain the literal interpretation fallacy.

Question 42

Describe three characteristics that indicate good questionnaire design.

Question 43

Describe the factors that researchers should consider when sequencing the questions on a survey.

Question 44

How might question context affect responses to survey questions? What question characteristics are most likely to produce context effects?

Question 45

Describe four factors to consider when constructing the physical layout of a survey.

Question 46

Name and define the three categories of survey instructions.

Question 47

Describe two characteristics of high quality survey instructions.

Question 48

Give an example of instructions that might bias the survey results. Then explain how this bias could be removed from those instructions.

Question 49

Explain why using existing measures is preferable to developing a new measure. What considerations are important when combining existing measures in a questionnaire?

Question 50

Describe the advantages and limitations of group-administered surveys.

Question 51

Describe the advantages and limitations of using online surveys.

Question 52

Describe two methods of recruiting participants for online surveys.

Question 53

Describe two techniques that can be used to increase survey response rates.

Question 54

Describe the advantages and limitations of telephone interviews.

Question 55

Describe the advantages and limitations of conducting in-person interviews.

Question 56

Which method of data collection is most likely to induce a social desirability response bias? Which method is least likely? Explain your reasoning.

Question 57

Which of the following is a population parameter?

A) the proportion of U.S. residents age 65 and older
B) the mean age of a group of college student research participants
C) the correlation between age and attitudes toward nuclear power in a group of research participants recruited at a shopping mall
D) the standard deviation of the ages of a group of research participants recruited from church groups

Question 58

________ surveys are the best way of estimating population parameters.

A) Convenience
B) Internet
C) Sample
D) Quota

Question 59

________ surveys are based on a representative cross-section of the population of interest.

A) Internet
B) Quota
C) Convenience
D) Sample

Question 60

________ surveys are based on the group or groups of participants that are readily available to the researcher.

A) Internet
B) Quota
C) Convenience
D) Sample

Question 61

Which of the following statements about types of surveys is TRUE?

A) The data from sample surveys can be used to estimate population parameters but not to test hypotheses.
B) The data from convenience surveys can be used to test hypotheses but not to estimate population parameters.
C) There is essentially no difference between sample surveys and convenience surveys in the way in which participants are recruited.
D) Psychological researchers are more likely to use sample surveys than convenience surveys.

Question 62

Consider the following survey question: "Under what circumstances should the university raise tuition?" This question can be categorized as

A) open-ended
B) stem-based
C) closed-ended
D) acquiescent

Question 63

Consider the following survey item: "The university should not raise tuition under any circumstances" with these responses options: Strongly Agree, Agree, Disagree, or Strongly Disagree. This item can be categorized as

A) open-ended
B) stem-based
C) closed-ended
D) acquiescent

Question 64

Which of the following statements about open-ended versus closed-ended questions is FALSE?

A) The responses to open-ended questions are more easily quantified.
B) Open-ended questions are generally better to use when asking about the frequency of sensitive or socially disapproved behaviors.
C) Responses to open-ended questions can be used to design response options for closed-ended questions.
D) Open-ended questions are more useful when one is unsure of the appropriate response options to use with closed-ended questions.

Question 65

Consider the following survey item stem: "Polysyllabic and Latinate verbiage obfuscates signification." This stem violates the question-writing rule of

A) avoid unnecessary negatives.
B) use the language of research participants.
C) avoid double-barreled questions.
D) be specific.

Question 66

Consider the following survey item stem: "People who do not speak English well should not be allow to teach in college." This stem violates the question-writing rule of

A) avoid unnecessary negatives.
B) use the language of research participants.
C) avoid double-barreled questions.
D) be specific.

Question 67

To determine whether respondents are likely to misunderstand or misinterpret a survey question, researchers should

A) use their own judgment based on their knowledge of the intended participant population.
B) use only items that were used in previous surveys.
C) pretest the questions to determine how well potential respondents understand them.
D) use only open-ended questions.

Question 68

A double-barreled question

A) includes two negatives.
B) implies that a certain response is desired.
C) uses emotional context to evoke a desired response.
D) asks for two or more pieces of information at the same time.

Question 69

A loaded question

A) includes two negatives.
B) includes high-level vocabulary words.
C) uses emotional context to evoke a desired response.
D) asks for two or more pieces of information at the same time.

Question 70

A leading question

A) includes two negatives.
B) implies that a certain response is desired.
C) uses emotional context to evoke a desired response.
D) asks for two or more pieces of information at the same time.

Question 71

Consider the following survey item stem: "My teacher speaks clearly and explains things well." This stem would be classified as being part of a(n) ________ question.

A) loaded
B) leading
C) double-barreled
D) insufficiently specific

Question 72

Consider the following survey item stem: "Do you agree that the state legislature should spend more money on education?" This stem would be classified as being part of a(n) ________ question.

A) loaded
B) leading
C) double-barreled
D) insufficiently specific

Question 73

Consider the following survey item stem: "Do you agree or disagree that labor unions should be prohibited from forcing their members to support undesirable political candidates?" This stem would be classified as a(n) ________ question.

A) loaded
B) leading
C) double-barreled
D) insufficiently specific

Question 74

When writing questionnaire items, one should

A) ask questions that are as specific as possible.
B) avoid making assumptions about respondents' personal characteristics or beliefs.
C) be tactful when asking about sensitive topics.
D) do all of the above.

Question 75

Sensitive survey topics include those that

A) people see as intruding on their privacy.
B) pose a threat to respondents if their answers become known to others.
C) address behaviors that social norms define as particularly good or particularly bad.
D) do any of the above.

Question 76

Dr. Patal plans to administer a survey about health-related behaviors that put people at risk for HIV infection. He is concerned that his respondents will be reluctant to answer truthfully. He can reduce this potential for biased responding by

A) implying the behavior is common, that "everybody does it."
B) using authority to justify the behavior, such as by starting out "Many doctors now think that …."
C) being casual, such as by using the phrase "Did you happen to …?"
D) doing any of the above.

Question 77

The term level of measurement refers to

A) rules for assigning numbers to observations.
B) the number of response options given for a survey question.
C) the level of aggregation (e.g., individual, group) at which data are collected.
D) the degree of specificity of the question asked in a survey item.

Question 78

A survey question that asks respondents whether they are male or female uses the ________ level of measurement.

A) nominal
B) ordinal
C) interval
D) ratio

Question 79

A survey question that asks respondents to rank a group of breakfast cereals from the one they like most to the one they like least uses the ________ level of measurement.

A) nominal
B) ordinal
C) interval
D) ratio

Question 80

A survey question that asks respondents to use a rating scale to note the extent to which they agree or disagree with an item uses the ________ level of measurement.

A) nominal
B) ordinal
C) interval
D) ratio