Deck 9: Critically Appraising Nonexperimental Quantitative Studies

Question 1

Which of the following questions is/are important in critically appraising surveys?

A) Was the information collected in a valid, unbiased manner?
B) Were the survey respondents representative of the target population?
C) Were the conclusions warranted in light of the design logic, the type of data analysis employed, and the findings of that analysis?
D) All of the above.

Answer 1

All of the above.

Question 2

Which of the following statements is/are correct about survey response rates?

A) Anything less than 90% is unacceptable.
B) A response rate of less than 50% is generally considered to be inadequate in most surveys.
C) An adequate response rate means that there is no risk of a meaningful nonresponse bias.
D) Online surveys ensure the best response rates.

Answer 2

A response rate of less than 50% is generally considered to be inadequate in most surveys.

Question 3

Which of the following statements is/are correct about sampling methods?

A) Probability sampling is generally deemed to be the safest way to try to achieve representativeness.
B) Nonprobability sampling involves selecting participants randomly.
C) Systematic samples are nonprobability samples.
D) None of the above.

Answer 3

Probability sampling is generally deemed to be the safest way to try to achieve representativeness.

Question 4

Which of the following sampling methods is used when trying to ensure adequate representation of a small minority group?

A) Simple random sampling.
B) Cluster sampling.
C) Stratified random sampling.
D) Systematic sampling.

Question 5

Multivariate procedures:

A) provide sufficient grounds for making causal inferences.
B) can increase the plausibility of causality.
C) have no bearing on whether a study's findings might apply to a particular client.
D) All of the above are correct about multivariate procedures.

Question 6

Case-control studies:

A) can offer useful clues regarding possible causality.
B) avoid the problem of recall bias.
C) remove the need for using multivariate statistical procedures.
D) All of the above are correct about case-control studies.

Question 7

Surveys can be conducted:

A) by mail.
B) using face-to-face interviews.
C) online.
D) All of the above.

Question 8

Surveys avoid the problem of nonresponse bias.

Question 9

Some surveys with poor response rates can have value.

Question 10

A sample is the segment of a population that participates in a study.

Question 11

Using cluster sampling is the best way to ensure adequate representation of a small minority group.

Question 12

Nonprobability samples are selected randomly.

Question 13

Although selecting cases randomly prevents researcher biases or judgment errors regarding what specific cases to select, it is still possible for a probability sample to be biased.

Question 14

Surveys can offset problems connected to external validity and internal validity by using multivariate data analysis procedures.

Question 15

Cross-sectional studies provide better information about how people change over time than do cohort studies or panel studies.

Question 16

Case-control studies use matched groups of people who appear to be comparable except for some contrasting outcome.

Question 17

A key limitation to be avoided in case-control studies is the possibility of recall bias, which occurs when knowing how things turned out biases how people recall earlier events.

Question 18

Identify and discuss the key issues to consider when critically appraising surveys.

Question 19

Identify and discuss the main types of probability and nonprobability sampling and discuss the advantages and disadvantages of each.

Question 20

Explain how multivariate procedures can enhance the value of survey findings.

Question 21

Describe the advantages of case-control studies and what to look for when critically appraising them.