Deck 1: Science, Society, and Social Research

Question 1

When the findings of a study accurately represent empirical reality, the results are said to be valid.

Answer 1

True

Question 2

A key concern of survey research is sample generalizability.

Answer 2

True

Question 3

Use the following to answer questions 16-18:
In each set, match a concept from Group A to a definition or example from Group B.
Examples of Types of Social Research
Group A
1. Description
2. Evaluation
3. Explanation
4. Exploration

Group B
a. The quality of neighborhoods, family, and peers affect whether youths become delinquents.
b. The GSS indicates that a smaller number of people spent social time with their neighbors in 1998, as compared to 1975.
c. How is loyalty developed among college basketball players?
d. In Netville, Ontario (where all homes were given Internet access), community relations improved among people who used the Internet.

Answer 3

1-b
2-d
3-a
4-c

Question 4

Exploratory research is designed to identify causes and effects.

Question 5

Use the following to answer questions 16-18:
In each set, match a concept from Group A to a definition or example from Group B.
Errors in Everyday Reasoning
Group A
1. Overgeneralization
2. Selective observation
3. Illogical reasoning
4. Resistance to change

Group B
a. Prematurely jumping to conclusions or arguing on the basis of invalid assumptions
b. Unjustifiably concluding that what is true for some cases is true for all cases
c. Reluctance to change ideas even in light of new information
d. Systematic procedures for selecting objects of study
e. Noting observations that coincide with preexisting preferences or beliefs

Question 6

When a measure measures what we think it does, it has external validity.

Question 7

To reduce the risk of illogical reasoning, social researchers use explicit criteria for identifying causes and for determining whether these criteria are met in a particular instance.

Question 8

"Why do young people in poor neighborhoods join gangs?" This is an example of what kind of research question?

A) Exploratory
B) Descriptive
C) Explanatory
D) Evaluation
E) Quantitative

Question 9

Although science requires systematic data collection, scientists should protect the specific methods of data collection need not be disclosed.

Question 10

Overgeneralizations occur when people conclude that what is true for some cases is true for all cases.

Question 11

Illogical reasoning occurs when people conclude that what is true for one case is true for all cases.

Question 12

Cross-population validity determines whether the findings based on a sample can be generalized to a different population than the one from which it was drawn.

Question 13

Descriptive research suggests how social phenomena (such as neighborhood characteristics) affect other social phenomena (such as youth outcomes).

Question 14

Evaluation research can be used to describe the impact of social programs.

Question 15

Using the General Social Survey, a researcher finds that of all the religious groups in the United States, Catholics are the single largest group, but combined Protestant denominations outnumber Catholics. This is an example of what kind of research?

A) Exploratory
B) Descriptive
C) Explanatory
D) Evaluation
E) Qualitative

Question 16

Researchers can rely on gender as disclosed in forums when identifying differences in usage patterns between men and women.

Question 17

Internal validity is also referred to as causal validity.

Question 18

Generalizability refers to the ability of a study to inform us about persons, places, or events that were not directly studied.

Question 19

Use the following to answer questions 16-18:
In each set, match a concept from Group A to a definition or example from Group B.
Validity
NOTE: Answers from Group B may be used more than once.
Group A
1. Causal validity
2. Cross population generalizability
3. External validity
4. Internal validity
5. Measurement validity
6. Sample generalizability

Group B
a. When a measure measures what we think it measures
b. When findings about one group, population, or setting hold true for other groups, populations, or settings
c. When a conclusion that A leads to or results in B is correct
d. When a conclusion based on a subset of a larger population holds true for the entire population

Question 20

Through systematic sampling and measurement, social science can overcome selective and inaccurate observation.

Question 21

The General Social Survey is administered to a sample of U.S. residents, but it hopes to identify features of the U.S. population as a whole. In other words, the GSS hopes for:

A) Validity
B) Reliability
C) Causal validity
D) Generalizability
E) Cross-population generalizability

Question 22

A new student observes that in his first class, the people sitting in the back row answer most of the questions, so in the next class he sits with the back row, concluding that this is where the smartest students sit. What is wrong with his reasoning?

A) He overgeneralized.
B) He made systematic observations.
C) He let his own biases affect his conclusions.
D) He deferred to authority.
E) None of the above

Question 23

The everyday error that involves unjustifiably concluding that what is true for some cases is true for all cases is called:

A) Overgeneralization
B) Selective observation
C) Inaccurate observation
D) Illogical reasoning
E) Resistance to change

Question 24

"Does gender have an effect on income? Do men, on average, make more than women?" These are examples of what kind of research questions?

A) Exploratory
B) Descriptive
C) Explanatory
D) Evaluation
E) Qualitative

Question 25

Findings from a recent study indicated that education was an important predictor of television viewing. What is the purpose of this research?

A) Descriptive
B) Exploratory
C) Explanatory
D) Evaluation
E) Selective

Question 26

Both explanatory and evaluation research studies are concerned with the causes and effects of social phenomena. The difference between them is that evaluation research focuses on the:

A) Effect of particular policies or programs
B) Meanings that people give their actions
C) Description of the social phenomena of interest
D) Consideration of the impact of social context
E) How people get along in the setting under study

Question 27

Social science overcomes the reliance on tradition or unquestioning respect for authority by:

A) Using systematic procedures for selecting individuals to study that are representative for the groups to which we hope to generalize
B) Using explicit criteria for establishing causality
C) Requiring systematic measurement and sampling
D) Using empirical evidence
E) Answering questions from an ego-based commitment

Question 28

The General Social Survey asks the question: Are you very happy, somewhat happy, or not at all happy in your marriage? Many researchers have questioned whether this is an accurate way to find out how satisfied people really are in their marriage. What is being critiqued in the GSS question?

A) Reliability
B) Causal validity
C) Sample generalizability
D) Cross-population generalizability
E) Measurement validity

Question 29

Social science reduces the risk of selective or inaccurate observation by:

A) Using systematic procedures for selecting individuals to study that are representative for the groups to which we hope to generalize
B) Using explicit criteria for establishing causality
C) Requiring systematic measurement and sampling
D) Using empirical evidence
E) Answering questions from an ego-based commitment

Question 30

Social science is best defined as the:

A) Application of scientific methods to the study of human social reality
B) Systematic selection of social objects
C) Attempt to achieve certainty in observing social reality
D) Assumption that social phenomena resemble biological and chemical phenomena
E) Application of psychological techniques on social phenomena

Question 31

A study of the effects of television violence on children was conducted at a local elementary school. Children were randomly selected from the fourth grade and shown a 10-minute cartoon with violent content. The children were then sent to the playground with other children. Children who were shown the cartoon displayed more aggression in their play than the children who did not see the cartoon. These findings supported the researchers' hypothesis that viewing television violence causes aggressive behavior. The design of this study makes it likely that the researcher's conclusion about the hypothesis has:

A) Cross-population generalizability
B) Measurement validity
C) Sample generalizability
D) Internal validity
E) Causal validity

Question 32

Which of the following is a component of science:

A) Logical methods
B) Systematic methods
C) Documented methods
D) Investigation of natural processes
E) All of the above are components of science

Question 33

The everyday error that involves prematurely jumping to conclusions or arguing on the basis of invalid assumptions is called:

A) Overgeneralization
B) Selective observation
C) Inaccurate observation
D) Illogical reasoning
E) Resistance to change

Question 34

How well the people selected to complete the General Social Survey actually reflect the larger U.S. population is a question of:

A) Reliability
B) Causal validity
C) Sample generalizability
D) Cross-population generalizability
E) Measurement validity

Question 35

When the results of a study hold true for multiple populations, it can be said that the study has:

A) Cross-population generalizability
B) Measurement validity
C) Sample generalizability
D) Internal validity
E) Causal validity

Question 36

When the state approved stronger penalties for drunk driving, including the automatic suspension of driving privileges, the number of highway deaths related to drunk driving decreased. This observation suggests which kind of social research?

A) Descriptive
B) Exploratory
C) Explanatory
D) Evaluation
E) Counter-factual

Question 37

The everyday error that involves the reluctance to change ideas even in light of new information is called:

A) Overgeneralization
B) Selective observation
C) Inaccurate observation
D) Illogical reasoning
E) Resistance to change

Question 38

Social science avoids illogical reasoning by:

A) Using systematic procedures for selecting individuals to study that are representative for the groups to which we hope to generalize
B) Using explicit criteria for establishing causality
C) Requiring systematic measurement and sampling
D) Using empirical evidence
E) Answering questions from an ego-based commitment

Question 39

A measure is valid when it:

A) Cannot be "psyched out" by the respondent
B) Corresponds to an accepted dictionary definition
C) Yields the same score when applied to the same phenomena
D) Relies on sophisticated instruments
E) Measures what the researcher intends to measure

Question 40

Social science reduces the likelihood of overgeneralization by:

A) Using systematic procedures for selecting individuals to study that are representative for the groups to which we hope to generalize
B) Using explicit criteria for establishing causality
C) Requiring systematic measurement and sampling
D) Using empirical evidence
E) Answering questions from an ego-based commitment

Question 41

You are working for a community development organization in a city with high rates of unemployment, poverty, high school attrition, and juvenile delinquency. Your organization wants to begin an afternoon computer training program for young people. Explain how descriptive, exploratory, explanatory, and evaluation research can all be used to help start and later maintain this program.

Question 42

When determining how accurate research is in capturing social reality, social scientists refer to dimensions of:

A) Causality
B) Reliability
C) Validity
D) Evaluation
E) Objectivity

Question 43

According to the text, what steps can social scientists make to combat the four different types of everyday error? Explain your answer by using an example of a hypothetical study on drug and alcohol use among teenagers.
Answer Key

Question 44

Write a brief explanation of the concept of validity and its three dimensions. To illustrate your explanations, describe what they would refer to in a hypothetical study of drug abuse in U.S. suburbs.

Question 45

An advertiser claims that "four out of five veterinarians feed their own dogs CANINE GOODIES" to conclude that CANINE GOODIES is a superior dog food. Use the dimensions of validity to discuss the potential flaws in this conclusion. Discuss how CANINE GOODIES might make their claims more scientific in future commercials.

Question 46

Consider the argument made by Putnam's Bowling Alone, as described in Chapter 1. Are Putnam's conclusions consistent with your own casual observations about how social ties have weakened in the United States? List three of your own observations that are either consistent with or contradict Putnam's conclusion. Describe how you might propose descriptive research to test whether your observations hold up to scientific criteria. In addition, be specific about the types of errors in everyday reasoning that might apply to your casual observations.

Question 47

Explain what generalizability is and why it is important to consider when doing social research. Provide an example of a hypothetical study that shows sample generalizability as well as cross-population generalizability.

Question 48

In which circumstances are descriptive, exploratory, explanatory, and evaluation research appropriate? Give an example for each.

Question 49

A researcher believes girls are more preoccupied with the way they dress than boys. Due to this assumption, he focuses his observations only on girls and their interactions with their friends, neglecting how boys present themselves to others. This is an example of:

A) Selective observation
B) Overgeneralization
C) Selectivity bias
D) Assumption error
E) Illogical reasoning

Question 50

Name four errors in everyday reasoning in the conclusion that people should not feel guilty about not letting their house cats out in the city, because when one observer moved into the country, she opened the door to her cats, and they chose not to go outside.

Question 51

According to Putnam's explanatory research, people "bowl alone" in the United States because which of the following has occurred in during the last few decades in the 20th century?

A) People prefer passive entertainment, such as TV.
B) Social ties have weakened.
C) Fewer people bowl.
D) On average, the population has aged.
E) Average incomes have increased.

Question 52

The extent to which a researcher's sample is representative of the population that it was drawn from is called:

A) Reliability
B) Overgeneralization
C) External validity
D) Responsiveness
E) Measurement validity

Question 53

Jason jumped to the conclusion that people who play video games all day are not athletic. This is an example of:

A) Selective observation
B) Generalizability
C) Illogical reasoning
D) Resistance to change
E) Assumption

Question 54

Which of the four "challenges" are the most difficult for social science to overcome? Review each of the four and evaluate the relative difficulties they create. Answer in terms of a specific research area, such as understanding homelessness, crime, or adaptations to communities or work organizations.

Question 55

Which of the following is not an important goal of social research?

A) Exploration
B) Explanation
C) Evaluation
D) Causation
E) Description

Question 56

Crime has been decreasing in most U.S. cities for the last decade. However, crime remains a critical issue in politics, in the media, and in explanations for why middle-class people do not want to live in the cities. Explain this situation by referring to all four of the errors in everyday reasoning. Propose different sources of errors in everyday reasoning that might account for continued concern about crime even in the face of evidence of declining crime rates.

Question 57

Sally decides that she wants to observe interactions among individuals involved in a protest. She wants to understand their actions as well as the issues that concern them. She is performing what type of research?

A) Explanatory
B) Exploratory
C) Descriptive
D) Interactive
E) Evaluation

Question 58

Researchers want to look at the impact of school policy on physical education and health classes on childhood obesity. To do this, they would perform what type of research?

A) Evaluation
B) Explanatory
C) Causation
D) Exploratory
E) Health

Question 59

A researcher asks five questions of a sample of community residents to find out how much they fear crime and whether their level of fear was influenced by a recent well-publicized murder in the community. Explain what the three dimensions of validity would refer to in this study and why they are important.