Deck 7: Survey Research and Resources

Question 1

Of the following all EXCEPT which are examples of difficulties faced by survey researchers as noted in your text?

A) Surveys aren't often used in educational research
B) Development of a questionnaire is difficult
C) Response rates are often low
D) People don't like to complete surveys

Answer 1

A

Question 2

A local company has donated land and is willing to support either an outdoor sports area or a new playground. A representative from the company sent out a survey to determine which is more desired by the community. This type of research can best be classified as

A) school.
B) opinion.
C) developmental.
D) follow-up.

Answer 2

B

Question 3

Ms. Wang's study addresses the reasons that parents report for sending their children to dance lessons. She has defined her topic and reviewed the literature, and has stated her questions. The next step in Ms. Wang's study is to

A) identify and select research participants.
B) create her research instrument.
C) seek informed consent permission.
D) report on her research findings.

Answer 3

B

Question 4

The ________________ type of survey consists of different groups and different samples over time.

A) cross-sectional
B) trend
C) cohort
D) panel

Question 5

Seth sends out a survey to all parents and teachers in the district to gather opinions about local school safety. Seth's study is an example of ________ survey research.

A) cross-sectional
B) trend
C) cohort
D) panel

Question 6

Which of the following is an example of a study that can be described as quantitative survey research?

A) Hanna interviews second grade teachers to understand teacher's relationships with their students.
B) Olivia observes how many times children talk out during class.
C) Marcia observes the nature of affection in three different classes.
D) Darlene describes the characteristics of effective management employed by a second grade teacher.

Question 7

As a researcher you are interested in self-reported changes in interest in music in the senior population. You will collect data at the time of retirement and each year for five years. This type of research can be classified best as an)

A) school survey.
B) opinion poll.
C) developmental survey.
D) follow-up survey.

Question 8

The type of survey research that involves one group administered the survey at one time best describes

A) cross-sectional
B) trend
C) cohort
D) panel

Question 9

Of the following, which is an example of a survey research topic?

A) Are there gender differences in students' SAT math scores?
B) Is there a relationship between aptitude for math and language skills?
C) Is there a difference in school attendance rates based upon school size?
D) How d students and administrators feel about the new uniform policy?

Question 10

Of the following, which is most likely a survey research topic?

A) Is there a gender difference in science achievement on The Programme for International Student Assessment PISA)?
B) Do parents believe that the new middle school science club is worth the funds the district spent?
C) What is the experience of ten-year olds at the summer Science day camp held at the university?
D) Is there a relationship between science self-efficacy and students science grades in eleventh grade?

Question 11

Survey data are collected in two primary ways. These two ways are through

A) self-report instruments and achievement tests.
B) projective assessments and self-report instruments.
C) Interviews and questionnaires.
D) Projective assessments and observation.

Question 12

Ida is a teacher who is interested in other teachers' opinions of full day versus part day kindergarten programs. Ida's study can best be described as a

A) developmental survey.
B) school survey.
C) practical survey.
D) sample survey.

Question 13

Melanie is conducting a survey for her thesis that examines administrative policies in middle schools that are intended to decrease bullying. After developing her survey and piloting the instrument with a small group, she then administers the instrument to a sample of 2300 middle school administrators. Which of the following survey research designs best describes Melanie's study?

A) Cross-sectional
B) Trend
C) Cohort
D) Panel

Question 14

The most common form of surveys in education are referred to as

A) developmental surveys.
B) school surveys.
C) sample surveys.
D) practical surveys.

Question 15

Of the following, which is an example of a survey research topic?

A) Does the intervention increase reading skills?
B) Is there a relationship between task performance and age?
C) What are the participants' opinions regarding effective instruction?
D) Are there differences by SES on the new aptitude measure?

Question 16

As a researcher you examine viability of local theatre productions. A survey that asks those who have recently attended an event about the likelihood they will attend another similar event is best classified as an)

A) school survey.
B) opinion poll.
C) developmental survey.
D) follow-up survey.

Question 17

After identifying a topic, survey researcher next

A) select an appropriate sample.
B) review the literature.
C) collect valid and reliable data.
D) examine the research context.

Question 18

According to your text, one particular challenge of self-report studies is that

A) people don't believe the findings from self-report studies.
B) self-report studies are more challenging to conduct than other types of research.
C) self-report studies often suffer from lack of participant response.
D) It is not possible to obtain valid results from self-report studies.

Question 19

Survey data are often collected via which of the following?

A) standardized tests.
B) ability measures.
C) questionnaires.
D) observations.

Question 20

The ________________ survey consists of the same group but different samples from that group over time.

A) cross-sectional
B) trend
C) cohort
D) panel

Question 21

The advantages of a telephone survey data collection include

A) less expense.
B) less training.
C) ability to obtain depth in data.
D) short data collection.

Question 22

Of the following, which is an unstructured item?

A) Rank order
B) Likert scale
C) Free-response
D) Checklist

Question 23

Consider the questionnaire items below as you answer the following questions.
1. Age ______
2. Total years teaching 1-5_____ 6-10 ______ 11-15 ______16-20 _______
3. 21-25 __________ more than 25 _______
4. School ____________
5. Number of children in your average-sized class _______
6. Do you agree that class size negatively affects instruction
SA A U D SD
7. Please list the ways in which class size effects your instruction
Item 5 is an example of an) ___________ type of item.

A) Likert
B) open-response
C) semantic differential
D) checklist

Question 24

Consider the questionnaire items below as you answer the following questions.
1. Age ______
2. Total years teaching 1-5_____ 6-10 ______ 11-15 ______16-20 _______
3. 21-25 __________ more than 25 _______
4. School ____________
5. Number of children in your average-sized class _______
6. Do you agree that class size negatively affects instruction
SA A U D SD
7. Please list the ways in which class size effects your instruction
Data collected from item 3 will be _________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 25

The majority of surveys use ____________ as the primary data collection method.

A) questionnaires
B) observation
C) interview
D) telephone

Question 26

Of the following, which is the sample technique most often used in survey research?

A) Cluster b Stratified random
C) Systematic
D) Purposive random

Question 27

The main benefit of cross-sectional survey designs is that they are

A) more generalizable than longitudinal designs.
B) more reliable than longitudinal designs
C) more convenient than longitudinal designs.
D) more valid than longitudinal designs.

Question 28

Compared to questionnaires, interviews generally

A) cost less.
B) take less time.
C) are more reliable.
D) have higher return rates.

Question 29

The ____________ type of survey research consists of the same group and the same sample over time.

A) cross-sectional
B) panel
C) trend
D) cohort

Question 30

All things being equal, the most biased item is

A) item 2.
B) item 3.
C) item 4.
D) item 5.

Question 31

Consider the questionnaire items below as you answer the following questions.
1. Age ______
2. Total years teaching 1-5_____ 6-10 ______ 11-15 ______16-20 _______
3. 21-25 __________ more than 25 _______
4. School ____________
5. Number of children in your average-sized class _______
6. Do you agree that class size negatively affects instruction
SA A U D SD
7. Please list the ways in which class size effects your instruction
Data collected from item 4 will be ________ level data.

A) nominal
B) ordinal
C) interval
D) ratio

Question 32

The item that will provide the least reliable data is likely

A) item 2.
B) item 4
C) item 5.
D) item 6.

Question 33

Consider the questionnaire items below as you answer the following questions.
1. Age ______
2. Total years teaching 1-5_____ 6-10 ______ 11-15 ______16-20 _______
3. 21-25 __________ more than 25 _______
4. School ____________
5. Number of children in your average-sized class _______
6. Do you agree that class size negatively affects instruction
SA A U D SD
7. Please list the ways in which class size effects your instruction
Item 2 is an example of a ____________ type of item.

A) Likert
B) open-response
C) semantic differential
D) checklist

Question 34

A cross sectional survey design compared to cohort design differs in that cross sectional surveys collect data a more frequently than in a cohort design.
B) once compared to multiple times in a cohort.
C) from different groups compared to same group in a cohort.
D) twice as compared to once in a cohort.

Question 35

Which of the following is NOT a relative benefit of questionnaire survey over other survey data collection methods?

A) Higher response rates
B) Relative expense
C) Confidentiality and anonymity
D) Standardized procedures

Question 36

One drawback of personal administration methods is that

A) it is difficult to get personal data.
B) there is a strong possibility of response sets.
C) administrators must be trained.
D) possible interviewer bias.

Question 37

A census is

A) a large scale cohort study.
B) a cross-sectional study of the full population.
C) a combination of a panel survey and a trend survey.
D) a follow-up study of all potential participants.

Question 38

Don studies high school seniors' concerns about world events during their post-secondary experiences. He surveys the entire senior class state-wide. He surveys them again every year for eight years. Don is illustrating a ___________ type of survey.

A) cross-sectional
B) trend
C) cohort
D) panel

Question 39

One of the primary benefits of interview survey methods is

A) a relative decrease in administration time.
B) that they allow for confidentiality and anonymity.
C) that there is likely increases in return rate.
D) the relative ease of scoring procedures.

Question 40

All things being equal, participants are most likely to find ____________ the most sensitive item.

A) item 1
B) item 2
C) item 3
D) item 4

Question 41

Telephone interviewing is most effective when

A) the items are mainly selection-type items.
B) the interview is lengthy.
C) the information requested is sensitive.
D) building rapport with the participant is important.

Question 42

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Of the following, how is item 2 best categorized?

A) Likert
B) Checklilst
C) Free response
D) Demographic

Question 43

According to your text which of the following should be included in the cover letter?

A) The human subjects protocol number
B) The purpose of the study if it is for your thesis or dissertation
C) The intended results of the study
D) The purpose of the study

Question 44

One disadvantage of interviews compared to questionnaires is that they

A) require more skills to administer.
B) result in an smaller response rate.
C) produce less biased results.
D) provide less complete data.

Question 45

Generally, as number of items increases on a survey the

A) reliability increases.
B) reliability decreases.
C) content validity increases.
D) content validity decreases.

Question 46

Max conducted a survey study and received an initial response rate of approximately 68% with his first mailing. What do you suggest for Max now?

A) His response rate is low. Try to determine if there is a systematic reason why.
B) His response rate is low. Send a second mailing.
C) His response rate is adequate. Send a second mailing.
D) His response rate is too high to send a second mailing. Analyze his data and report his findings.

Question 47

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Of the following, how is item 6 best categorized?

A) Likert
B) Checklist
C) Free response
D) Demographic

Question 48

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Of the following, how is item 11 best categorized?

A) Likert
B) Checklist
C) Free response
D) Demographic

Question 49

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Data collected from item 2 is an example of an) ____________ level data?

A) nominal
B) ordinal
C) interval
D) ratio

Question 50

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Of the following, how is item 4 best categorized?

A) Likert
B) Checklilst
C) Free response
D) Demographic

Question 51

Money and time are both tight at the charter school. Jill, the director, sent out a survey to get parents' perceptions of purchasing priorities for the school. She had a group of parents respond to the questionnaire as a pilot. She had them rate their priorities on a rating scale with the points "necessary", "very important", "purchase if money is available", "not necessary", "don't purchase". She was disappointed to find that the pilot parents rated everything as necessary. This will not help her make purchasing decisions. Of the following, what is the best strategy for Jill?

A) Send it out as it is. The larger general population of parents will have more variance than the small pilot.
B) Revise the instrument to include open-response items to get richer data.
C) Revise the instrument so parents must rank items to purchase relative to each other.
D) Conduct in-person interviews with the same items.

Question 52

Which of the following is a criteria for writing questionnaire items?

A) Do not include potentially controversial items
B) Include questions that influence respondents
C) Organize items from specific to general
D) Limit items to the same format

Question 53

An interview guide's primary purpose is to provide information to the

A) participant about the study.
B) Institutional Review Board for the purposes of obtaining permission for participation of human subjects.
C) researcher to assist in standardizing the interview.
D) site personnel to help the researcher in gaining entry.

Question 54

An advantage of the interview over questionnaires is that they

A) are less expensive.
B) provide in-depth data.
C) are less time consuming.
D) are easier to score.

Question 55

The typical response rate first mailings of questionnaires is approximately

A) 10-30%
B) 20-40%
C) 30-50%
D) 40-60%

Question 56

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Which of the following items will likely provide the least reliable data?

A) Item 1
B) Item 3
C) Item 6
D) Item 10

Question 57

Pam conducted a survey study and received an initial response rate of approximately 34%. She sent a second mailing and obtained an additional 6%. What do you suggest for Pam now?

A) Her response rate is adequate. Analyze her data and report her findings.
B) Her response rate is low. Send a third mailing.
C) Her response rate is too low. Redesign the survey.
D) Her response rate is low. Try to determine if there is a systematic reason why.

Question 58

The most common way to present results of individual survey items is to

A) report mean responses by item.
B) report percent of agreement to items.
C) present median responses.
D) present modal responses.

Question 59

Li sent out a survey and received an initial response rate of 44%. If her study follows typical response patterns from the literature, what can she expect her response rate to be after a second mailing?

A) 50%
B) 54%
C) 60%
D) 64%

Question 60

Marcy developed a survey to administer to parents of college students living on campus. One of the questions on her survey was, "Describe your level of satisfaction with your child's residence life experiences." Marcy found that few people answered this question. This is likely because

A) the item is sensitive.
B) the respondent is not in a position to answer the item.
C) the item is open-ended.
D) the item is unclear.

Question 61

The questions under item 6 are best described as

A) semantic differentials.
B) Likert scales.
C) Performance items.
D) Aptitude measures.

Question 62

At a recent school board meeting the district discussed discontinuing the Latin language classes at the high school. Ms. Bose requested that before a decision was made that the board survey the families in the district. The board agreed and as decided to use a free software program to design and deliver the survey. Which of the following might the board decide to use?

A) Survey Monkey
B) LimeSurvey
C) Zoomerang
D) SPSS Survey

Question 63

Felicia is opening a new Spa. She went to several banks in town and passed out the survey on Saturday mornings to bank customers as her potential clients. Consider the sample items below from her survey and answer the following questions.
1. Age ___________
2. Gender M F
3. Please circle how many times you have had a facial.
0 4 or fewer between 4-10 more than 10
4. Please circle how many times have you had a massage.
0 4 or fewer between 4-10 more than 10
5. On which day of the week are you most likely to get a massage?
Monday Tuesday Wednesday Thursday Friday Saturday Sunday
6. Please rate your agreement to the following items:
7. Would you go to the spa with your friends, spouse, or alone? _________________
Data taken from item 5 will consist of which level of data.

A) Nominal
B) Ordinal
C) Interval
D) Ratio

Question 64

The Hidden Valley school district has space concerns. They are considering moving the fifth grade students to the middle school. However, they would like to get students' input. In an effort to get the best information, they administer a survey regarding whether fifth graders should move to the middle school to every fourth grade student. The survey study is best described as

A) A projective study.
B) A census study.
C) A population study.
D) A sample study.

Question 65

Felicia is opening a new Spa. She went to several banks in town and passed out the survey on Saturday mornings to bank customers as her potential clients. Consider the sample items below from her survey and answer the following questions.
1. Age ___________
2. Gender M F
3. Please circle how many times you have had a facial.
0 4 or fewer between 4-10 more than 10
4. Please circle how many times have you had a massage.
0 4 or fewer between 4-10 more than 10
5. On which day of the week are you most likely to get a massage?
Monday Tuesday Wednesday Thursday Friday Saturday Sunday
6. Please rate your agreement to the following items:
7. Would you go to the spa with your friends, spouse, or alone? _________________
Data taken from item 4 will consist of which level of data?

A) Nominal
B) Ordinal
C) Interval
D) Ratio

Question 66

Felicia is opening a new Spa. She went to several banks in town and passed out the survey on Saturday mornings to bank customers as her potential clients. Consider the sample items below from her survey and answer the following questions.
1. Age ___________
2. Gender M F
3. Please circle how many times you have had a facial.
0 4 or fewer between 4-10 more than 10
4. Please circle how many times have you had a massage.
0 4 or fewer between 4-10 more than 10
5. On which day of the week are you most likely to get a massage?
Monday Tuesday Wednesday Thursday Friday Saturday Sunday
6. Please rate your agreement to the following items:
7. Would you go to the spa with your friends, spouse, or alone? _________________
Which sampling strategy did Felicia employ?

A) Stratefied
B) Random
C) Cluster
D) Convenience

Question 67

Felicia's strategy can best be described as a __________ survey design.

A) Cohort
B) Panel
C) Cross-sectional
D) Longitudinal

Question 68

Will conducted a study of High School lunch preferences. Consider the sample items below from his survey and answer the following questions.
1. Grade 9 10 11 12
2. Gender M F
3. How often do you buy school lunch? _____________
4. Of the following, circle those that apply to why you buy lunch.
Convenience Cost Friends buy
Please rate your agreement regarding if the school should serve these items:
10. Do you think the cost of school lunches is fair? __________________
11. What other items would you like to see offered at the school __________________
Of the following, which research question would be LEAST likely addressed through a survey study?

A) Are SAT scores a better predictor of GRE or LSAT scores?
B) Are SAT scores related to reported happiness at the end of Junior Year?
C) What is the average difference in SAT score between those enrolled in Engineering courses and those enrolled in Business courses?
D) Are the SAT scores at branch campuses significantly lower than they are at the state's main campuses?

Question 69

Jabar developed a survey to administer to measure untenured faculties perceptions of support by their Deans. One of the questions on his survey was, "Do you receive adequate support from the Dean" Jabar found that few people answered this question. This is most likely because

A) the item is sensitive.
B) the respondent is not in a position to answer the item.
C) the item is open-ended.
D) the item is unclear.

Question 70

Hakeem developed an attitudes about the importance of green space on campus. The measure was five items long and he administered it to twenty five people in his pilot study. He conducted a reliability analysis of the scale and found it to be quite low .25). Given he needs to have a reliability estimate of .80 to appease his dissertation committee, which of the following would you suggest to Hakeem?

A) Administer the pilot to more people and do the analysis again.
B) Lengthen the scale and send it out without another pilot.
C) Lengthen the scale and conduct another pilot to see if it goes up.
D) Reduce the number of items to two or three to increase reliability.