Question 1

The main threat(s) to the validity of direct observation is (are)
A) observer effect.
B) observer bias.
C) instrumentation.
D) a and b
E) a and c

Accepted Answer

Both observer effect and observer bias can threaten the validity of direct observation. Observer effect refers to the change in behavior of the person being observed due to the presence of the observer. Observer bias refers to the subjective interpretation of the behavior being observed by the observer. Instrumentation, which refers to issues with the recording devices used for observation, is not as significant a threat to validity as observer effect and observer bias.

Question 2

A researcher investigating a teacher's use of positive reinforcement in the classroom observed the classroom in five-minute cycles and recorded the number of instances of positive reinforcement during the cycle.The researcher was using
A) time coding.
B) sign coding.
C) a situational test.
D) contrived observation.
E) case sampling.

Accepted Answer

Time coding involves dividing the observation period into equal time intervals and recording the behaviors that occur during each interval. In this case, the researcher used five-minute cycles to observe the teacher's use of positive reinforcement. Therefore, A) time coding is the best choice. Sign coding involves identifying and categorizing specific behavioral signs, a situational test involves creating a scenario to observe behavior, contrived observation involves artificially creating a situation to observe behavior, and case sampling involves selecting specific cases to observe. These methods do not apply to this scenario.

Question 3

Which one of the following statements would be most suitable for a Likert-type scale measuring students' attitudes toward math?
A) Math is easy for some students and difficult for others.
B) Math is fun.
C) Math is one of the basic skills.
D) Some students like math.

Accepted Answer

A Likert-type scale is used to measure attitudes, which are subjective and personal opinions or feelings. Option B, "Math is fun," is a subjective statement and reflects a positive attitude toward math. The other options are either objective statements or neutral opinions that do not reflect a clear attitude toward math.

Question 4

The points on a rating scale will be least ambiguous when they are identified by
A) constant alternatives (never, seldom, often, etc.).
B) numbers.
C) descriptive phrases.
D) trait names.

Accepted Answer

Descriptive phrases provide clear context and meaning, reducing ambiguity in interpretation compared to numbers or vague terms.

Question 5

To select the most discriminating items for a Likert-type attitude scale, one would administer the items to a pilot group and then calculate the correlations between
A) item scores and total scores.
B) scores on the odd and even items.
C) scores on the positively stated and the negatively stated items.
D) scores on the scale and scores on criterion measuring the same attitudes.

Accepted Answer

Calculating the correlations between item scores and total scores would show which items have the highest correlation with overall attitude. These items would be the most discriminating and would be included in the final scale. Correlating scores on odd and even items or positively and negatively stated items would not necessarily indicate which items are most discriminating. Correlating scores on the scale with scores on a criterion measuring the same attitudes may be useful but is not mentioned in the question stem.

Question 6

Which of the following is not a characteristic of a group-administered standardized achievement test?
A) Uniform directions for administration are provided.
B) Scores can be interpreted by comparing them with group norms.
C) It must be administered by persons with specialized training.
D) Scores are relatively unaffected by administrators' biases.
E) Reliability and validity data are provided.

Accepted Answer

Group-administered standardized achievement tests can be administered by individuals without specialized training, making option C incorrect. The other options are all characteristics of group-administered standardized achievement tests.

Question 7

Exhibit 8-4: Select the type of problem likely to be made in the situations listed.
-Refer to Exhibit 8-4.A researcher using a five-point rating scale to assess kindergartners' creativeness in their drawing gives only ratings of 4 or 5.
A) Observer bias
B) Error of leniency
C) Error of central tendency
D) Halo effect
E) Contamination

Accepted Answer

The researcher is committing the error of leniency by only giving ratings of 4 or 5, indicating a higher level of creativity than may actually be present.

Question 8

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed.
-Refer to Exhibit 8-6.To determine how teachers feel about a new attendance policy recently instituted in their school.
A) Rating scale
B) Inventory
C) Attitude scale
D) Direct observation

Accepted Answer

An attitude scale would be the best choice to determine how teachers feel about a new attendance policy as it is designed to measure an individual's attitudes or feelings towards a particular topic or issue. A rating scale and an inventory may not capture the depth of emotion or opinion about the new policy, while direct observation would be inappropriate for this purpose.

Question 9

A researcher wants to reduce observer bias and rating errors in a systematic classroom observational study.Which of the following would not be a recommended procedure?
A) Make the observational task as objective as possible.
B) Train the observers to a high level of reliability.
C) Give the observers as much information as possible about the research problem, hypotheses, and subject characteristics.
D) Do not give the observers information about the research problem, hypotheses, and subject characteristics.

Accepted Answer

Giving observers extensive information about the research problem, hypotheses, and subject characteristics can inadvertently introduce bias, as it may influence their expectations and observations, leading to observer bias rather than reducing it.

Question 10

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed.
-Refer to Exhibit 8-5.Predicts individuals' later performance on academic tasks.
A) Aptitude test
B) Personality test
C) Achievement test
D) Performance test

Accepted Answer

An aptitude test is designed to measure an individual's potential ability to perform certain activities or tasks. In this case, predicting individuals' later performance on academic tasks would require an assessment of their potential rather than their current knowledge or skills, making an aptitude test the most appropriate choice.

Question 11

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed.
-Refer to Exhibit 8-5.Measures individual differences in students' academic self-concept
A) Aptitude test
B) Personality test
C) Achievement test
D) Performance test

Accepted Answer

Personality tests are designed to measure aspects of a person's character or psychological makeup, which includes an individual's academic self-concept. This concept relates to how students perceive their own academic abilities, which is more aligned with personality assessments than with aptitude, achievement, or performance tests.

Question 12

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed.
-Refer to Exhibit 8-5.Used to measure students' ability to weigh chemicals and mix solutions correctly
A) Aptitude test
B) Personality test
C) Achievement test
D) Performance test

Accepted Answer

The correct answer is D) Performance test because this type of test evaluates the ability to perform specific tasks or skills, such as weighing chemicals and mixing solutions correctly, which are practical, hands-on activities.

Question 13

Ursula is an excellent salesperson, but does not get along well with other employees.Her supervisor, however, rates her highly on the dimension of "works well with others." The supervisor is most likely guilty of a
A) halo effect.
B) generosity error.
C) contrast effect.
D) logical error.

Accepted Answer

The supervisor is guilty of the halo effect, which occurs when one characteristic of an individual influences the overall evaluation of that individual. In this case, Ursula's strong sales skills are leading the supervisor to rate her highly on all dimensions, including "works well with others," despite evidence to the contrary.

Question 14

Exhibit 8-4: Select the type of problem likely to be made in the situations listed.
-Refer to Exhibit 8-4.A researcher strongly opposed to inclusion must make frequency counts of various interactions in a classroom with a number of disabled students.
A) Observer bias
B) Error of leniency
C) Error of central tendency
D) Halo effect
E) Contamination

Accepted Answer

The researcher's strong opposition to inclusion may lead to observer bias, where the researcher's preconceived beliefs influence the counting and interpretation of interactions in the classroom.

Question 15

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed.
-Refer to Exhibit 8-6.To determine the extent to which elementary teachers used positive reinforcement in the classroom.
A) Rating scale
B) Inventory
C) Attitude scale
D) Direct observation

Accepted Answer

Direct observation would be the most appropriate type of instrument for determining the extent to which elementary teachers used positive reinforcement in the classroom, as it would involve observing their behaviors and interactions with students firsthand. Rating scales, inventories, and attitude scales are more commonly used for self-report data collection or gathering information about participants' perceptions or attitudes.

Question 16

The most distinctive characteristic of a situational test is its
A) lifelike atmosphere.
B) use of laboratory equipment.
C) assumption of prior training.
D) relatively ambiguous test items.

Accepted Answer

The most distinctive characteristic of a situational test is its lifelike atmosphere, which is designed to replicate real-life situations and behaviors. This is what sets it apart from other types of tests and allows for a more accurate assessment of an individual's skills and abilities in a given context. The other options (use of laboratory equipment, assumption of prior training, relatively ambiguous test items) are not necessarily unique to situational tests and may be present in other types of assessments.

Question 17

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed.
-Refer to Exhibit 8-5.Measures individuals' knowledge and/or mastery of chemistry.
A) Aptitude test
B) Personality test
C) Achievement test
D) Performance test

Accepted Answer

An achievement test is designed to measure what a person has already learned or achieved, such as their knowledge of chemistry. Aptitude tests measure a person's potential for learning a specific skill or knowledge, performance tests measure a person's ability to perform a specific task, and personality tests measure a person's behavioral tendencies and traits.

Question 18

For the items listed, select the one that best represents the order form abstract to concrete.
A) Construct, scale, operation definition, variable
B) Variable, construct, operational definition, scale
C) Construct, variable, operational definition, scale
D) Construct, variable, scale, operational definition

Accepted Answer

The order should generally move from abstract to concrete - starting with a broad concept and then defining more specific details. The correct order is:

1. Construct (an overarching concept)
2. Variable (a specific aspect or component of the construct)
3. Operational definition (a clear and specific definition of the variable)
4. Scale (the method or tool used to measure the variable)

Option C follows this order, while the other options either have a different order or include extra items that disrupt the logic of the sequence.

Question 19

Exhibit 8-4: Select the type of problem likely to be made in the situations listed.
-Refer to Exhibit 8-4.A researcher who observes a student speaking rudely to her teacher rates that student very low on a number of behavioral traits.
A) Observer bias
B) Error of leniency
C) Error of central tendency
D) Halo effect
E) Contamination

Accepted Answer

The situation described in the exhibit is an example of the halo effect. This occurs when an individual's overall impression of someone affects their perception of that person's specific traits or behaviors. In this case, the researcher is allowing the student's rude behavior to overshadow their other behavioral traits, leading to a lower overall rating.

Question 20

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed.
-Refer to Exhibit 8-6.To obtain teachers' assessment of the leadership ability of the senior class officers.
A) Rating scale
B) Inventory
C) Attitude scale
D) Direct observation

Accepted Answer

A rating scale would be the most appropriate instrument to obtain teachers' assessment of the leadership ability of senior class officers. This type of instrument allows respondents to rate the officers on specific leadership qualities, such as communication skills, decision-making ability, and problem-solving skills. Rating scales are commonly used in evaluating performance or assessing attitudes, opinions, or behaviors on a pre-determined set of criteria.

Quiz 8: Tools of Research

The main threat(s) to the validity of direct observation is (are)

A researcher investigating a teacher's use of positive reinforcement in the classroom observed the classroom in five-minute cycles and recorded the number of instances of positive reinforcement during the cycle.The researcher was using

Which one of the following statements would be most suitable for a Likert-type scale measuring students' attitudes toward math?

The points on a rating scale will be least ambiguous when they are identified by

To select the most discriminating items for a Likert-type attitude scale, one would administer the items to a pilot group and then calculate the correlations between

Which of the following is not a characteristic of a group-administered standardized achievement test?

Exhibit 8-4: Select the type of problem likely to be made in the situations listed. -Refer to Exhibit 8-4.A researcher using a five-point rating scale to assess kindergartners' creativeness in their drawing gives only ratings of 4 or 5.

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed. -Refer to Exhibit 8-6.To determine how teachers feel about a new attendance policy recently instituted in their school.

A researcher wants to reduce observer bias and rating errors in a systematic classroom observational study.Which of the following would not be a recommended procedure?

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed. -Refer to Exhibit 8-5.Predicts individuals' later performance on academic tasks.

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed. -Refer to Exhibit 8-5.Measures individual differences in students' academic self-concept

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed. -Refer to Exhibit 8-5.Used to measure students' ability to weigh chemicals and mix solutions correctly

Ursula is an excellent salesperson, but does not get along well with other employees.Her supervisor, however, rates her highly on the dimension of "works well with others." The supervisor is most likely guilty of a

Exhibit 8-4: Select the type of problem likely to be made in the situations listed. -Refer to Exhibit 8-4.A researcher strongly opposed to inclusion must make frequency counts of various interactions in a classroom with a number of disabled students.

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed. -Refer to Exhibit 8-6.To determine the extent to which elementary teachers used positive reinforcement in the classroom.

The most distinctive characteristic of a situational test is its

Exhibit 8-5: Indicate the type of test that would be most appropriate for the purposes listed. -Refer to Exhibit 8-5.Measures individuals' knowledge and/or mastery of chemistry.

For the items listed, select the one that best represents the order form abstract to concrete.

Exhibit 8-4: Select the type of problem likely to be made in the situations listed. -Refer to Exhibit 8-4.A researcher who observes a student speaking rudely to her teacher rates that student very low on a number of behavioral traits.

Exhibit 8-6.Indicate the type of instrument that would be used for the purposes listed. -Refer to Exhibit 8-6.To obtain teachers' assessment of the leadership ability of the senior class officers.