Question 1

A definition of Construct "A" in terms of Constructs "B","C",and "D" is known as a(n)
A)working definition.
B)operational definition.
C)theoretical definition.
D)textbook definition.
E)conceptual definition.

Accepted Answer

The answer of A definition of Construct "A" in terms...

Question 2

Of the many sources of differences of scores,the researcher is especially interested in isolating the differences due to
A)situational factors.
B)variations in administration.
C)mechanical factors.
D)true differences in the characteristic.
E)the sampling of items.

Accepted Answer

The researcher would want to isolate the differences that are truly reflective of differences in the characteristic being measured, and not due to situational factors (A), variations in administration (B), mechanical factors (C), or sampling of items (E). This would help ensure that the scores obtained are as accurate and reliable as possible.

Question 3

A test necessarily lacks content validity when it
A)does not successfully predict the criterion.
B)is made up of a statistically significant selected sample of items from a large collection of items.
C)has excellent "face validity."
D)is made up of a random selection of items from a population of items.
E)is made up of items which do not represent the domain of the construct.

Accepted Answer

Content validity refers to the degree to which a test actually measures the domain or construct it is supposed to measure. If the items in the test do not represent the domain of the construct accurately, it lacks content validity. Therefore, option E is the correct choice. A is incorrect because prediction of criterion is not necessarily related to content validity. B, C, and D are also incorrect as they do not relate to content validity directly.

Question 4

Which of the following statements is INCORRECT with respect to predictive validity?
A)It is relatively easy to assess.
B)It includes predictive and concurrent validity.
C)It is usually established by means of a correlation.
D)It is the most important kind of validity since it enables researchers to make accurate predictions.
E)It requires measurement of a criterion variable.

Accepted Answer

The answer of Which of the following statements is INCORRECT...

Question 5

While completing a survey on attitudes toward house ownership,John was hit by an attack of indigestion.Which of the following best accounts for the difference between John's and another respondent's scores?
A)A true difference in attitudes
B)A true difference in personality between john and bob
C)A difference due to temporary personal factors
D)A difference due to situational factors
E)A difference due to variations in administration.

Accepted Answer

John's indigestion is a temporary personal factor that could have affected his response to the survey questions, leading to a difference in his scores compared to another respondent who did not experience such temporary personal factors. Other factors such as true differences in attitudes or personality between John and the other respondent, situational factors or variations in administration may contribute to differences in scores, but in this specific scenario, the best explanation is C.

Question 6

Convergent validity is
A)demonstrated by showing how well the content of the test samples the subject matter.
B)demonstrated by correlating independent measures of the same construct.
C)demonstrated by the goodness of the predictions made with the measure.
D)demonstrated by the stability in scores exhibited by the measure.
E)never demonstrated.

Accepted Answer

Convergent validity is demonstrated by correlating independent measures of the same construct to show that they are measuring the same underlying construct. This is done to establish the accuracy and consistency of the measure.

Question 7

Exhibit 12.1 An advertiser has developed a television advertisement designed to create a "feeling of warmth" on the part of viewers since she believes that this will lead to positive attitudes toward the product,and ultimately to increased sales.In order to determine if the ad does produce the desired feelings in viewers,she has devised a three-item scale to measure the warmth construct.After viewing the commercial (independently),Joe had a score of 15 on the warmth scale and Perry had a score of 9.
Refer to Exhibit 12.1.Which of the following statements is FALSE?
A)The scale used is likely to be at least as reliable as a ten-item scale since a ten-item scale is more likely to inadvertently tap into constructs other than warmth.
B)If Joe and Perry had viewed the commercial and listened to instruction together at the same time,and then had completed the scales,at least one source of variation might have been greatly reduced.
C)It is possible that Perry's lower score might have resulted from accidentally checking the wrong response.
D)Some relatively stable characteristic of an individual,such as Perry's unwillingness to share the actual intensity of his feelings,might have contributed to the difference in the two scores.
E)Joe did not necessarily have "warmer" feelings toward the ad than Perry.

Accepted Answer

The statement that the scale used is likely to be at least as reliable as a ten-item scale since a ten-item scale is more likely to inadvertently tap into constructs other than warmth is false. The reliability of a scale is not determined by the number of items, but by its internal consistency and ability to measure the intended construct. A ten-item scale may have better reliability if it measures the warmth construct accurately without including items that measure other constructs.

Question 8

Which of the following is FALSE?
A)Researchers measure attributes of objects,not necessarily the objects themselves.
B)The measurement process itself may contain error.
C)Psychological measurement is fairly simple because many measurement scales have already been developed.
D)Both a and b.
E)a,b,and c.

Accepted Answer

Choice C is the false statement in the given options. Psychological measurement is a complex and challenging task because it involves measuring abstract constructs such as emotions, attitudes, and personality traits, which are not directly observable. Developing valid and reliable measurement scales for psychological constructs requires careful consideration of various factors, including the underlying theoretical framework, the choice of response format, and the sample characteristics. Therefore, it is not accurate to say that psychological measurement is simple because many measurement scales have already been developed.

Question 9

Which of the following is FALSE?
A)Content validity is most directly concerned with the question of what the instrument is measuring,i.e. ,what construct underlies its performance.
B)Construct validity cannot truly be established without evidence of convergent and discriminant validity.
C)The content validity of a measure focuses on the adequacy with which the domain of the characteristic is captured by the measure.
D)Both a and b.
E)a,b,and c.

Accepted Answer

Content validity is concerned with whether the test covers the representative sample of the domain of the construct, not what construct underlies its performance.

Question 10

Which of the following is FALSE?
A)It is true about psychological measurement that the situation in which the measurement is obtained can affect the score obtained.
B)Random error is also known as constant error.This is due to the fact that there are typically an equal number of positive and negative errors that yield a constant sum.
C)The validity of a measurement instrument refers to the extent to which differences in scores reflect true differences among entities on the characteristic that the instrument seeks to measure.
D)Both a and b.
E)a,b,and c.

Accepted Answer

Random error is actually also known as "unsystematic error" or "chance error", not constant error. Constant error refers to a consistent bias in measurement.

Question 11

Which of the following is an example of construct validation procedures? When attempting to measure the personality of Chevrolet owners,researchers used the California Personality Inventory.
A)As expected,scores on this test were found to correlate highly with scores on Edwards Personal Preference Schedule but very low correlations were found with scores on a Social Responsibility scale.
B)Scores of the California Personality Inventory were administered to the same subjects on two different occasions and correlated.
C)Scores on the California Personality Inventory were used to predict attitudes toward Chevrolets.
D)Scores on the California Personality Inventory were found to successfully predict Chevrolet owners.
E)All of the above are examples of procedures followed in examining the construct validity of a measure.

Accepted Answer

Option A is the only example that specifically mentions the use of a measure (the California Personality Inventory) to validate a construct (the personality of Chevrolet owners) by demonstrating the expected high correlation with a related measure (Edwards Personal Preference Schedule) and low correlation with an unrelated measure (Social Responsibility scale). Options B, C, and D are not examples of construct validation procedures, but rather alternative methods of data analysis or prediction. Option E is not a valid answer because it includes all options, even those that do not relate to construct validation procedures.

Question 12

Theory and hypothetical constructs are not of much practical use unless
A)a diagram can be used to illustrate linkages among the constructs.
B)it has been proven that the concepts really exist.
C)a relationship has been imprecisely stated.
D)they have been tested using empirical research.
E)All of the above.

Accepted Answer

The practical use of theory and hypothetical constructs lies in their ability to inform empirical research, providing a framework for investigation and potential hypotheses to be tested. Therefore, testing using empirical research is necessary to determine the validity and usefulness of these constructs. A diagram may aid in understanding the constructs, but it is not essential. The existence of any given construct is not as important as its usefulness in guiding research, and an imprecise statement of relationships can still provide a starting point for investigation.

Question 13

In a recent survey,those who brushed their teeth often under-reported the activity,while those who brushed their teeth less frequently overreported their dental hygiene behavior.The possible cause for differences in scores could best be attributed to
A)a true difference in the characteristic being measured.
B)differences due to situational factors.
C)differences due to temporary personal factors.
D)true differences in other relatively stable characteristics of the individuals.
E)differences due to variations in administration.

Accepted Answer

The answer of In a recent survey,those who brushed their...

Question 14

The time a person wakes up in the morning has been shown to be a good predictor of the time the person goes to bed.Wake up time is best described as having
A)construct validity.
B)content validity.
C)concurrent validity.
D)predictive validity.
E)convergent validity.

Accepted Answer

Predictive validity is the extent to which a measure predicts the behavior or outcome it is intended to measure. In this case, wake up time predicts the time a person goes to bed, making it a good predictor of sleep behavior.

Question 15

Which of the following is TRUE?
A)Three aspects of validity - pragmatic,content,and construct - are not only conceptually independent but are in actual practice rarely related to each other.
B)A measure has been used repeatedly and has produced almost identical answers;therefore this instrument is valid.
C)Random error is less troublesome than systematic error.
D)Both a and b.
E)a,b,and c.

Accepted Answer

Random error can be accounted for and minimized through study design and increased sample size, whereas systematic error is more difficult to detect and correct for because it is inherent in the measurement process. Therefore, systematic error is generally considered more concerning than random error.

Option A is incorrect because the three aspects of validity are conceptually related and often have important practical implications for each other. 
Option B is incorrect because test-retest reliability (producing almost identical answers) is a measure of consistency or stability, but not necessarily validity. 
Option D and E are incorrect for the reasons given above.

Question 16

Exhibit 12.1 An advertiser has developed a television advertisement designed to create a "feeling of warmth" on the part of viewers since she believes that this will lead to positive attitudes toward the product,and ultimately to increased sales.In order to determine if the ad does produce the desired feelings in viewers,she has devised a three-item scale to measure the warmth construct.After viewing the commercial (independently),Joe had a score of 15 on the warmth scale and Perry had a score of 9.
Refer to Exhibit 12.1.Which of the following is NOT a potential source of difference between these scores?
A)True differences with regard to the feeling of warmth created by the ad.
B)Perry had a rotten day at work,while Joe had a good day.
C)The sampling of items chosen to measure warmth could have contributed to the difference in scores.
D)Perry and Joe interpreted one of the questions differently.
E)All of the above are potential sources of differences between the scores.

Accepted Answer

All of the options listed are potential sources of differences between the scores, including true differences in feelings, external factors affecting mood, sampling of items, and interpretation of questions.

Question 17

Due to a misunderstanding of his instructions,a research assistant consistently entered the upper value of an attitude scale as a "6" instead of a "7" when keypunching data for his boss.This is an example of
A)systematic error.
B)researcher error.
C)random error.
D)scaling error.
E)marginal error.

Accepted Answer

This is an example of systematic error because it is consistent and always in the same direction (entering "6" instead of "7").

Question 18

An operational definition defines
A)how a construct is measured.
B)a construct using other constructs.
C)the usefulness of the measuring instrument.
D)the reliability of the measuring instrument.
E)the validity of the measure.

Accepted Answer

An operational definition defines how a construct is measured, meaning it specifies the observable operations, procedures, or conditions used to measure a construct. Essentially, it describes how a researcher plans to measure a concept in a way that is specific and measurable. It is one of the most critical steps in creating a research study because it ensures that the concept being studied is defined and measured in a consistent and objective way.

Question 19

Predictive validity is NOT concerned with
A)the use of a test score to predict some future occurrence.
B)the relationship between the predictive and criterion variables when both are assessed at the same point in time.
C)the use of a test score to predict some simultaneous occurrence.
D)the degree to which the measure appears to be measuring the full range of the construct.
E)predictive validity is concerned with all of the above.

Accepted Answer

Predictive validity is concerned with the ability of a measure to predict future outcomes or events, and is not related to whether the measure appears to be measuring the full range of the construct or whether the predictive and criterion variables are assessed at the same time. Therefore, the correct answer is D, as this option is not related to predictive validity.

Question 20

Validity is
A)concerned with the relationships of random error with systematic error.
B)equal to the true score plus the systematic error.
C)equal to the true score plus systematic error minus random error.
D)concerned with the extent to which differences in scores reflect true differences in the characteristic.
E)concerned with the extent to which differences in scores reflect instability in the measurements.

Accepted Answer

Validity is concerned with the extent to which differences in scores reflect true differences in the characteristic being measured. In other words, how accurately a test or measurement reflects what it is intended to measure. It is not directly concerned with random or systematic error, or the stability of measurements. Option A is incorrect because validity is not only concerned with error sources but also with the accuracy of measurement. Option B is incorrect because systematic error is not included in the calculation of validity. Option C is incorrect because random error is not subtracted from the true score to determine validity. Option E is incorrect because validity does not specifically address measurement instability.

Quiz 12: Asking Good Questions: Measurement Basics

A definition of Construct "A" in terms of Constructs "B","C",and "D" is known as a(n)

Of the many sources of differences of scores,the researcher is especially interested in isolating the differences due to

A test necessarily lacks content validity when it

Which of the following statements is INCORRECT with respect to predictive validity?

While completing a survey on attitudes toward house ownership,John was hit by an attack of indigestion.Which of the following best accounts for the difference between John's and another respondent's scores?

Convergent validity is

Which of the following is FALSE?

Which of the following is FALSE?

Which of the following is FALSE?

Which of the following is an example of construct validation procedures? When attempting to measure the personality of Chevrolet owners,researchers used the California Personality Inventory.

Theory and hypothetical constructs are not of much practical use unless

In a recent survey,those who brushed their teeth often under-reported the activity,while those who brushed their teeth less frequently overreported their dental hygiene behavior.The possible cause for differences in scores could best be attributed to

The time a person wakes up in the morning has been shown to be a good predictor of the time the person goes to bed.Wake up time is best described as having

Which of the following is TRUE?

Due to a misunderstanding of his instructions,a research assistant consistently entered the upper value of an attitude scale as a "6" instead of a "7" when keypunching data for his boss.This is an example of

An operational definition defines

Predictive validity is NOT concerned with

Validity is