Question 1

________ is the extent to which differences in observed scale scores reflect true differences among objects on the characteristics being measured,rather than systematic or random errors.
A)Validity
B)Generalizability
C)Reliability
D)None of the above

Accepted Answer

Validity refers to the extent to which a measurement tool is measuring what it is supposed to measure. In this case, the extent to which the differences in observed scale scores reflect true differences among objects on the characteristics being measured. Reliability, on the other hand, refers to the consistency of the measurement tool. Generalizability refers to the extent to which the findings of a study can be applied to other contexts or populations. None of the above is not a correct choice as one of the options is correct.

Question 2

Which of the following is not a problem with alternative-forms reliability?
A)The results will depend on how the scale items are split.
B)It is time consuming and expensive to construct an equivalent form of the scale.
C)It is difficult to construct two equivalent forms of a scale.
D)Both B and C are correct.

Accepted Answer

Alternative-forms reliability does not involve splitting scale items; it involves creating two equivalent forms of a scale, which can be time-consuming and difficult.

Question 3

________ is the variation in the information sought by the researcher and the information generated by the measurement process employed.
A)Systematic error
B)Measurement error
C)Random error
D)Variable error

Accepted Answer

Measurement error refers to the difference between the information researchers seek to measure and what is actually measured. Systematic error is caused by consistent bias or flaws in the measurement process, while random error refers to the unpredictable and unavoidable variations in measurement. Variable error is not a commonly used term in the context of measurement error.

Question 4

________ is an approach for assessing the internal consistency of the set of items when several items are summated in order to form a total score for the scale.
A)Internal consistency reliability
B)Split-half reliability
C)Test-retest reliability
D)Alternative-forms reliability

Accepted Answer

Internal consistency reliability is used to assess the consistency of a set of items that are used to create a total score for a scale. This approach measures the extent to which items on the scale are related to each other, with the goal of ensuring that the scale measures a single construct or concept. This is typically done by using a statistical technique known as Cronbach's alpha, which calculates the degree of correlation between each item on the scale and the total score, and provides a measure of the scale's internal consistency.

Question 5

X_O = X_T + X_S + X_R In the true score model shown above,X_T represents ________. A)random error B)the observed score or measurement C)the true score of the characteristic D)systematic error

Accepted Answer

X_T represents the true score of the characteristic in the true score model.

Question 6

________ represents stable factors that affect the observed score in the same way each time the measurement is made,such as mechanical factors (see Fig.9.6 in the text).
A)Systematic error
B)Measurement error
C)Random error
D)Variable error

Accepted Answer

Systematic error represents stable factors that affect the observed score in the same way each time the measurement is made, such as mechanical factors. The other options - measurement error, random error, and variable error - refer to factors that can cause variability in the observed score and are not necessarily stable.

Question 7

A measure is perfectly reliable if ________. A)X_O = 0 B)X_T = 0 C)X_S = 0 D)X_R = 0

Accepted Answer

A measure is perfectly reliable if the random error (X_R) is zero, meaning that the observed score (X_O) equals the true score (X_T) without any error.

Question 8

________ is the extent to which a scale produces consistent results if repeated measurements are made on the characteristic.
A)Validity
B)Generalizability
C)Reliability
D)None of the above

Accepted Answer

Reliability refers to the consistency of the results obtained using a particular measuring instrument, such as a scale. It indicates the degree to which repeated measurements of the same characteristic with the same instrument give the same result. Validity concerns whether the scale actually measures what it is intended to measure, and generalizability concerns the extent to which the findings of a study can be applied to other populations or settings. None of the above is not the best choice as all the options are related to the concept of the question.

Question 9

A scale designed to measure store image would be considered inadequate if it omitted any of the major dimensions (quality,variety,assortment of merchandise,etc. ).This inadequacy would be reflected in the ________ of the scale.
A)construct validity
B)content validity
C)criterion validity
D)internal consistency validity

Accepted Answer

Content validity refers to the degree to which a scale adequately covers all the dimensions or aspects of the construct being measured. In this case, if a scale designed to measure store image omits any major dimensions, it would result in a lack of content validity. Therefore, option B is the correct choice. Construct validity relates to the extent to which a scale accurately measures the construct it intends to measure. Criterion validity is the extent to which a scale can predict or correlate with an external criterion. Internal consistency validity measures the degree of consistency within the items of the scale. However, neither of these three options relate to the issue of missing dimensions of the construct being measured, unlike content validity.

Question 10

In ________ the degree of similarity between two measurements is determined by computing a correlation coefficient.The higher the correlation coefficient,the greater the reliability.
A)test-retest reliability
B)internal consistency reliability
C)coefficient alpha
D)coefficient beta

Accepted Answer

The described method of determining similarity between measurements by computing a correlation coefficient is known as test-retest reliability. The higher the correlation coefficient, the greater the reliability of the measurements. Internal consistency reliability (B) refers to the degree of consistency between items on a single measurement instrument. Coefficient alpha (C) is a measure of internal consistency reliability, specifically for scales or questionnaires with multiple items. Coefficient beta (D) is not a commonly used term in the field of measurement reliability.

Question 11

Which of the following is not an approach to assess multi-item scale reliability?
A)test-retest reliability
B)construct reliability
C)alternative forms reliability
D)internal consistency reliability

Accepted Answer

Construct reliability is not an approach to assess multi-item scale reliability. The other three options (test-retest reliability, alternative forms reliability, and internal consistency reliability) are all common approaches used to test the reliability of multi-item scales.

Question 12

There are several problems associated with the test-retest approach to determining reliability.If measuring respondents' attitude toward low-fat milk may cause them to become more health conscious and develop a more positive attitude toward low-fat milk,then there is a problem with ________.
A)the time interval between testing
B)the initial measurement altering the characteristic being measured
C)it being impossible to make repeated measurements
D)the first measurement having a carryover effect to the second or subsequent measurements

Accepted Answer

The problem with the test-retest approach in this scenario is that the initial measurement (asking about their attitude toward low-fat milk) may actually alter the characteristic being measured (their actual attitude toward low-fat milk). This means that the results of the second measurement may be skewed or inaccurate due to the influence of the initial measurement.

Question 13

Situational factors,such as the lack of clarity of the scale,including the instructions or the items themselves,and analysis factors,such as differences in scoring and statistical analysis are both ________ in measurement.
A)random error
B)potential sources of reliability
C)potential sources of error
D)systematic error

Accepted Answer

Situational factors and analysis factors both have the potential to introduce error and thereby reduce the reliability and validity of the measurement. They are not necessarily random or systematic, but their impact can be significant on the accuracy of the results. Therefore, the correct option is C, potential sources of error.

Question 14

________ is an approach for assessing reliability in which respondents are administered identical sets of scale items at two different times under as nearly equivalent conditions as possible.
A)Internal consistency reliability
B)Split-half reliability
C)Test-retest reliability
D)Alternative-forms reliability

Accepted Answer

Test-retest reliability involves administering the same set of scale items to the same group of respondents on two separate occasions to assess the consistency of their responses over time. This approach is useful for determining whether a particular measurement tool yields consistent results over a relatively stable span of time.

Question 15

________ is a type of validity,sometimes called face validity,that consists of a subjective but systematic evaluation of the representativeness of the content of a scale for the measuring task at hand.
A)Construct validity
B)Content validity
C)Criterion validity
D)Internal consistency validity

Accepted Answer

Content validity involves evaluating whether the content of a scale is representative of the construct being measured. This is often done through a subjective evaluation by experts in the field or by the target population. Content validity is sometimes referred to as face validity because it assesses whether the scale appears to measure what it is intended to measure on the surface.

Question 16

________ is not constant.It represents transient factors that affect the observed score in different ways each time the measurement is made,such as transient personal or situational factors.
A)Systematic error
B)Measurement error
C)Random error
D)Variable error

Accepted Answer

Random error represents the unpredictable or chance factors that affect the observed score. It is not systematic or constant and can be caused by various factors such as mood, noise, fatigue, etc., which may affect the measurement differently each time it is taken.

Question 17

________ is a form of internal consistency reliability in which the items constituting the scale are divided into two halves and the resulting half scores are correlated.
A)Internal consistency reliability
B)Split-half reliability
C)Test-retest reliability
D)Alternative-forms reliability

Accepted Answer

Split-half reliability is the type of internal consistency reliability in which the items of the scale are split into two halves and then the resulting half scores are correlated. This method is used to check if both halves of the questionnaire are consistent with each other. If the correlation coefficient between the two halves is high, it means that the scale is internally consistent.

Question 18

________ is a measure of internal consistency reliability that is the average of all possible split-half coefficients resulting from different splittings of the scale items.
A)Coefficient delta
B)Coefficient alpha
C)Coefficient beta
D)Coefficient eta

Accepted Answer

The measure described in the question is coefficient alpha, which is the most commonly used measure of internal consistency reliability.

Question 19

________ is assessed when the data on the scale being evaluated on the criterion variables are collected at the same time.
A)Convergent validity
B)Predictive validity
C)Concurrent validity
D)Discriminant validity

Accepted Answer

Concurrent validity is assessed when data on both the scale being evaluated and the criterion variables are collected at the same time, making it the best choice. Convergent validity is assessed when multiple measures of the same construct are correlated with each other, predictive validity is assessed when a scale is used to predict future behavior, and discriminant validity is assessed when a scale is shown to be distinct from other measures that assess different constructs.

Question 20

________ is a type of validity that examines whether the measurement scale performs as expected in relation to other variables selected as meaningful criteria.
A)Construct validity
B)Content validity
C)Criterion validity
D)Internal consistency validity

Accepted Answer

Criterion validity examines whether a measurement scale performs as expected in relation to other variables selected as meaningful criteria. Construct validity examines whether a measurement scale measures what it is intended to measure. Content validity examines whether a measurement scale adequately covers all aspects of the construct being measured. Internal consistency validity examines the extent to which the items within a measurement scale are consistent with each other.

Quiz 9: Measurement and Scaling: Noncomparative Scaling Techniques

________ is the extent to which differences in observed scale scores reflect true differences among objects on the characteristics being measured,rather than systematic or random errors.

Which of the following is not a problem with alternative-forms reliability?

________ is the variation in the information sought by the researcher and the information generated by the measurement process employed.

________ is an approach for assessing the internal consistency of the set of items when several items are summated in order to form a total score for the scale.

X_O = X_T + X_S + X_R In the true score model shown above,X_T represents ________.

________ represents stable factors that affect the observed score in the same way each time the measurement is made,such as mechanical factors (see Fig.9.6 in the text) .

A measure is perfectly reliable if ________.

________ is the extent to which a scale produces consistent results if repeated measurements are made on the characteristic.

A scale designed to measure store image would be considered inadequate if it omitted any of the major dimensions (quality,variety,assortment of merchandise,etc. ) .This inadequacy would be reflected in the ________ of the scale.

In ________ the degree of similarity between two measurements is determined by computing a correlation coefficient.The higher the correlation coefficient,the greater the reliability.

Which of the following is not an approach to assess multi-item scale reliability?

There are several problems associated with the test-retest approach to determining reliability.If measuring respondents' attitude toward low-fat milk may cause them to become more health conscious and develop a more positive attitude toward low-fat milk,then there is a problem with ________.

Situational factors,such as the lack of clarity of the scale,including the instructions or the items themselves,and analysis factors,such as differences in scoring and statistical analysis are both ________ in measurement.

________ is an approach for assessing reliability in which respondents are administered identical sets of scale items at two different times under as nearly equivalent conditions as possible.

________ is a type of validity,sometimes called face validity,that consists of a subjective but systematic evaluation of the representativeness of the content of a scale for the measuring task at hand.

________ is not constant.It represents transient factors that affect the observed score in different ways each time the measurement is made,such as transient personal or situational factors.

________ is a form of internal consistency reliability in which the items constituting the scale are divided into two halves and the resulting half scores are correlated.

________ is a measure of internal consistency reliability that is the average of all possible split-half coefficients resulting from different splittings of the scale items.

________ is assessed when the data on the scale being evaluated on the criterion variables are collected at the same time.

________ is a type of validity that examines whether the measurement scale performs as expected in relation to other variables selected as meaningful criteria.