Deck 10: Scale Construction: a Most Fundamental Tool

Question 1

In sampling and data collection for scale construction, a researcher must ensure that:

A) the sample is of convenience.
B) the size of the sample is appropriate.
C) the sample has high statistical validity.
D) the randomness of the sample is as low as possible.

Answer 1

B

Question 2

Identify a guideline suggested by DeVellis (2012) for developing scale items.

A) The readability of items should be examined to ensure they are at the appropriate level for the intended population.
B) Only one central thought should be dealt with in each item.
C) Indeterminate terms, like frequently or sometimes, and absolute terms, like all and none, in items should be avoided.
D) Awkward wording or dangling constructs and double negatives in items should be avoided.

Answer 2

A

Question 3

Which of the following is a characteristic of exploratory factor analysis (EFA)?

A) It is conducted when a researcher wants to assess the extent to which the hypothesized organization of a set of identified factors fits the data obtained.
B) It is used when a researcher wants to cross-validate the underlying factor structure of a construct with another sample.
C) It is conducted when a researcher wants to identify the factors necessary to explain the interrelationships among a set of indicators or items.
D) It is used when a researcher wants to test the hypothesis that a relationship between observed variables and their underlying latent constructs exists.

Answer 3

C

Question 4

In the context of inclusion of both positive and negatively worded items in a scale, DeVellis suggested that the benefits of having opposite direction items outweighed the disadvantages.

Question 5

_____ examines the interrelationships among a large number of items or variables and condenses that information into a smaller set of common underlying dimensions.

A) Regression
B) Scaling
C) Cluster analysis
D) Factor analysis

Question 6

The _____ of a scale can be established by providing a low correlation coefficient between two measures.

A) convergent validity
B) discriminant validity
C) internal validity
D) empirical validity

Question 7

To enhance the construct validity of a scale, researchers are advised to conduct content analyses and consult with domain experts and to pilot items to identify potential problems with their wording.

Question 8

Translating and back-translating the items of a scale ensure the validity of the items or scale in another culture.

Question 9

According to Cohen, Swerdlik, and Phillips (1996), the _____ refers to an indication of how much variance is shared by two variables.

A) coefficient of variation
B) coefficient of determination
C) test-retest reliability coefficient
D) coefficient alpha

Question 10

Identify a recommendation by Brown (2006) regarding confirmatory factor analysis (CFA) for cross-validation of a factor structure.

A) A researcher should use common factor analysis (CA) instead of confirmatory factor analysis (CFA) as it provides a real estimation of factor structure.
B) A researcher should use consistent methods across exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).
C) A researcher should use confirmatory factor analysis (CFA) instead of common factor analysis (CA) as it provides a real estimation of factor structure.
D) A researcher should use different estimation methods for the exploratory factor analysis (EFA) and confirmatory factor analysis (CFA).

Question 11

The fundamental aim of factor analysis is to search for underlying psychological constructs seen in the common dimensions that underlie the original items or variables.

Question 12

In order for the definition of a construct of interest to be operationalized, the construct should be written in a statement that is measurable.

Question 13

In the context of counseling research, which of the following is true of the measurement approaches based on the item response theory (IRT)?

A) It is used to relate one's response patterns to items of similar levels of difficulty to determine the reliability of the test.
B) It is used to identify levels of how items measure a certain attribute.
C) It is used to assess the ability of scale items to measure present performance with prior performance.
D) It is used to examine whether particular scale items have varying levels of internal validity.

Question 14

In scale construction, pilot testing provides a powerful tool for a researcher to identify items that might be misunderstood or unclear to the participants.

Question 15

A criterion-referenced scale measures an individual's ability.

Question 16

In the context of reliability estimates, coefficient alphas provide the researcher with information about the degree of the homogeneity or internal consistency among a set of items.

Question 17

According to Kline (2005), when conducting exploratory factor analysis (EFA) for new scale development, principal components analysis (PCA) provides a more realistic estimation of factor structure assuming that "the items are measured with errors."

Question 18

Which of the following is a myth on scale construction?

A) Items can be constructed only after an extensive literature review.
B) Representative samples must be used whenever possible.
C) Factor analysis alone provides sufficient evidence of a scale's validity.
D) Structural elements of a scale vary across cultures.

Question 19

The process of item generation in scale construction is highly linear.

Question 20

Which of the following is true of using scales in different cultural contexts?

A) The factor structure of a scale is universally valid across different cultural contexts.
B) A scale developed in one culture should not be used across different cultural contexts without acquiring additional data.
C) A psychological construct as measured by a scale does not differ across different cultural contexts.
D) The items that comprise a particular factor should exclude measures of convergent and discriminant estimates across different cultural contexts.