Question 1

Dr. Feelgood reports a Cronbach's alpha of .95 for a scale of 6 Likert items that measures compassion. She may legitimately make which of the assumptions or conclusions?&#10;A) Overall item intercorrelations are high&#10;B) The items may be measuring more than one construct&#10;C) Another index of reliability should be provided&#10;D) All of the above

Accepted Answer

A high Cronbach's alpha like .95 suggests high inter-item correlations (A). It may also indicate redundancy or that items measure more than one construct (B). Providing another reliability index can offer additional insights (C).

Question 2

Which of the following is true about measurement validity?&#10;A) It is easier to obtain than measurement reliability&#10;B) The correlation coefficient is used to describe all types of validity&#10;C) A correlation coefficient is used to describe criterion validity&#10;D) Face validity is the best evidence of measurement validity&#10;E) It is a property of the instrument as opposed to how the measure is to be used

Accepted Answer

Criterion validity refers to the degree to which a measure is related to an outcome, criterion or endpoint. A correlation coefficient is commonly used to assess criterion validity. (Option A is incorrect because measurement validity is typically more difficult to establish than measurement reliability, as validity assesses the accuracy of the measure while reliability assesses the consistency of the measure. Option B is incorrect because there are various types of validity that do not necessarily involve correlation. Option D is incorrect because face validity is the simplest type of validity and it does not provide strong evidence of validity. Option E is incorrect because measurement validity is not solely dependent on the instrument itself, but also on how it is used and the context in which it is used.)

Question 3

A researcher is developing a tool on prosocial behavior in toddlers. She wants to prove evidence for measurement validity. Which of the following is true about content validity?&#10;A) A panel of experts should review items for representativeness of the concept&#10;B) A correlation coefficient of .80 would be acceptable&#10;C) The researcher should do a thorough literature review on prosocial behavior in toddlers&#10;D) a and c

Accepted Answer

Content validity refers to whether the test items adequately measure the construct being studied. A panel of experts should review the test items to determine if they are representative of the concept being measured (a). Additionally, the researcher should conduct a literature review to ensure that the items align with previously established definitions of prosocial behavior in toddlers (c). Therefore, both (a) and (c) are true statements about content validity. A correlation coefficient (b) pertains to criterion validity, which is a different type of validity.

Question 4

A researcher develops an aptitude test to predict entry level nursing students' probability of graduating successfully from a 4-year nursing school. The dropout rate is 25%. Which of the following is true about predictive evidence of validity?

A) An r of .9 would suggest that predictive evidence is high
B) The criterion variable will have more participants than the predictor variable
C) Entry-level students can be compared concurrently with a group of graduating students
D) a and b

Accepted Answer

In predictive evidence of validity, a high correlation coefficient (r) between the test scores and later outcomes (such as graduation) indicates strong validity. An r of .9 is considered very high, indicating strong predictive evidence of validity. Therefore, option A is correct. Option B is incorrect, as the number of participants in the predictor and criterion variables does not affect the validity of predictive evidence. Option C is also incorrect, as the study design for predictive evidence involves administering the predictor test to a group of entry-level students and gathering data on their later outcomes (graduation) after a specific time period, rather than concurrently comparing entry-level students with graduating students. Option D is partially correct but does not explain the logic and reasoning behind the choices.

Question 5

Dr. Thera Pea has developed a social problem-solving test. In order to establish its criterion validity, she wants to give it to undergraduate students to see if it will predict grade point average in a graduate social work program. She is able to establish high concurrent evidence for the test. Which of the following would be true?

A) She gave the test to graduate students in the social work program and measured their GPAs
B) She gave the test to undergraduate students
C) She assumed that there is little change in social problem-solving skills during the time between undergraduate and graduate studies
D) a and c
E) All of the above

Accepted Answer

Criterion validity involves comparing the test to an outcome that it should theoretically be able to predict. In this case, Dr. Thera Pea is looking to see if the social problem-solving test can predict GPA in a graduate social work program. Establishing high concurrent evidence means she compared the test scores to the GPAs at the same time, which implies she tested current graduate students (A) and assumed the skills measured do not significantly change between undergraduate and graduate studies (C).

Question 6

Dr. Ann L. Retentive wants to establish construct validity for an instrument to measure perfectionism. Which of the following is true about convergent evidence for validity?&#10;A) There should be relatively low correlations between the instrument and other, theoretically related measures&#10;B) The researcher should develop some hypotheses about what the instrument should predict based on a theoretical framework&#10;C) The researcher needs to find a standardized, external criterion for comparison&#10;D) a and c

Accepted Answer

Convergent evidence for validity refers to demonstrating that the instrument correlates as expected with other measures that should theoretically be related to the construct being measured. Therefore, it is necessary for the researcher to first develop hypotheses about what the instrument should predict based on a theoretical framework. Option A is incorrect because there should be relatively high correlations between the instrument and other theoretically related measures, not low. Option C is partially correct but lacks specificity; the researcher needs to find a standardized, external criterion for comparison but also needs to demonstrate that the instrument correlates with other measures that assess the same construct. Option D is incorrect because option A is incorrect.

Question 7

Measurement reliability influences the accurate assessment of a study's results.

Accepted Answer

Measurement reliability is important because if the measurement is not consistent and reliable it can lead to inaccurate results and conclusions. Therefore, measurement reliability does influence the accurate assessment of a study's results.

Question 8

If a measurement tool has high reliability, it must have high validity as well.

Accepted Answer

Reliability and validity are two different aspects of measurement. Reliability refers to the consistency or stability of a measurement tool over time or across different observers, while validity refers to the accuracy or truthfulness of a measurement tool in measuring what it is intended to measure. A measurement tool can have high reliability but low validity, meaning that it consistently measures a certain variable but does not actually measure what it is intended to measure. Therefore, high reliability does not necessarily guarantee high validity.

Question 9

Criterion evidence for validity depends on establishing an r between the measurement instrument and a measurable external criterion.

Accepted Answer

Criterion evidence for validity requires establishing a correlation (typically an r value) between the scores on the measurement instrument and scores on an external criterion or measure, supporting the validity of the measurement instrument.

Question 10

A disadvantage of predictive criterion validity is that the researcher must wait until those tested initially can be measured on the criterion.

Accepted Answer

Predictive criterion validity requires measuring the predictive validity of a test at a later point in time, meaning researchers must wait until participants can be measured on the criterion. This can be a disadvantage if the criterion cannot be measured for an extended period or if participants drop out before the criterion can be measured.

Question 11

Construct validity is based on the assumption that the hypothetical concept of interest is directly observable and measurable.

Accepted Answer

The answer of Construct validity is based on the assumption...

Question 12

One form of evidence for criterion validity is if the instrument has a clear, interpretable factor structure.

Accepted Answer

The answer of One form of evidence for criterion validity...

Question 13

Factor analysis supports the theory-based grouping of items and is evidence-based on internal structure.

Accepted Answer

The answer of Factor analysis supports the theory-based grouping of...

Question 14

A single study can provide sufficient evidence of an instrument's validity.

Accepted Answer

The answer of A single study can provide sufficient evidence...

Question 15

Researchers should always strive to develop their own measurement tools.

Accepted Answer

The answer of Researchers should always strive to develop their...

Question 16

If a tool has high measurement validity, it must have high measurement reliability.

Accepted Answer

The answer of If a tool has high measurement validity,...

Question 17

According to the 1985 Standards, in your own words describe the difference between convergent and concurrent validity.

Accepted Answer

The answer of According to the 1985 Standards, in your...

Question 18

Why is it inappropriate to say a test is valid or invalid?

Accepted Answer

The answer of Why is it inappropriate to say a...

Question 19

According to the 1999 Standards what are the types of validity for evidence based on other variables?

Accepted Answer

The answer of According to the 1999 Standards what are...

Deck 12: Measurement Validity