Question 1

Obtaining both test scores and criterion scores from some intact, preselected population, and then correlating the scores, is an example of _______.

Accepted Answer

This is an example of concurrent validity, which assesses the extent to which two measures of the same construct are related at the same time. In this case, the test scores and criterion scores are obtained at the same time and then correlated to determine the concurrent validity of the test.

Question 2

Two general strategies for assessing criterion-related validity are

Accepted Answer

Criterion-related validity involves comparing a measure to an external criterion, so the two types of validity that are most relevant are concurrent validity (assessing how well the measure correlates with a criterion measured at the same time) and predictive validity (assessing how well the measure predicts a criterion measured later on). Therefore, the correct answer is C.

Question 3

Criterion measures are often chosen

Accepted Answer

D

Question 4

The percentage of people in the population who are successful according to some criterion is the

Accepted Answer

The base rate refers to the percentage of people in the population who are successful according to some criterion, providing a general measure of how common a particular trait or outcome is within a given population.

Question 5

Trying to estimate a person's score on a particular measure on the basis of that person's score on some other measure is referred to as

Accepted Answer

Predicting a person's score on a particular measure on the basis of their score on some other measure involves using the information from the other measure to estimate or guess the score on the specific measure. This is often done in psychological research to make predictions about how people will perform on certain tasks or measures based on their performance or scores on other tasks or measures.

Question 6

Meta-Analysis:

Accepted Answer

Meta-analysis allows researchers to combine the results from previous validity research in order to reach more reliable and robust conclusions about the validity of a particular test.

Question 7

________ is a generic term which represents a variety of more practical methods for assessing validity.

Accepted Answer

The answer of ________ is a generic term which represents...

Question 8

A validity study is conducted in the workplace, where many workers have had many years of on-the-job experience. This study is probably a _______ validity study.

Accepted Answer

A concurrent validity study is conducted when the test and the criteria are measured at the same time, as in this case where workers' on-the-job experience is compared to their performance on a test. Predictive validity would involve using the test scores to predict future job performance, construct validity would involve assessing whether the test measures the intended construct (e.g., intelligence, leadership ability), and content validity would involve examining whether the test adequately covers the relevant content area.

Question 9

The population in a concurrent validity study is ________ than the population in a predictive validity study.

Accepted Answer

In a concurrent validity study, the population is often more selective because it typically involves individuals who are already known to have the characteristic being measured, whereas predictive validity studies involve a broader population to predict future outcomes.

Question 10

The most fundamental difference between predictive and concurrent validity strategies is that

Accepted Answer

The most fundamental difference between predictive and concurrent validity strategies is that criterion scores are obtained at different times. Predictive validity involves using a measure to predict future performance on a criterion, while concurrent validity involves using a measure to predict current performance on a criterion. Therefore, the criterion scores are obtained at different times in these two strategies.

Question 11

A practical objection to predictive validity strategies is that

Accepted Answer

The practical objection to predictive validity strategies is that the decision maker must select some applicants who will fail in order to compare the job performance of those who pass the test with those who do not. This raises ethical concerns and can lead to legal challenges. Therefore, option D is the best answer. Options A, B, and C are all important considerations for conducting a valid study, but they do not address the specific practical objection mentioned in the question.

Question 12

The accuracy of decisions is directly linked to the __________ of test scores.

Accepted Answer

Validity refers to the degree to which a test measures what it is intended to measure. If a test is valid, then decisions made based on the scores obtained from that test will be accurate. Therefore, the accuracy of decisions is directly linked to the validity of test scores. Reliability refers to the consistency of test scores and while important, it is not directly linked to the accuracy of decisions. Representativeness and sample are not relevant to the accuracy of decisions in this context.

Question 13

The correlation between test scores and criterion scores represents

Accepted Answer

The correlation between test scores and criterion scores is a measure of validity. It indicates the extent to which the test measures what it is supposed to measure (i.e. the criterion). Reliability is a separate concept that refers to the consistency of test scores over time or across different test versions. Content validity is the degree to which the test items adequately cover the content domain of interest.

Question 14

Studying correlations between test scores obtained before making decisions, and criterion scores obtained after making decisions is an example of a _________ strategy.

Accepted Answer

Predictive validity involves studying the correlation between a predictor variable (in this case, test scores obtained before making decisions) and a criterion variable (in this case, criterion scores obtained after making decisions). Therefore, option A is the best choice. Option B, concurrent validity, involves studying the correlation between two measures that are taken at the same time. Option C, construct validity, involves studying whether a measure is actually measuring what it is intended to measure. Option D, decision making, is not a type of validity strategy.

Question 15

A ________ represents some action which you take on the basis of your _______.

Accepted Answer

A decision represents a choice or selection made between options, while a prediction is a forecast of what may happen in the future. Therefore, it is logical to say that a decision is based on predictions or expectations of outcomes. Therefore, option B is the best choice, as it identifies the correct relationship between decision and prediction.

Question 16

Test theory suggests that concurrent validity coefficients underestimate population validity. What does research suggest?

Accepted Answer

Research suggests that concurrent validity coefficients are often similar in size to predictive validities, and do not necessarily underestimate population validity. However, it is important to consider multiple forms of validity evidence when making inferences about a test's validity.

Question 17

The ideal criterion-related validity strategy is

Accepted Answer

Predictive validity is the ideal criterion-related validity strategy because it measures the ability of a measure to predict future outcomes. This is a stronger form of validity than concurrent validity because it assesses how well the measure can predict independent criteria that are measured at a later time. Construct validity and face validity are not criterion-related validity strategies but rather refer to the extent to which a measure measures what it is intended to measure.

Question 18

Correlating test scores with some measure of success is the same thing as correlating test scores with some

Accepted Answer

Correlating test scores with a criterion is the best way to determine if the test scores accurately predict success in a particular area. A criterion is a measurable outcome or behavior that represents the construct being measured by the test. For example, if a test aims to predict academic success, the criterion could be GPA or graduation rates. The correlation between the test scores and the criterion can indicate the validity of the test as a predictor of success.

Question 19

A criterion-related validity of 0.50 indicates that approximately ______ percent of the variability of performance can be accounted for by the test scores.

Accepted Answer

25Criterion-related validity is assessed by correlating a test score with a performance measure; the square of this correlation (r^2) represents the proportion of variance in the performance measure that can be explained by the test score. A validity of 0.50 squared equals 0.25, or 25 percent of the variability in performance accounted for by the test scores.

Question 20

Range restriction is most likely to occur in

Accepted Answer

The answer of Range restriction is most likely to occur...

Quiz 9: Validity for Decisions: Criterion-Related Validity