Question 1

_______ is the extent to which a score from a test is stable and free from error.
A) Reliability
B) Validity
C) Psychometrics
D) Stratification

Accepted Answer

Reliability refers to the consistency and stability of test scores over time or across different test administrations. A reliable test produces consistent results and is free from random errors or inconsistencies. Validity, on the other hand, refers to the extent to which a test accurately measures what it is intended to measure, and psychometrics is a broad field that includes the study of both reliability and validity, as well as other aspects of psychological measurement. Stratification is not related to the concept of test reliability.

Question 2

When computing internal reliability, _____ is used for dichotomous items and _____ is used for interval and ratio items.
A) coefficient alpha / K-R 20
B) coefficient alpha / Spearman-Brown
C) K-R 20 / coefficient alpha
D) Spearman-Brown / coefficient alpha

Accepted Answer

K-R 20 (Kuder-Richardson Formula 20) is specifically designed for dichotomous items (items with two possible answers, such as true/false), while coefficient alpha (often referred to as Cronbach's alpha) is used for items measured on interval or ratio scales, which can have a range of values.

Question 3

Test-retest reliability taps ____ stability.
A) form
B) temporal
C) item
D) score

Accepted Answer

Test-retest reliability measures the consistency of scores over time, therefore it taps temporal stability. Option A is incorrect because form stability refers to the consistency of responses to the same test items but presented in a different format. Option C refers to the consistency of responses to each item on the same test but presented at different times, which is not what test-retest reliability assesses. Option D refers to the consistency of the actual test scores obtained, but this is a consequence of the overall reliability of the measure and not the specific type of reliability being measured.

Question 4

There are three major ways to determine whether a test is reliable. With the _______ method, several people each take the same test twice.
A) repeat reliability
B) test-retest reliability
C) dual reliability
D) alternate forms reliability

Accepted Answer

The test-retest reliability method involves giving the same test to the same group of people on two separate occasions and then comparing their scores. This allows for an evaluation of whether the test produces consistent results over time. The other options (repeat reliability, dual reliability, and alternate forms reliability) do not involve multiple administrations of the same test and are therefore not as effective in measuring the test's reliability.

Question 5

In general, the longer the test, the higher its _______.
A) internal validity
B) external validity
C) internal reliability
D) external reliability

Accepted Answer

The length of a test does not necessarily affect its external validity or reliability. Internal reliability refers to the consistency of results within the test itself, and longer tests tend to have higher internal reliability due to more items measuring the same construct. Therefore, the longer the test, the higher its internal reliability.

Question 6

To ask if all of the items measure the same thing, or do they measure different constructs, is related to ________.
A) internal validity
B) test-retest reliability
C) scorer reliability
D) item homogeneity

Accepted Answer

Item homogeneity refers to the degree to which all items on a measure assess the same construct or trait. Therefore, questioning whether all items measure the same thing or different constructs is related to item homogeneity.

Question 7

The extent to which tests or test items sample what they are supposed to measure is related to the measure's _______ validity.
A) content
B) construct
C) criterion
D) concurrent

Accepted Answer

Content validity is the extent to which a test measures the specific content or knowledge domain it is intended to measure. Therefore, content validity is related to the degree to which test items or tasks are representative of the domain being assessed.

Question 8

_______ is an issue especially in projective or subjective tests in which there is no one correct answer.
A) Internal validity
B) Test-retest reliability
C) Scorer reliability
D) Item homogeneity

Accepted Answer

Scorer reliability is the degree of consistency among scorers who score a particular test. It is especially important in projective or subjective tests which do not have one correct answer. If scorers are not consistent, it can affect the validity and accuracy of the test results.

Question 9

An industrial/organizational psychologist correlates the responses to the even numbered items on a selection test with the responses to the odd-numbered items from the same test. Which of the following answers BEST describes the concern of the psychologist?
A) Parallel form reliability
B) Split-half reliability
C) Test-retest reliability
D) Scorer reliability

Accepted Answer

The psychologist is concerned with split-half reliability, which involves dividing a test into two halves and correlating the scores from each half. In this case, the psychologist is correlating the responses to even and odd numbered items to measure the internal consistency of the test.

Question 10

With a __________ validity design, the test is administered to a group of employees who are already on the job.
A) concurrent
B) predictive
C) content
D) face

Accepted Answer

Concurrent validity design involves administering the test to a group of employees who are already on the job. This tests whether the assessment effectively distinguishes between employees who are performing well on the job and those who are not. Therefore, option A) is the correct answer. The other options, predictive, content, and face validity designs involve different methods of testing the validity of an assessment tool.

Question 11

The Spearman-Brown prophecy formula is used to adjust the correlation in which of the following reliability estimate methods?
A) Test-retest method
B) Alternate form method
C) Counterbalancing method
D) Split-half method

Accepted Answer

The Spearman-Brown prophecy formula is used to adjust the correlation coefficient obtained from the split-half method. The formula predicts the reliability if the test is lengthened or shortened by estimating the correlation between two halves of the test.

Question 12

_______ validity is a measure which refers to the extent to which a test score is related to some measure of job performance.
A) Content
B) Construct
C) Criterion
D) Concurrent

Accepted Answer

Criterion validity is specifically related to job performance, while content validity refers to how well the test measures the relevant content for a job. Construct validity is concerned with whether the test measures the theoretical construct it is intended to measure, while concurrent validity is the extent to which scores on a test are related to scores on a different, established test measuring similar constructs, at the same point in time. Therefore, criterion validity is the best choice as it directly relates to job performance.

Question 13

When the two scores from alternate forms of a test are correlated and found to be similar, the test is said to have ________.
A) temporal stability
B) internal consistency
C) form stability
D) version consistency

Accepted Answer

Form stability refers to the extent to which different forms of a test produce similar scores. Therefore, when the two scores from alternate forms of a test are correlated and found to be similar, the test is said to have form stability. The other options refer to different types of reliability: temporal stability refers to consistency of scores over time, internal consistency refers to the consistency of scores across items within a test, and version consistency is not a recognized term in psychometrics.

Question 14

The process of counterbalancing test-taking order is used in which method of estimating reliability?
A) Test-retest reliability
B) Alternate-forms reliability
C) Internal reliability
D) All of the above use counterbalancing

Accepted Answer

Counterbalancing test-taking order is used in Alternate-forms reliability to control for the effects of practice, fatigue, and memory on test performance. Test-retest reliability involves administering the same test twice to the same group of people at different time points, while Internal reliability is concerned with the consistency of results across items within a single test. While these methods may also use counterbalancing techniques for other purposes, the primary purpose of counterbalancing test-taking order is to ensure that different groups of test-takers are exposed to different versions of the same test in a way that doesn't confound the effects of the test with the effects of order.

Question 15

A student takes the Scholastic Aptitude Test (SAT) as a requirement to get into college. Her score on the test is 600. Three weeks later, she is asked to take the identical test again. This time she scores 500. This inconsistency in scores is an issue of:
A) internal reliability
B) parallel forms reliability
C) test-retest reliability
D) form stability

Accepted Answer

This inconsistency in scores is an issue of test-retest reliability, as the same test was administered twice and the scores varied significantly. Internal reliability refers to the consistency of scores within the same test, parallel forms reliability refers to the consistency between different versions of a test, and form stability refers to the consistency of scores when the same test is administered at different times but without any intervening variable.

Question 16

With a _______ validity design, the test is administered to a group of job applicants who are going to be hired. The test scores, which are not used in the actual hiring decision, are then compared to a future measure of job performance.
A) concurrent
B) predictive
C) content
D) face

Accepted Answer

In a predictive validity design, the test scores are used to predict future job performance. This is different from a concurrent validity design, where the test scores are compared to current job performance, and a content validity design, where the test is evaluated to ensure it measures what it is supposed to measure. Face validity refers to how well a test appears to measure what it is intended to measure, and is not a relevant consideration in this context.

Question 17

The extent to which tests or test items sample the content that they are supposed to measure refers MOST specifically to:
A) face validity
B) content validity
C) construct validity
D) criterion validity

Accepted Answer

Content validity refers to the degree to which a test or test items accurately measure the intended content or domain they are meant to assess. This involves ensuring that the test questions adequately sample the content that the test is designed to measure. Face validity refers to whether a test appears superficially to measure what it is intended to measure. Construct validity refers to whether a test actually measures the psychological construct it is intended to measure, and criterion validity refers to whether a test is able to predict a certain criterion or outcome.

Question 18

The _______ of performance scores makes obtaining a significant validity coefficient more difficult with a concurrent validity design.
A) variety
B) restricted range
C) heterogeneous nature
D) cost

Accepted Answer

A restricted range of performance scores in a sample reduces the variability in the scores, making it difficult to obtain significant validity coefficients in a concurrent validity design. This is because validity coefficients are based on the variation in scores and a restricted range limits that variation.

Question 19

In industry, _____ is used to establish the content validity of selection tests or test batteries.
A) job analysis
B) correlational analysis
C) job evaluation
D) an experiment

Accepted Answer

Job analysis is the process of identifying the knowledge, skills, abilities, and other characteristics (KSAOs) required for successful job performance. By conducting a job analysis, the content of selection tests or test batteries can be compared to the KSAOs required for the job, establishing content validity. Correlational analysis is a statistical method used to examine the relationship between two or more variables. Job evaluation is the process of determining the relative worth of different jobs within an organization. An experiment involves manipulating one or more variables to observe the effect on another variable, but it is not commonly used for establishing content validity.

Question 20

If we use the weight of an infant to predict the subsequent performance of the infant in college, the weight measure is probably:
A) reliable and valid
B) reliable but not valid
C) not reliable but valid
D) not reliable and not valid

Accepted Answer

The weight measure may be reliable (consistent) in measuring an infant's weight, but it is not a valid predictor of subsequent performance in college. Therefore, it is reliable but not valid.

Quiz 6: Evaluating Selection Techniques and Decisions.

_______ is the extent to which a score from a test is stable and free from error.

When computing internal reliability, _ is used for dichotomous items and _ is used for interval and ratio items.

Test-retest reliability taps ____ stability.

There are three major ways to determine whether a test is reliable. With the _______ method, several people each take the same test twice.

In general, the longer the test, the higher its _______.

To ask if all of the items measure the same thing, or do they measure different constructs, is related to ________.

The extent to which tests or test items sample what they are supposed to measure is related to the measure's _______ validity.

_______ is an issue especially in projective or subjective tests in which there is no one correct answer.

An industrial/organizational psychologist correlates the responses to the even numbered items on a selection test with the responses to the odd-numbered items from the same test. Which of the following answers BEST describes the concern of the psychologist?

With a __________ validity design, the test is administered to a group of employees who are already on the job.

The Spearman-Brown prophecy formula is used to adjust the correlation in which of the following reliability estimate methods?

_______ validity is a measure which refers to the extent to which a test score is related to some measure of job performance.

When the two scores from alternate forms of a test are correlated and found to be similar, the test is said to have ________.

The process of counterbalancing test-taking order is used in which method of estimating reliability?

A student takes the Scholastic Aptitude Test (SAT) as a requirement to get into college. Her score on the test is 600. Three weeks later, she is asked to take the identical test again. This time she scores 500. This inconsistency in scores is an issue of:

With a _______ validity design, the test is administered to a group of job applicants who are going to be hired. The test scores, which are not used in the actual hiring decision, are then compared to a future measure of job performance.

The extent to which tests or test items sample the content that they are supposed to measure refers MOST specifically to:

The _______ of performance scores makes obtaining a significant validity coefficient more difficult with a concurrent validity design.

In industry, _____ is used to establish the content validity of selection tests or test batteries.

If we use the weight of an infant to predict the subsequent performance of the infant in college, the weight measure is probably: