Question 1

Test developers calculate an item-validity index to:

Accepted Answer

An item-validity index is a measure of how well an item discriminates between examinees who know the material and those who do not. It is used to determine the internal consistency of the test, which is a measure of how well the items on the test measure the same construct.

Question 2

Having a large item pool available during test revision is

Accepted Answer

Having a large item pool available during test revision is an advantage because poor items can be deleted in favor of the good items. This ensures that the test is of good quality and is a fair assessment of what it is intended to measure. While item development may be expensive, having a large pool to choose from ultimately leads to a better test. The answer D is not relevant and doesn't make sense. Option B is partially correct as some items may be deleted but having a large pool is still beneficial.

Question 3

Expert panels may be used in the process of test development to

Accepted Answer

Expert panels are typically used to screen test items for possible bias, ensuring fairness and validity in the test development process.

Question 4

If an item-discrimination index is negative

Accepted Answer

A negative item-discrimination index indicates that low scorers are more likely to answer the item correctly than high scorers, suggesting that the item may not be measuring what it's intended to measure. Option A is incorrect because a positive discrimination index indicates that high scorers are more likely to answer the item correctly. Option C is also incorrect because the issue is with the item itself, not with the equivalence of alternate forms. Option D is incorrect because negative discrimination indices are possible and are not an error in computer scoring.

Question 5

As the result of a sensitivity review,items containing __________ may be eliminated from a test.

Accepted Answer

A sensitivity review aims to examine test items for potential issues that may be offensive or unfair to certain groups. This can include offensive language, stereotypes, and unfair reference to situations. Therefore, all of these options may result in elimination of test items during sensitivity review.

Question 6

Factor analysis can help the test developer

Accepted Answer

Factor analysis can help test developers to both eliminate or revise items that do not load on the predicted factor and identify whether test items appear to be measuring the same construct. Therefore, the best choice is C.

Question 7

As part of the process of test development,the term test revision BEST refers to the

Accepted Answer

Test revision involves modifying an existing test, which can include rewording, deleting, or developing new items to improve its validity, reliability, or relevance. It does not necessarily mean creating a completely new test or simply reprinting an existing one.

Question 8

An item-discrimination index is used on an ability test

Accepted Answer

The item-discrimination index measures the extent to which an item is able to distinguish between high and low scorers on a test. It provides information about how well an item is able to discriminate among test-takers of different levels of ability, which is important when evaluating the quality of a test. Option A is incorrect because the index does not directly measure whether items are measuring what they are designed to measure. Option C is incorrect because the item-discrimination index is not used to estimate the predictive validity of an item or test. Option D is incorrect because the index does not specifically measure the difference between median and low scorers.

Question 9

In creating a test designed to measure personality constructs,the test developer's first step would BEST be to

Accepted Answer

Before creating any items or selecting test takers, it is essential to have a clear definition and understanding of the personality construct being measured. This will ensure that items are relevant and valid and that the test is measuring what it is intended to measure. Option A is not the first step as it pertains to item development and assumes that socially desirable responses are unwanted. Option B is premature because it does not account for construct and item validity. Option D is also premature because test tryouts should be conducted after initial items and test structure have been developed.

Question 10

A sensitivity review panel would most likely be made up of

Accepted Answer

A sensitivity review panel should be diverse in terms of representation to ensure that different perspectives are taken into account. Psychologists from both minority and majority groups should be included to give a balanced view.

Question 11

The higher an item-validity index,the greater the __________ validity.

Accepted Answer

Item-validity index measures the correlation between test scores and a criterion measure, so a higher item-validity index indicates a higher criterion-related validity. Therefore, the best choice is C - criterion validity.

Question 12

An analysis of item alternatives for a multiple-choice test can yield information about

Accepted Answer

An analysis of item alternatives can provide information about the effectiveness of distracter choices, which items need to be revised, and testtaker response patterns. Therefore, all the given options are correct, making option D the best choice.

Question 13

When an item-characteristic curve of an ability test has an inverted U shape,it usually indicates that

Accepted Answer

When an item-characteristic curve of an ability test has an inverted U shape, it means that the item is relatively easy for high-ability test-takers and relatively difficult for low-ability test-takers. However, the item is most suitable for those with moderate ability, who have the highest probability of answering the item correctly. Therefore, the best choice is option A, which states that test-takers of moderate ability have the highest probability of answering the item correctly.

Question 14

Which is TRUE of the latent-trait model of measurement?

Accepted Answer

The latent-trait model of measurement assumes that the variables being measured by a test are not directly observable and are unidimensional. This model is commonly applied to a variety of tests, not just achievement tests. Additionally, the model is not designed to measure multidimensional traits.

Question 15

A sensitivity review typically focuses on which of the following?

Accepted Answer

A sensitivity review typically focuses on the sensitivity of individual test items, meaning how accurately they are measuring the intended construct and how easily they are affected by extraneous factors. The review aims to identify potential sources of bias or error in the items and improve their quality. The review may also consider the impact of cultural differences or group characteristics on item functioning. The other options may be part of a broader validity and reliability analysis, but they are not the primary focus of a sensitivity review.

Question 16

The higher the item-reliability index,

Accepted Answer

Item-reliability index measures the consistency of a particular item in a test. If the item is reliable, then it is consistent in measuring what it is intended to measure. Therefore, the higher the item-reliability index, the higher is the internal consistency of the test, which means the items are measuring the same construct, resulting in higher overall test reliability.

Question 17

An item-characteristic curve

Accepted Answer

The answer of An item-characteristic curve
...

Question 18

On a particular test,men and women tend to have the same total score.Men and women do,however,tend to exhibit different response patterns to specific items.A reasonable conclusion is that the test is:

Accepted Answer

The fact that men and women exhibit different response patterns to specific items indicates that the test is biased, meaning that it may be more favorable to one group over the other. However, the fact that the total score is the same for both groups suggests that the test may be reliable and valid overall, measuring the same construct consistently across both groups.

Question 19

A test developer designs a test for the sole purpose of identifying the most highly skilled individuals among those tested.During the test revision stage of test development,the test developer will be particularly interested in

Accepted Answer

Item discrimination is crucial for identifying the most highly skilled individuals because it measures how well an item can distinguish between high and low performers.

Question 20

The think aloud test administration format

Accepted Answer

The think aloud test administration format has examinees literally thinking aloud as they respond to each item on a test. It is a qualitative technique that can help test developers understand how an examinee interprets particular items. Therefore, all of the given options are correct.

Quiz 8: Test Development