Question 1

Co-validation is:

Accepted Answer

Co-validation, also referred to as co-norming, is a recommended strategy that can save time and money for the test publisher. Therefore, both option B and C are correct.

Question 2

A student makes the following complaint after taking an exam: "I spent all night studying Chapter 7 and there wasn't even one test question from that chapter!" From a psychometric perspective,this student is concerned about the exam's

Accepted Answer

The student's concern is about the content of the exam not aligning with their study material, which relates to content validity rather than error variance, test-retest reliability, or rater error. None of the options directly address issues of content coverage or validity.

Question 3

In general,what can be said about an item analysis of a speeded test?

Accepted Answer

In a speeded test, where the primary challenge is completing the items quickly rather than the difficulty of the items themselves, item analysis can be misleading and difficult to interpret. This is because the performance on later items is more about how fast a test-taker can work rather than their ability level, leading to potentially higher difficulty and discrimination levels for items at the end of the test.

Question 4

Which is TRUE with regard to latent-trait models?

Accepted Answer

Latent-trait models assume that the underlying construct, or latent trait, being measured is unidimensional. This means that it is a single, underlying factor that affects performance on all observed measures or indicators.

Question 5

A student raises concern that a professor has given different grades to two essay answers that are very similar.From a psychometric perspective,the student is expressing concerns about

Accepted Answer

The student is expressing concerns about rater error, which occurs when different graders give different scores to the same response, leading to inconsistencies in grading. This is a common concern in subjective assessments like essay responses where different graders may have different interpretations and biases.

Question 6

All of the following are methods of evaluating item bias EXCEPT

Accepted Answer

Validity shrinkage is not a method of evaluating item bias. The other three choices are commonly used methods to detect item bias.

Question 7

Ideally,psychological or educational tests are revised

Accepted Answer

Tests should be revised when they are no longer useful, outdated or not aligned with current standards or research. The frequency of revision depends on the type of test and its purpose. There is no set time frame or schedule for test revision.

Question 8

The best type of item yields an item-characteristic curve that

Accepted Answer

A positive slope indicates that as the level of the ability being measured increases, the likelihood of a correct response also increases. This is ideal for assessing the proficiency of the test takers.

Question 9

Which of the following conditions may lead to the decision to revise a psychological or educational test?

Accepted Answer

All of the conditions listed can lead to the decision to revise a psychological or educational test. Item content that has become outdated may impact the test's relevance and accuracy, while test norms that no longer represent the population for which the test is designed may affect the test's ability to accurately measure what it intends to measure. If the reliability and validity of a test can be improved by a revision, this will ultimately result in a better assessment tool.

Question 10

Which is TRUE of item-characteristic curves?

Accepted Answer

Item-characteristic curves depict the relationship between an item’s difficulty and the probability of a correct response. They can be used to assess whether or not items are biased by comparing responses from different groups of test-takers. The other options are not accurate descriptions of item-characteristic curves.

Question 11

With regard to the test revision process,it typically

Accepted Answer

The test revision process includes all of the steps that the initial test development included, such as reviewing and analyzing data, modifying items or test forms, and conducting pilot testing. It may not take as long as the original development, but it still requires a significant amount of time and effort. The cost of the revision process may depend on the extent of the changes needed, but it can still be significant. Therefore, option B is the best choice.

Question 12

A test manual for a commercially prepared test should ideally include

Accepted Answer

A test manual for a commercially prepared test should ideally include all three of these components: a description of the test development procedures used, test-retest reliability data, and internal-consistency reliability data. These components provide important information about the test's construction, reliability, and validity, which are critical for ensuring that the test accurately measures what it is intended to measure. Therefore, all of these components are important to include in a test manual for a commercially prepared test.

Question 13

As part of the test development process,a test revision may entail

Accepted Answer

Test revision may involve various changes such as re-wording, deleting, or developing new items as well as the development of a new edition of the test. Therefore, the correct option is D. Reprinting of a test may also be necessary, but it is not the only possible change that can happen during test revision.

Question 14

Ability tests are typically standardized on a sample that is representative of the general population and selected on the basis of variables such as

Accepted Answer

Ability tests are standardized on a sample that is representative of the general population based on variables such as age, gender, and geographic region. Therefore, option D (All of these) is the best answer as it includes all the variables mentioned in the question.

Question 15

The term used to describe the decrease in item validities that typically occurs during cross-validation is

Accepted Answer

Validity shrinkage refers to the decrease in item validities that occurs when a prediction model is applied to new data compared to the original sample used to develop the model. This is a common phenomenon in cross-validation, where the model is developed using one subset of the data and tested on another subset. The difference in performance between the two subsets is often due to validity shrinkage, which is caused by differences in the characteristics of the two subsets.

Question 16

Which is TRUE of cross-validation of a test after standardization has occurred?

Accepted Answer

Cross-validation often results in validity shrinkage because the model may not perform as well on new, unseen data as it did on the training data, leading to a decrease in the apparent validity of the test.

Question 17

Generous time limits are typically associated with

Accepted Answer

Generous time limits are typically associated with power conditions, as they allow individuals to demonstrate their maximum level of performance without the pressure of time constraints.

Question 18

A student complains that a midterm examination did not include items from a particular in-class lecture.From a psychometric perspective,the students is expressing concern about the midterm's

Accepted Answer

Content validity measures the extent to which an assessment tool, such as a test, includes items that are relevant to the construct being measured. In this case, if the student is complaining that the midterm did not include items from a particular lecture, they are expressing concern about whether the exam had content validity, as it did not cover all the relevant material. Test-retest reliability refers to the consistency of scores over time, internal consistency reliability refers to the consistency of scores across items within the same test, and cross-validation refers to the process of testing a model or procedure on a different dataset than the one used to develop it. None of these concepts directly address the student's concern about the inclusion of certain content on the exam.

Question 19

Which statement is TRUE of guessing?

Accepted Answer

Guessing introduces variability in test scores that is not related to the construct being measured, making it challenging for test developers to accurately interpret test results and ensure the reliability and validity of the test.

Question 20

During the norming of a new intelligence test,a test publisher administers to all of the testtakers not only the new intelligence test,but a vision test using an eye chart.The publisher has engaged in

Accepted Answer

The actions described do not fit the definitions of test conceptualization, cross-validation, or shared validation. Test conceptualization involves defining what the test is supposed to measure. Cross-validation refers to the process of validating the test findings with a new sample. Shared validation (also not a standard term in this context) does not accurately describe administering a vision test alongside an intelligence test. The scenario described does not match any of these processes, hence "None of these" is correct.

Quiz 8: Test Development