Question 1

What are response sets?
A) ways of responding that test takers find most comfortable
B) the four or five responses provided in a multiple-choice question
C) equipment, such as computers, used to respond to tests
D) patterns of responding that result in false or misleading information

Accepted Answer

Response sets are patterns of responding that are typically used by test takers to provide false or misleading information. Examples of response sets include social desirability bias, acquiescence response bias, and extreme response bias. These patterns can be identified by test developers and measures are put in place to counteract their impact on test results.

Question 2

Which one of the following is likely to occur when test takers lack the necessary skills (such as reading) to take the test, do not wish to be evaluated, or lack the attention span necessary to complete the task?
A) random responding
B) social desirability
C) acquiescence
D) withdrawal

Accepted Answer

When test takers lack the necessary skills or lack the attention span necessary to complete the task, they may engage in random responding, which involves selecting answers without considering the question or the response options. This can result in inaccurate test scores and may not provide useful information about the test-taker's abilities or knowledge. Social desirability involves responding in a way that will be viewed positively by others, while acquiescence involves agreeing with all questions or statements regardless of their content. Withdrawal involves disengaging from the testing process altogether.

Question 3

Test developers are advised to write how many more questions than they will need when developing a new test?
A) 50% more than they will need
B) twice as many as they will need
C) 3 times as many as they will need
D) 4 times as many as they will need

Accepted Answer

Test developers are advised to write twice as many questions as they will need in order to have a sufficient number of questions to choose from and to ensure that the test is valid and reliable.

Question 4

A high score on which of the following scale identifies test takers who are uncooperative, responding randomly, or faking?
A) Forced Choice Scale
B) Social Desirability Scale
C) Reliability Scale
D) Validity Scale

Accepted Answer

Validity scales are designed to identify test takers who are not answering honestly or accurately, including those who are uncooperative, responding randomly, or faking. The other scales listed (Forced Choice Scale, Social Desirability Scale, and Reliability Scale) do not specifically target this type of response distortion.

Question 5

Which one of the following test formats has little face validity, that is, no apparent connection with the stated purpose of the test?
A) true/false
B) multiple choice
C) forced choice
D) short essay

Accepted Answer

Forced choice tests involve choosing between two or more options, often with neither option being clearly better or worse than the other. This format may not seem to have a strong connection to the stated purpose of the test and can be prone to various biases. The other formats (true/false, multiple choice, and short essay) typically have a more obvious connection to the purpose of the test.

Question 6

Test and survey developers should balance items for which the correct response would be positive with an equal number of items for which the correct response would be negative to control for which bias?
A) social desirability
B) faking
C) random responding
D) acquiescence

Accepted Answer

Balancing items with positive and negative correct responses helps control for acquiescence bias, where respondents might have a tendency to agree with statements regardless of their content.

Question 7

Which one of the following is likely to result in ineffective test items?
A) identification of item topics by consulting the test plan
B) ensuring that each item is based on an important learning objective or topic
C) using slang or colloquial language when developing items
D) ensuring that all items are independent

Accepted Answer

Using slang or colloquial language in test items can lead to confusion or misinterpretation by test takers, resulting in ineffective test items. The other choices (A, B, and D) are all important steps to take in developing effective test items.

Question 8

What is the tendency of some test takers to provide or choose answers that are perceived to be most acceptable or that present the test taker in a favorable light called?
A) social desirability
B) social acquiescence
C) social faking
D) social responding

Accepted Answer

This tendency is called social desirability. Test takers may provide or choose answers that they perceive as socially desirable or acceptable, even if it is not their true answer or belief.

Question 9

What are the odds of guessing the correct answer on one true/false question?
A) "1 in 2" or 50%
B) "1 in 3" or 33.3%
C) "1 in 10" or 10%
D) "1 in 50" or 2%

Accepted Answer

A true/false question can only have two possible answers, so the odds of guessing correctly are 1 in 2 or 50%.

Question 10

According to your textbook, which one of the following test formats do students prefer because it allows them to focus on demonstrating what they have learned rather than limiting them to answering specific questions?
A) true/false
B) multiple choice
C) essay
D) forced choice

Accepted Answer

According to the textbook, students prefer essay tests because they allow them to demonstrate what they have learned in their own words, rather than being limited to choosing from predefined answer options.

Question 11

Which one of the following items is of particular importance when administering subjective tests where multiple people score each test taker?
A) content validity
B) interrater reliability
C) test-retest reliability
D) internal consistency

Accepted Answer

Interrater reliability is crucial in situations where multiple people are scoring subjective tests. It refers to the consistency of scores given by different raters. This ensures that the scores are not influenced by the individual biases or interpretations of different raters. Content validity, test-retest reliability, and internal consistency are also important factors in test administration, but they are not specific to situations where multiple raters are scoring the tests.

Question 12

What is the probability of guessing the correct answer on a multiple-choice item with four response choices?
A) .33
B) .25
C) .10
D) .5

Accepted Answer

The probability of guessing the correct answer on a multiple-choice item with four response choices is 1/4, which is equivalent to 0.25. Therefore, the correct choice is B.

Question 13

In organizations, what is a commonly used subjective test?
A) multiple-choice test
B) preemployment test
C) maximal performance test
D) interview

Accepted Answer

The commonly used subjective test in organizations is an interview where a person is questioned about their qualifications, experience, and other subjective elements that cannot be measured through objective methods such as multiple-choice or preemployment tests.

Question 14

"The tendency to agree with any ideas or behaviors presented" is the definition of ______.
A) social desirability
B) acquiescence
C) faking good
D) unrandom responding

Accepted Answer

Acquiescence refers to the tendency to agree with any ideas or behaviors presented, even if they are not necessarily true or in line with the individual's own beliefs. Social desirability refers to the tendency to give socially desirable responses, while faking good refers to the intentional presentation of oneself in a positive light. Unrandom responding refers to responding in a non-random or patterned way on a survey or measure.

Question 15

What does the forced choice format require the test taker to do?
A) provide an answer to each question even when the test taker does not know the answer
B) choose from one of two or more words/phrases that appear unrelated but equally acceptable
C) choose one of several answers that appear equally acceptable
D) respond to the item by telling a story or drawing a picture

Accepted Answer

The answer of What does the forced choice format require...

Question 16

Which one of the following response sets may have a cultural basis as well as being an individual inclination?
A) social desirability
B) acquiescence
C) faking
D) random responding

Accepted Answer

Acquiescence, or the tendency to agree with statements, can be influenced by cultural norms that emphasize harmony and conformity.

Question 17

Which one of the following types of questions provides a freedom of response that facilitates assessing higher cognitive behaviors such as analysis, synthesis, and evaluation?
A) essay
B) forced choice
C) multiple choice
D) true/false

Accepted Answer

Essay questions provide freedom of response, allowing students to demonstrate higher cognitive behaviors such as analysis, synthesis, and evaluation. This is because essay questions require the student to generate their own response and provide evidence to support their answer. Forced choice, multiple choice, and true/false questions do not provide this level of freedom and are more focused on recall or application of knowledge rather than higher order thinking.

Question 18

Which test format would the stem, "Which one word from each of the following pairs of words is most descriptive of you?" be part of?
A) short essay format
B) multiple-choice format
C) true/false format
D) forced choice format

Accepted Answer

The stem "Which one word from each of the following pairs of words is most descriptive of you?" is asking the respondent to choose one word from a pair of words, making it a forced choice format.

Question 19

Which one of the following formats presents an incomplete sentence such as "I feel happiest when I am . . ."?
A) essay
B) multiple choice
C) sentence assessment
D) sentence completion

Accepted Answer

Sentence completion is the format that presents an incomplete sentence and requires the individual to fill in the missing information.

Question 20

Which one of the following formats would be best to use when the test takers are likely to answer dishonestly?
A) multiple choice
B) forced choice
C) true/false
D) structured interview

Accepted Answer

Forced choice questions present test takers with two or more equally plausible options and require them to choose the one that best applies to them. This makes it harder for test takers to guess the "correct" answer or manipulate their responses to make themselves look better.

Quiz 10: How Do We Develop a Test

What are response sets?

Which one of the following is likely to occur when test takers lack the necessary skills (such as reading) to take the test, do not wish to be evaluated, or lack the attention span necessary to complete the task?

Test developers are advised to write how many more questions than they will need when developing a new test?

A high score on which of the following scale identifies test takers who are uncooperative, responding randomly, or faking?

Which one of the following test formats has little face validity, that is, no apparent connection with the stated purpose of the test?

Test and survey developers should balance items for which the correct response would be positive with an equal number of items for which the correct response would be negative to control for which bias?

Which one of the following is likely to result in ineffective test items?

What is the tendency of some test takers to provide or choose answers that are perceived to be most acceptable or that present the test taker in a favorable light called?

What are the odds of guessing the correct answer on one true/false question?

According to your textbook, which one of the following test formats do students prefer because it allows them to focus on demonstrating what they have learned rather than limiting them to answering specific questions?

Which one of the following items is of particular importance when administering subjective tests where multiple people score each test taker?

What is the probability of guessing the correct answer on a multiple-choice item with four response choices?

In organizations, what is a commonly used subjective test?

"The tendency to agree with any ideas or behaviors presented" is the definition of ______.

What does the forced choice format require the test taker to do?

Which one of the following response sets may have a cultural basis as well as being an individual inclination?

Which one of the following types of questions provides a freedom of response that facilitates assessing higher cognitive behaviors such as analysis, synthesis, and evaluation?

Which test format would the stem, "Which one word from each of the following pairs of words is most descriptive of you?" be part of?

Which one of the following formats presents an incomplete sentence such as "I feel happiest when I am . . ."?

Which one of the following formats would be best to use when the test takers are likely to answer dishonestly?