Deck 18: How to Develop a Psychological Test: a Practical Approach

Question 1

____________ are tests designed to look very difficult but are in fact very easy and on which most people who put forth the effort to succeed will do so.

A)Dissimulation scales
B)Effort tests
C)Forced-choice tests
D)Symptom validity tests

Answer 1

Symptom validity tests

Question 2

One can ensure congruence among the construct definitions,operational definitions,and test content by developing a:

A)table of specifications.
B)test matrix.
C)variance table.
D)covariance table.

Answer 2

table of specifications.

Question 3

____________ are often called Social Desirability scales and are designed to detect the inaccurate denial of symptoms that are really present.

A)D-scales
B)F-scales
C)G-scales
D)L-scales

Answer 3

L-scales

Question 4

In which phase is it important to develop conceptual and operational definitions of the constructs you want to measure?

A)Test conceptualization
B)Specification of test structure
C)Planning standardization and psychometric studies
D)Plan implementation

Question 5

An ____________ is derived by initially examining the correlation matrix of all items on the test to see which items are the most similar.

A)F-scale
B)Inconsistency index
C)L-scale
D)Response bias scale

Question 6

____________ might be considered effort testing for personality and behavior rating scales.

A)F-scales
B)E-scales
C)L-scales
D)V-scales

Question 7

__________ are designed by including extreme responses to traditional items that are seldom endorsed as present even in individuals with significant levels of psychopathology.

A)F-scales
B)D-scales
C)Inconsistency indices
D)L-scales

Question 8

____________ means presenting oneself falsely or under pretense whereas ____________ means presenting oneself falsely to achieve a personal gain.

A)Dissimulation; malingering
B)Ingenuousness; subterfuge
C)Malingering; dissimulation
D)Subterfuge; ingenuousness

Question 9

The literature review is conducted during which phase of test development?

A)Test conceptualization
B)Specification of test structure
C)Planning standardization and psychometric studies
D)Plan implementation

Question 10

What type of test is carefully scrutinized for illegal items and emphasizes normal range variations in personality as opposed to psychopathology?

A)Objective personality tests
B)Post-employment tests
C)Pre-employment tests
D)Subjective personality tests

Question 11

What is the first task of a test developer?

A)Conduct the literature review.
B)Define the construct to measure.
C)Describe the potential uses of the test.
D)Identify a need in the field.

Question 12

_________ is an attempt to mislead an examiner through inaccurate or incomplete responses or effort.

A)False effort
B)Justification
C)Response bias
D)Symptom validity

Question 13

According to Bloom's Taxonomy,what is the simplest level?

A)Analysis
B)Comprehension
C)Evaluation
D)Knowledge

Question 14

After the constructs are well defined,what is the next step in test development?

A)Conduct the literature review.
B)Decide how to assess the reliability of the test.
C)Determine in what setting the test will be used.
D)Identify a need in the field.

Question 15

In which phase is it important to specify item formats?

A)Test conceptualization
B)Specification of test structure
C)Planning standardization and psychometric studies
D)Plan implementation

Question 16

The accuracy of the examinee's behavioral effort is:

A)dissimulation.
B)effort.
C)response bias.
D)symptom validity.

Question 17

A(n)_____________ definition explains our construct at a theoretical level and may use many interpretative words.

A)abstract
B)conceptual
C)operational
D)concrete

Question 18

____________ is/are of clinical interest with adolescents and adult offender populations,and in the 1990s Reynolds and Kamphaus (1992)developed a rapid,reliable measure to assess it/them.

A)Antisocial tendencies
B)Attention deficit disorder
C)Sensation seeking
D)Sociopathic tendencies

Question 19

The use of general rules,principles,or abstract concepts to solve a problem not previously encountered involves objectives at the _____________ level.

A)Analysis
B)Application
C)knowledge
D)Synthesis

Question 20

The application of knowledge to problem solving describes:

A)Abstract reasoning
B)Crystallized intelligence
C)Dynamic awareness
D)Fluid intelligence

Question 21

What is the first step in deciding on a sampling plan?

A)Administer the test to the individuals in the sample.
B)Describe the target population.
C)Determine the percentage of people with specific characteristics needed to make the sample representative.
D)Obtain a true random sample of the population.

Question 22

What type of score would be appropriate to answer the question: "Has John's performance in language arts reached a predetermined level?"

A)Criterion-referenced score
B)Norm-referenced score
C)IRT-based score
D)Standard score

Question 23

The most popular and widely applicable method for calculating internal consistency reliability coefficients is:

A)Cronbach's alpha.
B)Pearson correlation coefficient.
C)Spearman correlation coefficient.
D)test-retest reliability.

Question 24

What type of score would be particularly useful in determining how has Jenny's math performance changed in relation to the beginning of her specialized instruction?

A)Criterion-referenced score
B)Norm-referenced score
C)Rasch scores
D)Standard scores

Question 25

The student will be able to correctly describe each step in the completed geometric proof.This is an example of an objective at which level of Bloom's Taxonomy?

A)Analysis
B)Comprehension
C)Evaluation
D)Synthesis

Question 26

_________ scores tell us the number of points accumulated by a person on a measure but typically provide us only with ordinal scale measurement.

A)Rasch
B)Raw
C)Standard
D)Z

Question 27

When writing items for a new test,what 'rule of thumb' has been verified repeatedly over decades of test development?

A)Draft the exact number of items you expect to need on the test.
B)Draft at least twice as many items as you expect to need on the test.
C)Draft at least three times as many items as you expect to need on the test.
D)Draft at least four times as many items as you expect to need on the test.

Question 28

What is always an undesirable attribute for a test?

A)Multiple validity scales
B)Forced choice items
C)Test items with fewer than 4 responses
D)Unnecessary length

Question 29

What must be submitted in order to have a test published?

A)Factor studies
B)Test development outline
C)Test proposal
D)Copyright permission

Question 30

Traditionally,table of specifications were written for tests of ___________ and ___________.

A)achievement; aptitude
B)achievement; behavior
C)behavior; personality
D)personality; aptitude

Question 31

What type of score should be used if an examiner wants to compare the examinee's score to a reference group?

A)Cut-scores
B)Criterion-referenced scores
C)Raw scores
D)Standard scores

Question 32

After the test blueprint coverage is constructed,what is the next step in test development?

A)Complete reliability studies.
B)Determine and describe the item formats.
C)Plan validity studies.
D)Complete analyses for detecting biased items.