Question 1

______ scores are based on a predetermined level of performance to a comparison study.

Accepted Answer

Criterion-referenced scores are based on a predetermined level of performance, while norm-referenced scores are based on a comparison to a group of test-takers. Analytically referenced and reliant-referenced are not commonly used terms in relation to standardized testing.

Question 2

In ______ approach, scores are interpreted based on the comparison of one group's performance with other groups', all of whom represent a clearly defined population.

Accepted Answer

In norm-referenced approach, scores are interpreted in relation to the performance of other individuals, providing information about how well an individual or group of individuals performed compared to a larger group that represents a clearly defined population. This approach is commonly used in standardized achievement tests and college entrance exams.

Question 3

Thorndike and Thorndike-Christ noted that many tests and measures are designed to "reflect the values and experiences of typical ______."

Accepted Answer

Thorndike and Thorndike-Christ noted that many tests and measures are designed to "reflect the values and experiences of typical middle-class individuals."

Question 4

Reliability is reported as a correlation expressed as the degree of the relationship between two sets of scores. Possible scores in these correlations can range from ______.

Accepted Answer

Correlation coefficients can range from -1.0 to +1.0, with 0 indicating no relationship between the variables and positive or negative values indicating the direction and strength of the relationship. Therefore, the best choice is D, which states the range of -1.0 to +1.0.

Question 5

Strong indicators of reliability in a particular test or measure have a score of at least ______.

Accepted Answer

A score of at least .80 is considered a strong indicator of reliability in a test or measure. This means that 80% of the variability in scores can be attributed to true differences between individuals, rather than measurement error or chance. Lower scores may still indicate some degree of reliability, but they may also suggest greater variability in scores due to extraneous factors. Therefore, a score of .60 or .75 would not provide as strong of an indicator of reliability as a score of .80 or higher. A score of .50 would generally be considered too low to provide meaningful information about reliability.

Question 6

______ concerns the consistency of a measure based on content, for instance, when two forms of the measure are administered to a sample and reliability coefficients are obtained between them.

Accepted Answer

Alternate-form reliability concerns the consistency of a measure based on content when two forms of the measure are administered to a sample and reliability coefficients are obtained between them. Test-retest reliability concerns the consistency of a measure over time. Scorer reliability concerns the consistency of scores assigned by different scorers. Interrater reliability concerns the consistency of scores assigned by different raters or observers.

Question 7

Which type of reliability involves the measurement of the consistency of scores over a period of time?

Accepted Answer

Test-retest reliability involves administering the same test to the same group of people at two different points in time and measuring the consistency of scores over that time period. Therefore, test-retest reliability is the type of reliability that involves the measurement of the consistency of scores over a period of time.

Question 8

A basic type of validity that concerns the extent to which responses on test items represent a particular content is known as ______.

Accepted Answer

Content validity refers to the degree to which the items on a test represent a particular content domain or construct. It is concerned with whether the test items are measuring what they are supposed to measure. Construct validity focuses on the overall theoretical framework, criterion-related validity concerns whether a test is related to other measures in the way it is supposed to be, and convergence and divergence evidence involve comparing scores on related tests to see if they converge or diverge as expected.

Question 9

Which type of validity involves obtaining evidence of prediction of a particular construct, or accuracy in identifying a construct in practice?

Accepted Answer

Criterion-related validity involves obtaining evidence of prediction of a particular construct, or accuracy in identifying a construct in practice.

Question 10

All the potential effects that alter the true score, such as the limitations of the test, time of day in responding to the measure, and lack of consistent administration procedures, are referred to as ______.

Accepted Answer

These effects that alter the true score are referred to as error, as they introduce variability and inaccuracies in the measurement. The other options are not relevant to this concept. Truer score is not a commonly used term, formal structure refers to the organization of a test, and criterion structure relates to the validity of a measure in predicting a specific outcome.

Question 11

Factor analysis is a source for ______.

Accepted Answer

Factor analysis is a statistical method used to identify the underlying structure of a set of variables. It can be used to identify the factors that are common to a set of variables, and to determine the relationships between these factors. Factor analysis is a source of convergence and divergence evidence, which can be used to support the validity of a construct.

Question 12

An approach to measuring dependent variables where scores are used to evaluate behavior is known as ______.

Accepted Answer

Direct observation involves the systematic and objective observation of behaviors, and provides scores that can be used to evaluate the dependent variable. Self-report, ratings, and interviews rely on participants' subjective reporting of their attitudes or behaviors, which may not be as accurate or reliable as objective observation.

Question 13

The strength of this approach to measuring dependent variables is ease and time of administration and does not require extensive training is ______.

Accepted Answer

Self-report inventories are the easiest and quickest to administer and do not require extensive training, making them an efficient method for measuring dependent variables.

Question 14

One of the cornerstone tools for the assessment of behavioral, social, and emotional problems is ______.

Accepted Answer

Direct observation allows for an objective and systematic observation of the individual's behavior in various settings and avoids potential biases associated with self-report or interviews.

Question 15

Assessments that measure heart rate, ECG, blood pressure, and galvanic skin response are known as ______.

Accepted Answer

These assessments are using physiological methods to measure internal bodily responses, such as heart rate, ECG, blood pressure, and galvanic skin response. Direct observation involves observing behavior directly without using any instruments, while indirect observation involves observing behavior indirectly, such as through surveys or interviews. Self-report involves individuals reporting their own thoughts, feelings, or behaviors.

Question 16

Instrumentation is that area of the methods section where the researchers systematically describe the dependent measures used in the study.

Accepted Answer

Instrumentation is indeed the area of the methods section where researchers describe the dependent measures used in the study.

Question 17

Standardization in administering the dependent measure theoretically provides more objective data.

Accepted Answer

The answer of Standardization in administering the dependent measure theoretically...

Question 18

Researchers and practitioners have noted the importance of using measures of the dependent variable that are culturally, gender, and diversity-issue appropriate.

Accepted Answer

It is important to use measures that are appropriate for the culture, gender, and diversity considerations of the individuals being studied or treated. This helps ensure that the results are accurate and meaningful.

Question 19

Use of an inappropriate test or dependent measure can result in test bias and problems with interpreting outcomes.

Accepted Answer

The use of an inappropriate test or dependent measure can result in test bias and problems with interpreting outcomes. This is because such tests or measures may not accurately capture the construct or phenomenon being studied, leading to misleading results and conclusions. Therefore, it is important to carefully select and validate tests and measures to ensure that they are appropriate and relevant to the research question at hand.

Question 20

A higher positive correlation indicates a weak relationship between the two sets of scores.

Accepted Answer

A higher positive correlation indicates a strong relationship between the two sets of scores.

Quiz 12: Evaluating the Methods Sectioninstruments