Question 1

Which statement is false?&#10;A) Reliability and validity are dependent on the test and the characteristics of the group tested.&#10;B) Objectivity, reliability, and validity, in that order, must be determined for a test.&#10;C) An intraclass correlation coefficient is used to estimate test reliability and test objectivity.&#10;D) Validity is estimated by one of two different methods.&#10;E) It is recommended that a researcher know that a test has the essential characteristics before collecting data in a study.

Accepted Answer

Validity is not limited to just two methods of estimation; there are several methods to estimate validity, including content validity, criterion-related validity (which can be further divided into concurrent and predictive validity), and construct validity, among others.

Question 2

Select the false statement below.&#10;A) The essential characteristics associated with any test are objectivity, reliability, and validity.&#10;B) In any situation, calculate an intraclass correlation coefficient (R) to estimate test score reliability.&#10;C) The three basic approaches to obtaining validity information are logical, criterion, and construct.&#10;D) Reliability is required to have validity.&#10;E) There are two types of reliability, internal consistency and stability.

Accepted Answer

The false statement is B because the intraclass correlation coefficient (R) is one method to estimate test score reliability, but it's not the only method and not applicable in every situation. Other methods include test-retest reliability, parallel-forms reliability, and internal consistency measures like Cronbach's alpha.

Question 3

Select the false statement about desirable characteristics of test scores and the interpretations of the test scores.&#10;A) The three essential characteristics for a test are validity, reliability, and objectivity.&#10;B) Validity is the degree to which interpretations based on test scores are correct.&#10;C) Reliability is the degree to which scores of people are the same on two different occasions.&#10;D) Validity and reliability may be dependent on characteristics of the group like age and gender.&#10;E) Seldom are researchers concerned about how economical (test time per person, equipment needed, etc.) a test is.

Accepted Answer

Economical aspects of a test, including test time per person and equipment needed, are often important considerations for researchers. They are concerned with the efficiency and practicality of administering tests, especially in large-scale studies or in settings where resources are limited.

Question 4

Which statement below is true?&#10;A) There are several correlation techniques and coefficients that are used to estimate reliability.&#10;B) There are several approaches to gathering validity evidence.&#10;C) The criterion score influences the formula used to calculate R.&#10;D) Objectivity is also called rater reliability.&#10;E) All of the statements are true.

Accepted Answer

All the statements provided are true. Statement A is correct because there are indeed various correlation techniques and coefficients, such as Pearson's r, Spearman's rho, and intraclass correlation, that are used to estimate the reliability of measurements. Statement B is accurate as validity evidence can be gathered through different approaches, including content validity, criterion-related validity, and construct validity. Statement C is true because the criterion score, or the standard against which a test is evaluated, can influence the formula used to calculate the correlation coefficient (R) in the context of criterion-related validity. Finally, statement D is correct because objectivity, which refers to the extent to which the results of an assessment are consistent, regardless of who the rater is, can indeed be considered a form of rater reliability, emphasizing the importance of minimizing subjective judgment in scoring.

Question 5

Which statement below is false?&#10;A) With repeated measures (trials) for each person, the criterion score is the mean score.&#10;B) The criterion score selected determines the R formula.&#10;C) Values determined by using ANOVA are used to calculate R.&#10;D) A common criterion score is the mean of the repeated measures for a person.&#10;E) The Reliability program in SPSS provides information that can be used to calculate several different R-values.

Accepted Answer

The answer of Which statement below is false?&#10;A) With repeated...

Question 6

In regard to the criterion validity approach:&#10;A) ideally the criterion is the gold standard.&#10;B) usually the validity coefficient is less than one.&#10;C) it may be impossible to use this approach for lack of a criterion.&#10;D) All of these are correct.

Accepted Answer

All the statements are correct regarding the criterion validity approach: A) The criterion should ideally be the gold standard for comparison. B) The validity coefficient, which measures the degree of correlation between the test under evaluation and the criterion, is typically less than one, indicating less than perfect correlation. C) In some cases, it may be impossible to apply this approach due to the absence of a suitable criterion.

Question 7

In regard to the construct validity approach:&#10;A) it is an approach to use if no other approach is possible.&#10;B) it is not a very precise approach.&#10;C) any type of evidence can be used to demonstrate validity.&#10;D) it is seldom used in some areas of kinesiology.&#10;E) the maximum construct validity value is 1.0.

Accepted Answer

Construct validity involves using any type of evidence to support the validity of a measurement tool or approach, indicating that it accurately measures the construct it is intended to measure.

Question 8

Determining a running test's ability to predict VO₂max is an example of evidence based on: A) internal structure. B) relation to other variable. C) test content. D) response process.

Accepted Answer

Determining a running test's ability to predict VO2max involves assessing how well the test scores correlate with a known variable (VO2max), which is an example of evidence based on the relation to other variables.

Question 9

Examining if a test-criterion relationship can be applied to a new situation is an example of:&#10;A) external structure.&#10;B) test reliability.&#10;C) validity generalization.&#10;D) test content validity.

Accepted Answer

Validity generalization refers to the process of determining whether the validity of a test for predicting a particular criterion (such as job performance) in one context can be generalized to another context. This involves examining if a test-criterion relationship established in one situation can be applied to a new situation.

Question 10

Determining if fitness testing changed students' behavior is an example of evidence based on:&#10;A) internal structure.&#10;B) consequence of testing.&#10;C) test content.&#10;D) response process.

Accepted Answer

Determining if fitness testing changed students' behavior is an example of evidence based on the consequence of testing. This type of evidence examines the effects or outcomes of testing on individuals or groups, such as changes in behavior, attitudes, or decision-making processes as a result of the testing.

Deck 13: Measurement in Research