Question 1

Some school districts require candidates for a teaching position to teach an actual lesson, which is rated for quality. The district also may require candidates to submit a collection of curriculum materials and lesson plans that they have prepared in their previous teaching positions.
a. What is this approach to measurement called?
b. What is the technical name for the collection of completed work?

Accepted Answer

The answer of Some school districts require candidates for a...

Question 2

Describe four criteria recommended for judging the validity of performance assessments.

Accepted Answer

The answer of Describe four criteria recommended for judging the...

Question 3

Describe at least one advantage and one disadvantage of self-report personality measures.

Accepted Answer

The answer of Describe at least one advantage and one...

Question 4

How do the Mental Measurement Yearbooks contribute to the use of tests in research?

Accepted Answer

The answer of How do the Mental Measurement Yearbooks contribute...

Question 5

State one reason why it is important for a researcher to examine an actual copy of an achievement test before deciding to use it in a study.

Accepted Answer

The answer of State one reason why it is important...

Question 6

State two questions that can guide a search for relevant information to help you select among the range of tests that appear related to one's sample and research problem.

Accepted Answer

The answer of State two questions that can guide a...

Question 7

Describe one procedure that customarily is used as part of an item analysis of a test under development.

Accepted Answer

The answer of Describe one procedure that customarily is used...

Question 8

How can the publication Standards for Educational and Psychological Testing help if a test to be administered as part of a research study comes under attack?

Accepted Answer

The answer of How can the publication Standards for Educational...

Question 9

Describe three actions you could take if you encounter public or professional resistance to the tests that you wish to administer for a research study.

Accepted Answer

The answer of Describe three actions you could take if...

Question 10

A researcher plans to administer a personality measure and wants to ensure that the research sample gives honest responses to its items. What is one procedure that the researcher can use to accomplish this goal?

Accepted Answer

The answer of A researcher plans to administer a personality...

Question 11

Describe three procedures that might help obtain individuals' maximal effort on a performance test.

Accepted Answer

The answer of Describe three procedures that might help obtain...

Question 12

Describe four procedures that might help obtain individuals' honest responses on a personality measure.

Accepted Answer

The answer of Describe four procedures that might help obtain...

Question 13

Describe a procedure for handling each of these testing problems.
a. A researcher is planning to administer several aptitude tests to groups of college students as part of a research project. What can he do to increase the likelihood that students will give their maximum performance?
b. A researcher wants to administer a measure of sexual attitudes to high school and college students. What can she do to increase the likelihood that students will give frank, honest responses?

Accepted Answer

The answer of Describe a procedure for handling each of...

Question 14

An investigator has developed a new technique to teach eighth-grade students the characteristics of positive and negative numbers. She wishes to evaluate the technique by using it to teach group A. Group B, which receives conventional instruction on positive and negative numbers, serves as a control. She needs a mathematics achievement test to measure the post-training performance of the two groups. She considers the XYZ Test of Mathematics Achievement. In checking the test manual, she finds that when this test was administered to a sample of eighth-grade students at the end of the academic year, the test scores correlated .72 with their end-of-year grades in mathematics. No other validity evidence was given in the test manual.
a. What type of validity evidence was given in the test manual?
b. What type of validity evidence is most relevant to the proposed study, and why?

Accepted Answer

The answer of An investigator has developed a new technique...

Question 15

A researcher is asked by school district personnel to collect data for a period of three years to determine whether their plans to improve third-grade reading skills are successful. The researcher decides to administer the same reading achievement test at the end of each school year for the next three years. List the aspects of their content that she should judge carefully as she examines various achievement tests for possible use in the study.

Accepted Answer

The answer of A researcher is asked by school district...

Question 16

a. Select one standardized test. If your thesis or dissertation will involve the use of standardized tests, select a measure relevant to that study. Otherwise, select a measure that relates to your major professional interests.
b. Obtain a specimen set for your measure. Most departments of psychology, university libraries, or counseling centers have a file of standardized tests. A copy of the test, the test manual, and the scoring key are included for most measures. Your instructor will give you the information you need to obtain a specimen set.
c. Sources of Information
(1) Look up the selected measure in the most recent edition of the Mental Measurements Yearbook available in your institution's library. If your measure is not reviewed, select another measure.
(2) Check the name of the measure you have selected in the most recent three annual volumes of Psychological Abstracts and ERIC. Also check key words related to the topic of the measure. For
example, if your measure were the IPAT Anxiety Scale Questionnaire, you would check the key word anxiety in the subject index. Locate one study in which the measure was used. Read the study,
giving particular attention to data related to the questions below. Prepare a note card on the article and submit it as part of this assignment.
d. Answer the following questions based on your study of the sources mentioned above.
(1) Objectivity
(a) Is the measure subject to administrator bias? Discuss.
(b) Is the measure subject to scoring bias? Discuss.
(2) Normative Data
(a) Are normative data provided? Describe.
(b) Are the samples used in establishing the norms satisfactory? Describe.
(c) How comparable are norm groups to the sample in your study (if this measure is being considered for your thesis or dissertation project)?
(3) Validity
(a) What type of validity evidence is most appropriate for this measure? Why?
(b) What validity evidence is given in your sources? Describe.
(c) Write a brief evaluation of the validity evidence available on this measure.
(4) Reliability
(a) What type of reliability data are available for this measure? Describe.
(b) What are the reliability coefficients?
(c) Write a brief evaluation of the reliability data available for this measure.
e. Submit a typed, double-spaced paper giving the name and a brief description of the measure, including the publisher's name, publication data, administration time, age levels if appropriate, and the types of scores that it yields. Answer the four questions listed in "d" above. Be sure to include your note card with your paper [see (c-2)]. Be prepared to report on your standardized test evaluation in class.

Accepted Answer

The answer of a. Select one standardized test. If your...

Question 17

Find a test that pertains to a research problem or topic of interest to you. Indicate in writing:
a. how the test possibly is relevant to your research problem.
b. the reference source in which you identified the information.
c. something interesting you learned about the test from the reference source. (Write just two sentences.)

Accepted Answer

The answer of Find a test that pertains to a...

Quiz 7: Collecting Research Data With Tests and Self-Report Measures