Question 1

A test's ability to produce the same results over time is its:

Accepted Answer

Reliability refers to the consistency of a measure. A test is considered reliable if it produces the same results under consistent conditions.

Question 2

Estefani and Stephania are looking at videos of bullying behaviors on playgrounds. They both look at a video of one child pushing another and code it as aggression. This illustrates:

Accepted Answer

Inter-rater reliability refers to the degree to which different observers or raters agree in their assessment decisions. In this scenario, Estefani and Stephania both agree in coding a video of one child pushing another as aggression, demonstrating inter-rater reliability.

Question 3

When a test is as short as possible but also comprehensive it is said to have:

Accepted Answer

Internal consistency refers to how well all parts of the test measure the same concept or construct, which is crucial for a test to be comprehensive yet concise.

Question 4

Hassan has developed a test for aggressive behavior. He finds that he only needs to calculate the even numbered questions for reliability instead of the entire test. This would indicate his test has good:

Accepted Answer

Split-half reliability is a measure of consistency where a test is split into two parts and the scores on both halves are compared. If calculating only the even numbered questions (or similarly, the odd ones) for reliability yields consistent results, it indicates that the two halves of the test are consistent with each other, demonstrating good split-half reliability.

Question 5

Logan takes the GRE and scores a combined 1,150. He retakes the test six months later and again scores a 1,150. This indicates that the test:

Accepted Answer

High test-retest reliability is indicated by Logan scoring the same on two separate occasions, showing that the test produces consistent results over time.

Question 6

Whereas ____ refers to whether a test measures what it is supposed to measure, ____ means that that the measure is consistent.

Accepted Answer

The answer of Whereas ____ refers to whether a test...

Question 7

If a test measures what it is supposed to measure, it is said to have:

Accepted Answer

Validity refers to the extent to which a test measures what it is supposed to measure.

Question 8

A test of aggressive behavior includes statements such as, "When I get mad I punch people in the face." These would represent:

Accepted Answer

Face validity refers to the extent to which a test appears to measure what it's supposed to measure at face value. The statement given directly relates to aggressive behavior, making it seem like a valid measure of aggression to those taking or evaluating the test.

Question 9

A test of extraversion correlates highly with a test of sociability. This would demonstrate high:

Accepted Answer

Concurrent validity is the degree to which a test correlates with another test that measures the same construct at the same time. In this case, the test of extraversion correlates highly with a test of sociability, which suggests that both tests are measuring the same construct (extraversion).

Question 10

Dulce designs a new test of neuroticism and correlates it with existing measures like a sub-scale from the MMPI-2; she finds they correlate highly. This demonstrates high:

Accepted Answer

Construct validity is the degree to which a test measures what it is supposed to measure. In this case, Dulce's test of neuroticism correlates highly with an existing measure of neuroticism, which suggests that her test is measuring what it is supposed to measure.

Question 11

If GRE scores are designed to predict intelligence and people who score 1,300 get all A's in graduate school, then the GRE would have high:

Accepted Answer

Predictive validity refers to the extent to which a score on a scale or test predicts future performance. In this case, if GRE scores (which are designed to predict intelligence) accurately predict getting all A's in graduate school, then the GRE demonstrates high predictive validity.

Question 12

A variable that makes it difficult to determine the effect of the treatment variable on the dependent measure is known as an:

Accepted Answer

A confounding variable is one that influences both the dependent variable and independent variable, causing a spurious association. This makes it difficult to determine the actual effect of the treatment variable on the outcome.

Question 13

Kali is in an experiment where subjects are given a drug that is supposed to make them feel less depressed. She starts to feel better even though she is in the control group. This is known as the:

Accepted Answer

The placebo effect occurs when a person experiences a physiological or psychological improvement after being given a treatment that has no therapeutic effect, such as being in a control group and receiving a sugar pill instead of the actual medication. Kali feeling better despite not receiving the active drug is a classic example of the placebo effect.

Question 14

Esperanza is in an experiment where subjects are given a drug that is supposed to make them feel less anxious. Neither Esperanza nor the researcher know what treatment she is receiving. This is known as a(n):

Accepted Answer

This is an example of a double-blind study, where neither the participants nor the researchers know who is receiving the actual treatment and who is receiving a placebo, to prevent bias in the results.

Question 15

Terrell is performing a study on the effects of benzodiazepines on anxiety. Some patients are in the control group and others in the experimental group. Only Terrell knows who is in what group. This is known as a:

Accepted Answer

In a single-blind study, only the researcher knows whether a participant is receiving the experimental treatment or is in the control group. The participants do not know which group they are in, which helps to prevent their expectations from influencing the results.

Question 16

A treatment is said to be _____ if the main variable influences the purported dependent variable; if p<.05 than the measure is said to be ______.

Accepted Answer

The correct answer is that a treatment is said to be clinically significant if the main variable influences the purported dependent variable; if p<.05, then the measure is said to be statistically significant. Clinical significance refers to the practical importance of a treatment effect - whether it has a real, noticeable impact on daily life. Statistical significance, indicated by p<.05, suggests that the observed effect is unlikely to have occurred by chance, but it does not necessarily imply that the effect is large or important in a practical sense.

Question 17

One of the advantages of a two-group design is that it:

Accepted Answer

A two-group design can control for history effects by having a control group that experiences the same historical events as the treatment group, allowing for a comparison that isolates the effect of the treatment itself.

Question 18

Research based on things like observations of behaviors is classified as:

Accepted Answer

Research based on observations of behaviors typically falls under qualitative research. This type of research focuses on understanding concepts, thoughts, or experiences through analysis of non-numerical data such as texts, interviews, or observations, rather than through statistical methods.

Question 19

A(n) _____ seeks to determine if a particular service is needed and useful and, if so, for whom it would be best whether there is a need for it.

Accepted Answer

Program evaluation is the process used to assess the need, usefulness, and effectiveness of a service or program, determining its value and impact on a specific population.

Question 20

Briefly describe the constructs of reliability and validity. If you have to pick one, which would it be and why?

Accepted Answer

The answer of Briefly describe the constructs of reliability and...

Quiz 3: Methods for Research and Evaluation