Deck 1: Research Methods

Question 1

What are secondary data?

A) Subjective
B) Data are not themselves the direct source of data.
C) Data that can not be analyzed by statistical means
D) Confounded

Answer 1

B

Question 2

A meta-analysis is accomplished by aggregating the _________?

A) statistical effect size
B) Bayesian statistics
C) degree of evidence
D) statistical interactions

Answer 2

A

Question 3

A computational model uses the ____________?

A) statistical effect size
B) data from questionnaires
C) pooling of data
D) the output of a formula or a computer simulation

Answer 3

D

Question 4

An experimental design describes the _____ between an independent and a dependent variable?

A) confounding
B) interaction
C) conditions used to establish and effect or a causal relation
D) conflict

Question 5

What is a t-test?

A) A technique to analyze trends between two (or more) factors
B) A measure of effect size
C) A method to normalize a data set
D) A statistical test for the two level comparison

Question 6

A repeated measures design is when _____?

A) the experiment is repeated multiple times
B) each participant in the experiment receives both conditions.
C) the dependent variable is measured throughout the experiment
D) different participants receive the two conditions

Question 7

What is the benefit of a counterbalanced design?

A) It increases the effect size
B) It makes the data easier to analyze
C) It averages out the sequential biases when the two groups' performances are averaged
D) It provides insight into both side of an argument

Question 8

A 2 x 2 four condition experiment is an example of a ________?

A) factorial design
B) regression
C) computational model
D) meta-analysis

Question 9

What is a statistical interaction?

A) A conflict between the results of two separate statistical analyses
B) Another term for a confounding variable in the dataset
C) The results of a counter-balanced experimental design
D) The generalizability of an effect of one independent variable across levels of another

Question 10

What is a mixed design?

A) A counter-balanced experimental design
B) An experimental design with more than one hypothesis
C) One, or some of, the factors are repeated measures and other(s) are between subjects
D) An experimental design that utilizes a combination of qualitative and quantitative measures

Question 11

What is a regression analysis used on?

A) Questionnaire data exclusively
B) Interval or ratio- scale levels of the independent variable
C) Assumptions on the statistical power of the experimental design
D) The results of a computational model

Question 12

The extent to which people with higher situation awareness also experience higher workload can be analysed using a ___________?

A) t-test
B) analysis of variance
C) regression analysis
D) product moment correlation

Question 13

What is the effort-performance trade-off?

A) The results of a confounding variable in the experimental design
B) The declining performance of participants over the course of an experiment
C) The workload experienced by participants during an experiment
D) Participants in one condition expend greater effort to increase performance than in another
Condition

Question 14

What is N?

A) Sample size
B) Effect size
C) Statistical power
D) How the results of a product moment correlation are expressed

Question 15

What factor does NOT influence the statistical power of an experiment?

A) Effect size
B) Participant age
C) Sample size
D) Variability of the data

Question 16

What is ground truth?

A) The state of the world that the researcher believes
B) The state of the world that the academic literature advocates
C) The state of the world that the researcher wishes to discover
D) The state of the world that the experimental participants believe

Question 17

When does a Type I error occur?

A) When we fail to fully counter balance the experimental design
B) When we detect an effect that does exist
C) When we fail to detect an effect that does, in fact, exist
D) When we erroneously conclude there is an effect where in fact there is none

Question 18

When does a Type II error occur?

A) When we fail to detect an effect that does, in fact, exist
B) When we fail to fully counter balance the experimental design
C) When we erroneously conclude there is an effect where in fact there is none
D) When we detect an effect that does exist

Question 19

What is the effect of increasing statistical power?

A) Reduce the range of dependent variables that can be tested
B) Reduce the probability of a type II error without a corresponding increase in type I error
C) Reduce the number of participants required
D) Increase the applicability of the results to the real-world

Question 20

A meta-analysis is a tool for _______ ?

A) detecting potential confounds in an experimental design
B) debriefing participants after an experiment to gain additional insights
C) analyzing factorial designs
D) accumulating evidence over a series of experimental studies

Question 21

Analytical equation models often involve _____ ?

A) task analysis
B) linear algebra
C) statistic tests
D) participant validation

Question 22

A discreate event simulation model _____?

A) drives the presentation of the experimental scenario
B) provides the means by which participants interact with the scenario
C) runs in real time to simulate a process inferred to operate within the brain.
D) allows the real-time execution of a task analysis

Question 23

What is the main advantage of a discrete event simulation model?

A) It can impose the variability on the process that is an inherent feature of human performance
B) It reduces the impact of confounding variables
C) It can automatically generate a meta-analysis
D) It does not require validation