Deck 2: Foundations of Recruitment and Selection I: Reliability and Validity

Question 1

Which of the following terms refers to relationships between observations

A)a variance
B)a construct
C)a concept
D)a validation

Answer 1

B

Question 2

Which of the following concepts is defined as the hypothetical difference between an individual's observed score on any particular measurement and the individual's true score

A)measurement error
B)standard deviation
C)lack of standardization
D)test and retest

Answer 2

A

Question 3

What is a defining characteristic of a practice-based selection process

A)It is defensible.
B)It is intuitive.
C)It is system-wide.
D)It is structured.

Answer 3

B

Question 4

To estimate reliability, it is important to adopt a strategy to develop approximations of parallel measures.Which of the following is NOT such a strategy

A)internal consistency
B)test and retest
C)intra-rater agreement
D)alternate forms

Question 5

What do you get when you square the reliability coefficient

A)the proportion of consistency in the true scores attributed to true differences on the measured characteristic
B)the proportion of error in the error scores attributed to true differences on the measured characteristic
C)the proportion of measurement error in the observed scores attributed to true differences on the measured characteristic
D)the proportion of variance in the observed scores attributed to true differences on the measured characteristic

Question 6

The Toronto Police Service requires candidates to show that they are Canadian citizens or permanent residents, are at least 18 years of age, and have a valid driver's licence and no record of criminal convictions.What would these requirements be classified as

A)KSAOs
B)screening criteria
C)performance dimensions
D)reliable qualifications

Question 7

Which of the following statements applies to a test by the UK Department of Work and Pensions (DWP), as described in the "Sham Psychometric Test" controversy

A)The test was appropriate because it had a valid goal: to help people find jobs.
B)The test was appropriate because it came from a larger test that had been validated by the DWP.
C)The test was inappropriate because it showed strengths but not weaknesses.
D)The test was inappropriate because it had not been validated for use by the DWP.

Question 8

What concept is defined as the degree to which observed scores are free from random measurement errors

A)validity
B)fairness
C)error score
D)reliability

Question 9

Which of the following is NOT a reason to use practice-based selection approaches

A)fit with organizational culture
B)comfort with the process
C)consistency of the process
D)flexibility and speed

Question 10

Which of the following is NOT a broad category of factors that affect reliability

A)lack of standardization
B)temporary individual characteristics
C)seasonality
D)chance

Question 11

What is the final step in the selection process

A)developing performance indicators for the individuals who were hired with the process
B)gathering feedback from the individuals who were hired with the process
C)demonstrating that hiring decisions based on the selection system have utility
D)demonstrating that hiring decisions based on the selection system are reliable

Question 12

What is a potential outcome of a practice-based selection process

A)the effective use of structured and consistent procedures
B)a defensible system with effective employees
C)increased productivity and competitiveness
D)human rights litigation and marginal employees

Question 13

For what is job analysis information used

A)to ensure reliability throughout the selection process
B)to identify both the performance domain and the knowledge, skills, abilities, and other attributes linked to job performance
C)to ensure the selection process is fair, equitable, and unbiased
D)to ensure utility throughout the recruitment and selection process

Question 14

What is the first step in an organization's selection process

A)reviewing the candidate pool for the job position
B)identifying knowledge, skills, abilities, and other attributes for the job position
C)acquiring job analysis information for the job position
D)developing performance indicators and job dimension for the job position

Question 15

Which of the following is NOT a selection criterion for the Toronto Police Service

A)The applicant must meet the vision standard for the Toronto Police Service.
B)The applicant must have successfully completed four years of secondary school education.
C)The applicant must be a Canadian citizen or landed immigrant.
D)The applicant must not have a criminal record for which a pardon has not been granted.

Question 16

What is the best way for HR professionals to ensure that their selection decisions meet the standards set by courts and tribunals

A)completely eliminating factors such as age, gender, and disability when considering candidates
B)thoroughly analyzing required KSAOs for each position to be filled
C)avoiding making hiring decisions
D)using valid and reliable science-based methods when choosing BFORs

Question 17

Which of the following is NOT a technical quality of a testing procedure

A)standardized test administration
B)test reliability
C)validity evidence
D)careful test development

Question 18

What is a defining characteristic of a science-based selection process

A)It is flexible.
B)It is intuitive.
C)It is rational.
D)It is subjective.

Question 19

Which of the following is NOT a statement about reliability

A)Reliability is an indication of the stability of measurements.
B)Reliability is the degree that observed scores are free from random errors.
C)Reliability is the amount of systemic errors relative to their true score.
D)Reliability is the consistency of a set of measurements over time.

Question 20

What is a potential outcome of a science-based selection process

A)a significant number of qualified applicants
B)a defensible system with effective employees
C)a flexible, quick process that fits the organization's culture
D)a process that is comfortable and flexible for all employees

Question 21

Which of the following is correct

A)A test can be reliable but not valid.
B)Construct validity is another term for content validity.
C)Bias refers to the reaction of test takers to a particular test.
D)A test can be valid but not reliable.

Question 22

The HR manager focuses on one variable, usually job performance, in the selection process.

Question 23

If an employer does not have a reliable and valid selection process, it can still make a correct guess about an applicant that will have positive benefits for the organization.

Question 24

What could an employer do to establish concurrent validity

A)compare test results with performance ratings of existing employees
B)compare test results with employee performance ratings after one year on the job
C)compare test results with results of previously validated test
D)have experts determine whether the test accurately measures the current content of the job

Question 25

Which of the following concepts refers to the use of different selection rules for different identifiable subgroups

A)subgroup differential
B)subgroup bias
C)subgroup norming
D)subgroup fairness

Question 26

An HRM used the identical measurement procedure to assess the same characteristic over the same group of people on different occasions.What method of estimating reliability was used

A)test and retest
B)alternate forms
C)internal consistency
D)inter-rater reliability

Question 27

What two strategies are typical methods that a researcher uses to acquire evidence for test-criterion relationships

A)criterion-related and correlation
B)inference and intuition
C)differential and selective
D)predictive and concurrent

Question 28

What concept is defined as follows: the decrease in magnitude of the validity coefficient associated with measurement error of the predictor, the criterion, or both

A)sampling error
B)regression
C)attenuation
D)differential prediction

Question 29

Which of the following statements is true

A)Validity concepts in selection apply only to test scores.
B)U.S.Labor Department guidelines suggest that tests with validity coefficients above .35 are very beneficial.
C)U.S.Labor Department guidelines suggest that only tests with reliability coefficients above .55 should be used in selection.
D)Employment tests have been shown to have no adverse impact on applicants.

Question 30

In their mid-1970s research, what procedure did researchers Schmidt and Hunter use to challenge the idea that a validity coefficient is specific to the context in which it is measured

A)validity generalization
B)meta-analysis
C)range restriction
D)attenuation

Question 31

Which employment test has been identified as being biased in favour of males

A)Bennett Mechanical Comprehension test
B)Wonderlic Personnel test
C)Toronto Police Service physical abilities test
D)cognitive ability test

Question 32

To test validity, a content sampling strategy is often applied to the selection process.Which of the following is NOT a step in this content sampling strategy

A)A scoring scheme is developed for the selection assessments.
B)Tasks of the target position are identified by job experts.
C)Job experts independently rate the reliability of each task.
D)Job experts evaluate the relationship between performance and job success.

Question 33

Employers must know the legal and professional standards in order to increase the likelihood that their selection processes are compliant.

Question 34

What concept is defined by the following: "systematic errors in measurement, or inferences made from those measurements, that are related to different identifiable group membership characteristics such as age, sex, or race "

A)discrimination
B)unfairness
C)bias
D)validity

Question 35

The goal of selection is to identify job candidates who have those attributes required for success on the job.

Question 36

The employer's goal in selection is to hire an applicant who possesses the necessary knowledge, skills, abilities, and other attributes to perform the job being filled.

Question 37

An employer's employment decisions must be rational and intuitive.

Question 38

Employers who are concerned about an applicant's opinion about the usefulness of a test or certain questions on a test are considering what element in the proper use of tests

A)content validity
B)validity generalization
C)face validity
D)construct validity

Question 39

What concept is defined as the predicted average performance score of a subgroup

A)subgroup prediction
B)differential prediction
C)systematic prediction
D)performance prediction

Question 40

The head of HR at Megatherium Industries wants to use a cognitive ability test for applicants to a management position.If she wants to follow science-based methods in selection, but is unwilling to run a validation study, what approach should she use to test validation

A)use of best practices
B)comparison of test results of high-performing and low-performing employees
C)comparison of test questions with job content
D)use of validity generalization

Question 41

Issues of fairness need to be determined statistically.

Question 42

Measurement error can be thought of as the hypothetical difference between an individual's observed score on any particular measurement and the individual's true score.

Question 43

When candidates are asked different questions from one interview to the other, validity is reduced.

Question 44

What is fairness
Why is it an important concept in selection

Question 45

The reliability coefficient is the degree that true scores correlate with one another.

Question 46

What is reliability
Identify three factors affecting reliability.

Question 47

Achieving fairness often requires compromise between conflicting interests.

Question 48

The principle that every test taker should be assessed in an equitable manner is known as equity.

Question 49

How does science affect the selection process

Question 50

What is validity in selection
Describe four validation strategies.

Question 51

Hiring decisions must be defensible; they must meet legal requirements and professional standards of reliability and validity.

Question 52

Scribe Engineering, a medium-sized information technology company, is having difficulties recruiting and retaining several of its administrative assistant positions.Traditionally, Scribe has used a practice-based selection process.As the new HRM, what would you suggest to the CEO

Question 53

Validity is the degree to which observed scores are free from random measurement errors.

Question 54

Discuss face validity and explain whether it is based on the perceptions of the test taker or of experts.

Question 55

What is bias in selection

Question 56

Since TS Inc.is a small, growing aviation company, the CEO makes the hiring decisions based on his years of experience as well as his gut feeling.He started the business 10 years ago with 10 employees and the company has grown to over 30 employees.The CEO has asked you, the HRM, to explain some of the differences between the use of his practice-based selection approach and an empirical-based process.Also explain what challenges you anticipate he would face in using validation techniques.

Question 57

Choose a specific job you are familiar with and choose one characteristic that you think is critical to successfully performing that job.If you were the HRM hiring for this position, what would you consider in measuring the characteristic and job performance to ensure reliability and validity

Question 58

An employer's recruitment and selection process goal is to attract and hire an applicant who possesses the knowledge, skills, abilities, and other attributes to successfully perform the job.