Deck 9: Evaluation of Training

Question 1

Which of the following statements is true regarding learning outcomes?

A)There are two main categories,knowledge and skill.
B)To assess knowledge,you will need to develop a knowledge test.
C)Learning must be determined within the first 2 weeks after training.
D)It is sometimes useful to assess learning periodically during training.

Answer 1

D

Question 2

What are the outcome levels of evaluation identified in the text?

A)Proactive and reactive
B)Cost benefit and cost effectiveness
C)Reaction,learning,behavior,and organizational results
D)Utility,value,and evaluative

Answer 2

C

Question 3

Training was developed to improve productivity.When assessing training's effectiveness at the organizational results level,which of the following would be the most appropriate thing to focus your attention on?

A)Organizational profitability
B)Work unit productivity
C)Market share
D)Corporate strategy
E)All of the above

Answer 3

B

Question 4

If the training was designed to teach trainees how to use the new forms that were developed by Human Resources,you can expect to measure this transfer of training

A)In about 6 months.
B)In about 3 weeks.
C)It is not necessary if learning was indicated to have occurred.
D)A few days after training.

Question 5

Which of the following statements is true regarding the evaluation of transfer of training?

A)It is often more difficult to assess than organizational results.
B)The evaluation needs to take place a few weeks after training,before forgetting becomes a possibility.
C)Attitude change needs to be measured using well-developed instruments.
D)It is useful to ask coworkers if they have noted the specific change in behavior.
E)C & D

Question 6

According to the text,which of the following groups would be interested in "process evaluation" data?

A)Trainers (including trainer doing the training)
B)Trainees
C)Trainees' supervisor
D)Both A & B
E)All of the above

Question 7

Which of the following are reasons usually given by managers for not evaluating training?

A)Nothing to evaluate
B)Too complex a job
C)No one cares about the evaluation
D)Both A & C
E)All of the above

Question 8

_____ are measures of the trainee's perceptions,emotions,and subjective evaluations of the training experience.

A)Reaction outcomes
B)Learning outcomes
C)Job behavior outcomes
D)Organizational results
E)Value outcomes

Question 9

Which of the following is NOT obtained from a reaction questionnaire?

A)Facilities issues
B)Trainer issues
C)Amount of learning
D)Perceived value of training
E)Relevance of training

Question 10

Which of the following statements regarding process evaluation is true?

A)The training manager is always interested in this data.
B)It is not that important to gather such information for a one- time half-day seminar.
C) Trainees are not interested in this data.
D) Only newer trainers are interested in this type of data.

Question 11

Scripted situations are a

A)Process for assessing learning.
B)Process for training interpersonal skills.
C)Process for assessing transfer of training to the job.
D)Means of measuring attitudes.

Question 12

Outcome evaluation determines

A)The learning outcomes.
B)How well the training accomplished its goals.
C)How well the trainer covered the objectives.
D)None of the above.

Question 13

Research has shown the relationship between reaction,learning,behavior and results is

A)Strongly correlated.
B)Weakly correlated.
C)Evidence is mixed.
D)None of the above.

Question 14

Which of the following categories should be included in a reaction questionnaire?

A)Relevance of training
B)Training content
C)Trainer's behavior
D)Both A & B
E)A,B,& C

Question 15

Evaluation of the _____ examines how the training was carried out._____ evaluation determines if training accomplished its _____.

A)Process;Outcome;Objectives
B)Objectives;Process;Task
C)Outcome;Task;Goals
D)Design;Implementation;Strategy

Question 16

What are the inputs into the evaluation phase of training?

A) Evaluation strategy and design B Evaluation objectives and design issues
C) Organizational constraints
D)B & C
E) A & C

Question 17

Cost effectiveness evaluation _____.

A)Compares the monetary costs of training to the financial benefits accrued from training
B)Compares the monetary costs of training to the non?monetary benefits from training
C)Compares the social costs of training to the financial benefits accrued from training
D)Compares the monetary costs of trainers to the financial benefits accrued from training
E)Compares the monetary costs and non?monetary costs of training to the financial benefits accrued from training

Question 18

Which of the following statements concerning reaction questionnaires is NOT true?

A)They are used to determine what trainees thought about training.
B)There are two classifications of reaction questionnaires.
C)Utility reaction questionnaires reflect the trainee's belief about the value of the training.
D)All of the above are true.

Question 19

Which kind of analysis compares the monetary cost of training with the intangible or nonmonetary results?

A)Cost saving
B)Cost effectiveness
C)Cost benefit
D)All of the above

Question 20

Which of the following times is best for providing the opportunity to complete a reaction questionnaire?

A)During training (after each segment)
B)Immediately following training
C)One or two months after training
D)A or B,depending on what information you are after
E)A,B,or C,depending on what information you are after

Question 21

______To assess a change in attitude toward teamwork after training,simply ask trainees if they feel more positive toward teamwork.

Question 22

The training manager is likely interested in which of the evaluation outcomes?

A)Reaction,learning,and behavior
B)Reaction,learning,behavior,and results
C)Learning and behavior
D)Behavior and results
E)None of the above

Question 23

____The trainees are very interested in obtaining the process evaluation data.

Question 24

_______The ultimate reason for training is organizational results.

Question 25

Upper management's interest in "outcome evaluation" data is focused on

A)Learning behavior and results.
B)Behavior and results.
C)Perhaps an interest in behavior and a definite interest in results.
D)No interest in any level.

Question 26

The confidence that evaluation findings will generalize to others who undergo the training is known as

A)History.
B)Maturation.
C)Internal validity.
D)External validity.
E)Testing.

Question 27

____The best time to determine if the training transferred to the job is 2 months after training

Question 28

The authors suggest that when assigning trainees to a control group or trained group,the best method to use is

A)Sampling.
B)Representative sampling.
C)Random assignment.
D)Random selection.

Question 29

____To be of any value,the reaction questionnaire must be administered right after training.

Question 30

Which of these statements is true regarding small business?

A)It might not be necessary to evaluate training.
B)If the training costs were significant,evaluation can be of value.
C)Much of the training in a small business is OTJ.
D)All of the above are true.

Question 31

When is the best time to evaluate training?

A)Immediately after training
B)A few days after training
C)3-6 months after training
D)It depends on each organization

Question 32

Name the design that fits the following description - Multiple measures of performance are taken and each group receives training,but at different points in time.

A)Multiple baseline design
B)Solomon's time series design
C)Group 4-time series design
D)Solomon's multiple baseline series design

Question 33

Utility analysis is a

A)Measure of learning.
B)Method of estimating overall value of training based on the trainee's change in behavior.
C)Simplified method of cost/benefit analysis.
D)A cost-savings analysis.

Question 34

The confidence you have that the results of the evaluation are in fact correct is called

A)Validity.
B)External validity.
C)Internal validity.
D)General validity.
E)History validity.

Question 35

Each of the following statements states a weakness with the evaluation techniques presented in the text;which of the statements is NOT true?

A)Posttest only - there could be a number of other competing causes for any change.
B)Pretest/posttest - it is difficult to determine the impact of training on any changes that occur.
C)Posttest only with control group - results may not generalize to other groups
D)Pretest/posttest with control group - threats to external validity are still a concern.
E)All of the above are true.

Question 36

____For organizational results measures,you can often use the data obtained in the original TNA as the pre measure.

Question 37

A group of similar employees who do not receive the training is called the

A)Random assignment group.
B)Factor analysis assignment.
C)Neutral group.
D)Control group.

Question 38

When the number of employees being trained is small,Blanchard & Thacker recommend which of the following evaluation designs?

A)Do not evaluate;it is not cost effective
B)Posttest only
C)Single case designs
D)Multiple?case designs

Question 39

_______An inexpensive but effective way to determine if training transferred to the job is to ask trainees in a reaction questionnaire.

Question 40

Which of the following is NOT listed as a threat to internal validity?

A)Maturation
B)Testing
C)Instrumentation
D)Statistical regression
E)Reaction to evaluation

Question 41

Define internal and external validity and explain five threats to internal validity and two threats to external validity.

Question 42

_____ It is always best to evaluate training using all three levels of evaluation.

Question 43

Describe the three kinds of knowledge that can be evaluated in training and how they can be measured.

Question 44

______ A cost/ benefit evaluation compares the monetary cost of training with the non-monetary benefits.

Question 45

Briefly discuss the reasons and counter?reasons for not evaluating training programs.

Question 46

Describe the cost benefit evaluation and cost effectiveness evaluation methods of evaluating whether training was "worth it."

Question 47

Explain the four types of evaluation outcomes identified in the text.

Question 48

_____In organizations,random assignment is the method to use when placing individuals in the control group and trainee group

Question 49

____You must always have a pretest to compare your posttest to in a well-designed evaluation.

Question 50

____Maturation refers to the events other than training that take place concurrently with the training program.