Deck 16: Accountability in Counseling

Question 1

__________ ordinarily would NOT be considered stakeholders of a counseling program.

A) Third-party insurance payers
B) Administrators
C) Parents and teachers
D) Clergy

Answer 1

Clergy

Question 2

The most important factor to consider when creating a counseling program advisory committee is

A) reliability.
B) influence.
C) experience.
D) professionalism.

Answer 2

influence.

Question 3

Aggregated data

A) is helpful for understanding how the average students perform.
B) tells very little about diversity of learner performance.
C) shows a total grade level or school-wide results.
D) All of the above.

Answer 3

All of the above.

Question 4

While using performance data, professional counselors must understand

A) the expectations of the students/clients.
B) what the purpose of the assessment is.
C) norm-referenced and criterion-referenced score interpretation.
D) None of the above.

Question 5

A __________ is best described as a line up of 100 individuals, with the first student being the lowest performing and the 100^th student being the highest performing student.

A) percentile rank
B) criterion-referenced score
C) quartile
D) stanine

Question 6

A perceptions-based needs assessment

A) includes the professional counselor gathering information about performance data.
B) is more content driven and subjective than a data-driven needs assessment.
C) only shows the goals of administrators for their students.
D) includes only the teachers' referrals of students to the counselor.

Question 7

How long should you ordinarily take to conduct a needs assessment for a new program or one undergoing tremendous renovations?

A) One year
B) Ten years
C) Up to 20 years
D) Six years

Question 8

__________ is a significant challenge of conducting a perceptions-based needs assessment?

A) Receiving consent from parents to provide an assessment to students.
B) Convincing teachers to allow you to conduct one in their busy classrooms.
C) Survey return rate.
D) None of the above.

Question 9

__________ is the process of confirming the agreement of priorities by several populations assessed.

A) Triangulation
B) Concurrent validity
C) Coinciding data
D) Value-added assessment

Question 10

A __________ is a method for determining needs.

A) questionnaire
B) classroom visit
C) personal interview
D) All of the above.

Question 11

In the ABCD model for writing objectives, ABCD stands for

A) Action, Behavior, Conditions, and Developmental age.
B) Audience, Behavior, Conditions, and Description of expected performance criterion.
C) Action, Before and after, Calculations, and Description of expected performance criterion.
D) Antecedent, Behavior, Consequence, and Data-driven needs assessment.

Question 12

Which of the following is NOT a purpose of evaluation?

A) To analyze the program budget and compare expenditures to future program needs.
B) To collect data that will be meaningful in determining what program modifications are indicated.
C) To collect data that will become an important part of the counselor's evaluation.
D) All of the above are purposes of evaluation.

Question 13

__________ involves a systematic examination of a program's content.

A) Program evaluation
B) Value-added assessment
C) Service assessment
D) Outcome evaluation

Question 14

Agency directors, counselor supervisors, superintendents, and school boards may request __________ to document how counselors are spending their time.

A) program evaluations
B) service assessments
C) outcome evaluations
D) computation of school-wide scores on achievement tests

Question 15

A __________ can assist professional counselors in documenting information needed in a service assessment.

A) tallying sheet
B) computation program
C) time log
D) stop watch

Question 16

One important disadvantage of a service assessment is

A) it does not give information about the quality or effectiveness of counselor interventions.
B) it takes a great deal of time and resources to conduct.
C) counselors often have a difficult time documenting and categorizing all of their services.
D) it tells how counselors are actually spending their time.

Question 17

A(n) __________ answer(s) the question, "How are members different as a result of the intervention?"

A) service assessment
B) criterion-referenced norm
C) outcomes evaluation
D) stakeholder perception

Question 18

In contrast to formative evaluation, summative evaluation is

A) collected at a specific endpoint in an evaluation process.
B) collected at intervals throughout the implementation of the program.
C) more appropriate for first year counselors to implement.
D) more effective in determining counseling program changes.

Question 19

A(n) __________ is an important way for professional counselors to demonstrate the effectiveness of a counseling program.

A) outcome
B) aggregated hierarchical model
C) perception-based needs assessment
D) control group

Question 20

Random assignment of participants

A) creates aggregated data to be evaluated.
B) helps counselors disaggregate data much more efficiently.
C) randomizes various sources of error allowing for the control of validity threats.
D) All of the above.

Question 21

Quasi-experimental and nonexperimental designs

A) allow the counselor to conclude that the treatment was the cause of changes in participants.
B) include case studies and time series designs.
C) have very valuable and powerful results.
D) randomly assign participants to treatment conditions.

Question 22

___________ usually involve a protocol and predetermined procedures for collecting specific types of data during a specified time period.

A) Informal observations
B) Single-subject research designs
C) Formal observations
D) None of the above.

Question 23

In a single-subject research design, the _________ refers to the state of the individual before the intervention begins.

A) baseline
B) condition line
C) dependent variable
D) pre-treatment stage

Question 24

__________ would be appropriate for disseminating results of the counseling program?

A) Written reports
B) Multimedia presentations
C) E-mail
D) All of the above.

Question 25

Accountability in counseling answers the question,

A) What did the client's learn from the counseling services?
B) How effective were the counseling services?
C) How effective was the counselor in implementing the services?
D) How are clients different as a result of the counseling services?

Question 26

Accountability practices usually involve

A) collecting data and assessing the needs of clients, staff, and community.
B) using data to establish objectives and goals.
C) conducting effective interventions based on objectives and goals determined.
D) All of the above.

Question 27

In an agency based counseling program, it would be important to include __________ on an advisory committee.

A) professional counselors
B) community leaders
C) politicians
D) All of the above.

Question 28

A student's achievement test score was ranked at the 61st percentile. This means that the student

A) was outperformed by 61% of age-mates.
B) outperformed 61% of age-mates.
C) outperformed 60 of his age-mates.
D) was outperformed by 60 of his age-mates.

Question 29

School counselors should conduct a programmatic needs assessment

A) yearly.
B) every other year.
C) on a 6 year cycle.
D) on a 3 year cycle.

Question 30

In order to receive the highest return rate on a needs assessment survey it should

A) be one page in length.
B) be distributed to a captured audience.
C) take no longer than 5 minutes to complete.
D) All of the above

Question 31

Service assessments in program evaluation are used to determine

A) the efficacy of counseling interventions.
B) the efficacy of the counselor's skills.
C) how the counselor spends his/her time.
D) All of the above.

Question 32

A value-added assessment answers the question,

A) What value does the counselor add to the program interventions?
B) What value does the counseling service add to the student/client?
C) What value does the counseling service add to the student/client's performance?
D) How can value be added to the intervention or program?

Question 33

All of the following are examples of non-experimental designs EXCEPT

A) static group comparison.
B) case study.
C) pre-test-post-test single group design.
D) nonequivalent control group design.

Question 34

An outcome evaluation

A) answers how clients are different as a result of the intervention.
B) is used to improve future programs.
C) analyzes the performance or products of clients.
D) All of the above.

Question 35

An aggregated hierarchical model involves all of the following EXCEPT

A) outcomes.
B) goals.
C) objectives.
D) audit.

Question 36

An example of a true experimental design is the

A) randomized post-test only control group design.
B) two -sample pre-test post-test design.
C) case study.
D) time series design.

Question 37

A counselor who wants to assess the current study skills of a group of students prior to and after running a study skills group intervention would use a

A) randomized post-test only control group design.
B) pretest-post-test single-group design.
C) time series design.
D) case study.

Question 38

__________ is an example of an academic performance indicator.

A) Art work
B) Unstructured interview
C) Survey
D) Informal observation

Question 39

In an AB design, the A stands for __________ and the B for __________.

A) intervention, behavior
B) baseline, intervention
C) behavior, intervention
D) behavior, treatment

Question 40

The counselor is tallying how many times the student speaks out in class. In an AB design, how many times the student speaks out is the

A) antecedent.
B) dependent variable.
C) independent variable.
D) construct.

Question 41

A control group may be referred to as

A) wait-list control.
B) treatment as usual.
C) placebo group.
D) All of the above.

Question 42

Accountability in counseling answers the question,

A) How many hours did you spend doing classroom guidance this year?
B) How are clients different as a result of the services provided by professional counselors?
C) What is a comprehensive developmental school counseling program?
D) What will every student know and be able to do?

Question 43

Which of the following is NOT a disadvantage of conducting accountability studies?

A) It takes time and resources to do quality outcomes research and evaluation.
B) Data is sometimes "over interpreted" or given undue meaning.
C) Some stakeholders do not trust data provided in accountability studies.
D) Comprehensive evaluations are seldom conducted.

Question 44

The purpose of a needs assessment is to

A) understand the needs of various subpopulations in the school community.
B) establish priorities that guide the construction of a counseling program.
C) allow stakeholders to indicate population needs.
D) All of the above.

Question 45

Disaggregated means

A) data can be analyzed by looking at differences among groups.
B) results in the outcomes study do not meet the expected results.
C) stakeholders found many priorities differing from those of the professional counselor.
D) All of the above.

Question 46

__________should be assessed when conducting a perceptions-based needs assessment.

A) Parents
B) Staff members
C) Students
D) All of the above.

Question 47

__________ would NOT be appropriate response formats for a needs assessment?

A) Multi-scale formats
B) Likert-type scales
C) Essay/short answer questions
D) True/false questions

Question 48

A(n) __________ frequently provides an analysis of each facet of the comprehensive counseling program.

A) outcomes evaluation
B) service assessment
C) results assessment
D) program audit

Question 49

__________ is/are NOT a potential source of accountability evidence?

A) Portfolios
B) Newspapers
C) Focus groups
D) Client/student work

Question 50

A wait-list control group would

A) experience nothing.
B) undergo a counseling experience for a different issue.
C) receive their typical treatment for the presenting problem.
D) All of the above.

Question 51

__________ refers to the focus on changing social, ecological, and client conditions in particular environments.

A) Action research
B) A single-subject research design
C) A true experimental research design
D) A quasi-experimental research design

Question 52

The content of a needs assessment should be __________ rather than service related.

A) topical
B) researched
C) factual
D) informative

Question 53

Which of the following is an important facet of program evaluation in relation to accountability?

A) Results or outcome evaluation
B) Service assessment
C) Process evaluation
D) All of the above

Question 54

All of the following steps are considered when developing an action research plan EXCEPT

A) gathering data.
B) creating action plan.
C) evaluating and reflecting.
D) plotting data points on a graph.

Question 55

__________ involve the professional counselor documenting each time an individual is contacted or provided with a counseling service and the nature of the topic addressed.

A) Time logs
B) Event-topic counts
C) Consultations
D) Outcome measures

Question 56

A __________ is the state of the individual before the intervention begins.

A) control
B) outcome
C) baseline
D) reference

Question 57

__________ approaches to needs assessment use existing data to determine client population needs and treatment equity.

A) Counselor-driven
B) Client-driven
C) Data-driven
D) Population-driven

Question 58

A formative evaluation involves feedback

A) given based on information from stakeholders.
B) given by clients based on their needs.
C) collected at a specified end point.
D) that occurs during the implementation of a program.

Question 59

A(n) __________ is created by the client that stemmed from a program standard, whereas a(n) __________ is a collection of exemplar products that can be evaluated to determine the quality of the individual's performance.

A) product, portfolio
B) portfolio, product
C) product, assessment
D) assessment, portfolio

Question 60

A __________ assessment establishes a baseline and evaluates students' progress over time.

A) value-added
B) value-stay
C) value-occurring
D) value-worth

Question 61

An aggregated hierarchical model is composed of

A) objectives, outcomes, and goals.
B) objectives, goals, and data.
C) goals, data, and outcomes.
D) data, outcomes, and objectives.

Question 62

An interview can be

A) unstructured.
B) structured.
C) semi-structured.
D) All of the above.

Question 63

__________ means that all student results are lumped together to show total grade level or school-wide results.

A) Summative
B) Disaggregated
C) Aggregated
D) Categorized

Question 64

Accountability involves

A) sharing results with major stakeholder groups.
B) setting goals and establishing objectives based on data/determined needs.
C) collecting data and assessing client, staff, and community needs.
D) All of the above.

Question 65

Which of the following is considered a topical needs assessment?

A) Individual counseling
B) Consultation
C) Substance abuse
D) Group counseling

Question 66

__________ is the most important factor to consider when composing a counseling program advisory committee.

A) Size
B) Influence
C) Schedules
D) Diversity

Question 67

What does the C in the ABCD model for writing learning objectives stands for

A) conditions.
B) consultation.
C) client.
D) criterion.

Question 68

The percent of returned surveys out of those distributed is known as

A) return percent.
B) return proportion.
C) return comparison.
D) return rate.

Question 69

The counting of the number of clients who may benefit from intervention is known as

A) tableting.
B) tabulating.
C) triangulating.
D) tallying.

Question 70

A percentile rank is most easily understood if a lineup of _____ individuals all with certain characteristics in common is visualized.

A) 25
B) 50
C) 75
D) 100

Question 71

All of the following are considered sequencing questions EXCEPT:

A) Are leading questions avoided?
B) Are questions with similar content grouped logically?
C) Are only closed-ended questions used?
D) Are later responses biased by early questions?

Question 72

In order for counseling to remain valued by the public and paid for by third-party payers and clients, professional counselors must

A) show their credentials to each client.
B) provide evidence showing their work is worthwhile and produces results.
C) prove they attended a CACREP program.
D) have taken a specified number of credits in testing and DSM diagnosis.

Question 73

__________ answers the question, "How are clients different as a result of the services provided by professional counselors?"

A) Research
B) Testing
C) Accountability
D) Theories

Question 74

The second of four quartiles includes percentile ranks ranging from

A) 1-25.
B) 25-49.
C) 26-50.
D) 50-75.

Question 75

Briefly describe what accountability in counseling involves.

Question 76

What are the advantages and disadvantages of conducting accountability studies.

Question 77

Describe the two different types of needs assessments.

Question 78

What is included in an efficient needs assessment?

Question 79

Explain the process of converting needs assessment results to program goals and objectives.

Question 80

Describe process evaluation, service assessment, and outcome evaluation.