You are on page 1of 8

WHAT IS AN

ASSESSMENT CENTER?
THE ASSESSMENT CENTER METHOD,
APPLICATIONS, AND TECHNOLOGIES
BY SECTION 1: A traditional assessment center involves six
BY WILLIAM C. BYHAM, How an Assessment Center Works participants and lasts from one to three days.
PH.D. As participants work through the simulations,
DEVELOPMENT
The assessment center method involves multiple
they are observed by assessors (usually three
DIMENSIONS evaluation techniques, including various types
I N T E R N AT I O N A L line managers) who are trained to observe
of job-related simulations, and sometimes
and evaluate behavior and knowledge level.
interviews and psychological tests. Common
Assessors observe different participants in each
job simulations used in assessment centers are:
simulation and take notes on special observation
• In-basket exercises forms. After participants have completed their
simulations, assessors spend one or more days
• Group discussions
sharing their observations and agreeing on eval-
• Simulations of interviews with “subordinates” uations. If used, test and interview data are
or “clients” integrated into the decision-making process.
• Fact-finding exercises The assessors’ final assessment, contained in
a written report, details participants’ strengths
• Analysis/decision-making problems and development needs, and may evaluate their
• Oral presentation exercises overall potential for success in the target position
if that is the purpose of the center.
• Written communication exercises
Perhaps the most important feature of the
Simulations are designed to bring out behavior
assessment center method is that it relates not
relevant to the most important aspects of the
to current job performance, but to future perform-
position or level for which the assessees are
ance. By observing how a participant handles
being considered. Known as “dimensions”
the problems and challenges of the target job or
(or competencies) these aspects of the job are
job level (as simulated in the exercises), asses-
identified prior to the assessment center by ana-
sors get a valid picture of how that person would
lyzing the target position. A job analysis proce-
perform in the target position. This is especially
dure identifies the behaviors, motivations, and
useful when assessing individuals who hold jobs
WHAT IS AN ASSESSMENT CENTER?

types of knowledge that are critical for success


that don’t offer them an opportunity to exhibit
in the target position. During assessment, the
behavior related to the target position or level.
job simulations bring out assessees’ behavior
This is often the case with individuals who aspire
or knowledge in the target dimensions.
to management positions but presently hold
positions that don’t give them an opportunity to
exhibit management-related behavior on the job.

1
© Development Dimensions International, Inc., MMII. All rights reserved.
In addition to improved accuracy in diagnosis Thornton and Byham (1982) reviewed 29 studies
and selection, the organization that operates an of the validity of assessment center methodology.
assessment center enjoys a number of indirect The authors found more support for the assess-
benefits. Candidates accept the fairness and ment center method than for other selection
accuracy of promotion decisions more readily and methodologies, while lamenting the fact that most
have a better understanding of job requirements. of the studies were done by a few large organiza-
Training managers to be assessors increases their tions (AT&T, GE, IBM, SOHIO, and Sears).
skills in many other managerial tasks, such as
In 1985 Thornton and his associates at Colorado
handling performance appraisals and conducting
State University processed 220 validity coefficients
coaching and feedback discussions.
from 50 studies using a statistical approach called
meta-analysis. They estimated the method’s
SECTION 2: validity at .37 (Gaugler, Rosenthal, Thornton, &
Validity and Fairness Bentson, 1985). Working independently of
The assessment center method, in its modern Thornton, Wayne Cascio of the University of
form, came into existence as a result of the AT&T Colorado arrived at the same figure (.37) in
Management Progress Study (Bray, Campbell, studying the validity of first-level assessment
& Grant, 1974). In this study, which began in centers in an operating company of the Bell
the late 1950s, individuals entering management System. Cascio’s main interest, however, was
positions in Bell Telephone operating companies in measuring the “bottom-line impact” of promotion
were assessed and, from then on, their careers decisions based on assessment center information
were followed. The study was unusual in that versus decisions based on criteria extracted from
it was pure research. Neither the individuals other methods (Cascio & Ramos, 1984).
assessed nor their bosses were given information To determine the dollar impact of assessment
about their performance in the center. Nor was centers, Cascio needed more than validity infor-
this information in any way allowed to affect mation; he needed cost data (fully loaded costs
participants’ careers. Participants were assessed of the assessment process), plus job performance
soon after they entered management as new data expressed in dollars. Over a four-year period
college recruits or after they were promoted he developed a simple methodology for express-
from the ranks. ing in dollar terms the job performance levels of
Not only did researchers follow participant managers. Using information provided by more
advancement during the ensuing years, but a than 700 line managers, Cascio combined data
second assessment also was conducted eight on the validity and cost of the assessment center
years after the first (Howard & Bray, 1988). with the dollar-valued job performance of first-level
The criterion used was advancement to the managers. With this data, he produced an esti-
fourth level of management in a seven-level mate of the organization’s net gain in dollars
hierarchy. The eight-year prediction is more resulting from the use of assessment center
valid—an expected finding since most individuals information in the promotion process. Over a
would have begun to consolidate their manage- four-year period, the gain to the company in terms
ment skills after eight years in management. Yet of the improved job performance of new managers
the original assessment ratings were still valid— was estimated at $13.4 million, or approximately
WHAT IS AN ASSESSMENT CENTER?

even after 20 years. $2,700 each year for each of the 1,100 people
promoted in first-level management jobs.

2
© Development Dimensions International, Inc., MMII. All rights reserved.
Adverse Impact Selection and Placement of Candidates for
Higher Levels of Management
Compared to other selection methodologies, the
assessment center method generally is seen as In the early 1970s organizations began using
more fair and objective in terms of gender, race, the assessment center method to help select
and age than other methodologies. Some differ- and place individuals in higher levels of manage-
ential performance has been found but this usually ment. Assessment centers have been used to
is the result of differential applicant populations. help evaluate candidates for presidencies of
The method is uniquely fair because of its empha- organizations, plant managers, general managers,
sis on actual behavior rather than psychological and many senior government positions. Most
constructs. of these assessments were made by a team of
outside “professional” assessors (consultants).
There is consistent research showing that assess-
It is difficult to find qualified high-level, in-house
ment centers are unbiased in their predictions of
people who can take the time to assess and
future performance. These studies considered a
evaluate candidates objectively.
candidate’s age, race, and gender and found that
predictions by assessment center methodology
are equally valid for all candidates. (See Thornton SECTION 4:
& Byham, 1982, for a complete discussion of Selection and Placement of
these issues.) Empowered Personnel
Federal courts have viewed assessment centers The greatest growth of assessment centers since
as valid and fair. Indeed, they often have mandat- 1985 has been stimulated by organizations moving
ed assessment centers to overcome selection to an empowered workforce. These organizations
problems stemming from the use of paper-and- are giving employees:
pencil and other selection instruments. • Responsibility for their designated areas
or outputs.
SECTION 3: • Control over resources, systems, methods,
Adoption of the Assessment Center and equipment.
Method Outside the United States • Control over working conditions and schedules.

The chief reason the assessment center method is • Authority (within defined limits) to commit
the organization.
valid in so many different countries is that it is an
easily adaptable evaluation system, not an evalua- • Evaluation by achievements.
tion instrument. Users need not adopt dimensions Most also are organizing employees into self-
or standards of performance that are important in directed work teams. The teams are made up
the U.S. but perhaps unimportant in their country; of team members and a team leader (the team
they merely adopt a systematic procedure for eval- leader is a working, nonmanagement member
uating candidates against job-related dimensions of the team). Teams take responsibility for:
that are specific to their particular organization
• Improving quality and productivity; job rotation.
and environment. For example, the dimension
• Planning/Scheduling.
Interpersonal Sensitivity is shown in vastly different
ways in Japan than in the United States, but the • Who works on what.
WHAT IS AN ASSESSMENT CENTER?

method by which the dimension is assessed works • Quality audit.


just the same (and as well). • Equipment adjustment, maintenance, and repair.
• Housekeeping, vacation planning, absenteeism,
tardiness, and performance issues.
• Choosing the team leader.
• Many other areas.

3
© Development Dimensions International, Inc., MMII. All rights reserved.
The adaptation of self-directed teams drastically The assessment center method is an excellent
changes the role of supervisors and managers. diagnostic tool because it separates an individual’s
Supervisors (often called group leaders) have a abilities into specific areas (dimensions) and
very large span of control, with as many as 100 then seeks specific examples of good and poor
subordinates. Because teams and team leaders behavior within each dimension. This helps the
take on many of the normal supervisory functions, assessee and his/her boss determine more
the supervisors became more managerial in precisely what training and developmental
function, concentrating more on budgeting and activities are required.
planning. This, in turn, affects the role of middle
Almost all organizations using assessment centers
managers. The multiple-level changes in job
for selection or promotion also use the information
functions have forced organizations to use new
obtained to diagnose training needs. However, a
methods in connection with selection, promotion,
major shift in focus is the large number of firms
and placement decisions. Because assessment
now using assessment centers solely to diagnose
centers worked so well at supervisory and mana-
training needs.
gerial levels, it was natural to turn to assessment
centers as a methodology. One example is of two individuals who were
assessed in a training-needs diagnostic program.
Hundreds of manufacturing plants have used
One had extensive needs in interpersonal skills,
assessment centers to select employees, team
the other in decision making. As a result of these
leaders, and group leaders. To accomplish this,
profiles, very different training prescriptions
many new processes were developed, especially
emerged. Such information saves the individuals
in connection with “greenfield” plant start-ups
and their organizations a great deal of time
where large numbers of applicants must be
and effort by getting them into the right training
processed. Toyota assessed 22,000 applicants
program at the most appropriate time.
to staff their 3,000-person plant in Kentucky.
Most diagnostic assessment for managers is
At the employee level, exercises involve appli-
done within an organization using consultants.
cants in problem-solving group exercises,
Assessment at the executive level takes place in
simulations of the manufacturing process, and
elaborate, specially built assessment facilities
one-to-one interactive exercises. Supervisor
operated by consultants.
exercises provide opportunities to demonstrate
coaching, leadership, and decision-making skills. Diagnosing Management Skills and
Assumptions as Part of a Corporate
Diagnosis of Training and Development Needs Culture Change Strategy
Quick, easy training methods don’t change Individual assessments in a plant or department
people’s skill levels. Skill acquisition requires can be combined to form an integral part of an
intensive, time-consuming classroom training and organization’s culture change strategy. After an
must be coupled with opportunities for on-the-job organization has decided on the desired culture,
practice and feedback so new behaviors are the next logical step is to define the behaviors
“set” in the individual’s repertoire. Because skill necessary to implement that culture and evaluate
development takes a lot of time and effort, every- incumbents’ skill levels in these behavioral areas.
one cannot be trained in every skill. The assess- For example, an essential ingredient of a partici-
WHAT IS AN ASSESSMENT CENTER?

ment center method provides an effective means pative culture is the ability to run a meeting so all
to determine training or developmental needs. participants can speak their minds and have a
Individuals then can be placed in the most sense of ownership in decision making. A leader’s
appropriate program. skill in accomplishing this can be determined in an
assessment center.

4
© Development Dimensions International, Inc., MMII. All rights reserved.
This kind of diagnostic information is extremely business schools have used assessment center
useful in developing a culture-change strategy. technology to evaluate training programs (Byham,
Individuals who lack the skills needed to manage 1982). The advent of video technology, which
participatively cannot implement a participative allows the relatively inexpensive evaluation of
strategy even if they want to—they must increase individuals, has increased the application of
their basic skill level first. In addition, research assessment center methodology dramatically
shows that the easiest way to change a person’s in this area.
attitudes or basic assumptions about people is to
change the person’s behavior first. This represents SECTION 4:
a marked departure from the previous strategy New Simulations, Tests,
in which organizations tried to change attitudes and Methods
and hoped that behavioral change would follow.
Simulations such as In-basket exercises, group
With the new strategy, individuals are identified
discussions, management games, and analysis
whose attitudes or basic assumptions about
exercises described in Byham’s 1970 Harvard
people can be considered out of line with the
Business Review article are still the bedrock of
desired culture. Their behavior is changed
assessment center methodology. However, they
through an effective training and developmental
have been supplemented by new types of exercis-
program. This addresses their attitudes and
es, most importantly the interaction simulation.
assumptions through the positive reinforcement
In this exercise the assessee is given background
they receive for improved behavior. In time,
information about the need to interact with an
management effects the desired culture change
individual (subordinate, peer, or customer), and
throughout the organization.
personal information about the individual. After
Evaluating the Effectiveness the assessee has had an opportunity to prepare,
of Training Programs he or she conducts a simulated interaction with a
person trained as a roleplayer. The “interviewee”
The American Society for Training and Development
follows a well-defined role and makes standard
(ASTD) estimates that U.S. companies spend over
responses to all issues that might come up.
$60 billion each year on training. The fastest-grow-
A trained assessor observes the assessee’s
ing portion of this amount is for sales, supervisory,
behavior.
and management training, yet most companies
have not evaluated the effectiveness of their training Although leaderless group exercises still are
programs properly. used commonly to assess leadership, one-to-one
interaction simulations have become more popu-
Assessment center methodology is an excellent
lar. This change reflects a general feeling that
method for establishing the validity and effective-
individual leadership skills are not necessarily
ness of training programs. Three research
correlated with group leadership skills. Another
designs commonly are used. In the first design,
reason for the switch is that people going through
a group of individuals is trained while a matched
the same group exercise may have quite different
group is not. Both groups then are put through
experiences. Group interactions depend on the
an assessment center The second and third
nature of the people involved. Sometimes the
designs have a group of individuals assessed,
group is highly competitive; other times it is quite
WHAT IS AN ASSESSMENT CENTER?

then trained, then assessed again. The assess-


cooperative. Sometimes several people vie for
ment center results show that there were marked
leadership; other times only one person takes
changes in individuals’ performance after training.
charge. This lack of consistency has caused
Organizations such as SOHIO, Lukens Steel, organizations especially concerned with EEO
AT&T, the New York Metropolitan Transit Authority, issues to opt for the more standardized interaction
and over a dozen undergraduate and graduate simulations or different forms of group exercises.

5
© Development Dimensions International, Inc., MMII. All rights reserved.
A growing number of organizations have adopted followed AT&T’s lead, concentrating on behavioral
a “total simulation” approach to assessment. exercises rather than paper-and-pencil tests. Most
Instead of having a number of distinct and inde- even dropped intelligence tests because of the
pendent exercises, these organizations have common finding of adverse influence on blacks.
integrated their exercises into a common scenario. However, the Bell companies retained these tests.
Characters introduced in the In-basket exercise
Today intelligence tests (general ability tests),
are seen in later simulations, and candidates play
are being used again in conjunction with assess-
the same role throughout the assessment process.
ment centers. Research data show that the
combination of intelligence data and behavioral
Using Videotape to Stimulate Behavior
observations provides a markedly better means
A development in the last 15 years involves the of evaluating people than either used alone
use of videotape to stimulate assessee behavior. (Thornton & Byham, 1982). The problem with
An assessee watches a video of a situation he or using paper-and-pencil intelligence tests and other
she will face on the job (e.g., an interaction with a psychological instruments is that they require very
subordinate). Periodically the tape stops and the careful validation efforts, and assessors must be
assessee is presented with four choices of what specially trained in both data interpretation and
to do or say. A score is calculated based on the how to integrate that data with behavioral data.
assessee’s responses to a number of these situa-
Projective tests are frequently used in executive
tions. The scoring system is developed based on
level assessment centers. Inventories to match
a validity study.
job and candidate motivation profiles are used
Other applications use the video simulation to elicit at all levels.
verbal responses. This unaided overcomes any
bias caused by the multiple choice format. Multiple Perspective (Self-Report, Boss,
Subordinate, and Workplace Peer Evaluation
Psychological Inventories and Projective Tests Instruments)
The original AT&T research assessment centers An assessment center provides insights into
used psychological inventories (e.g., the Edwards many job dimensions, but usually not all important
Personal Preference Schedule) and projective dimensions. Dimensions such as Work Standards
tests (e.g., the Thematic Apperception Test) to and Energy are not evaluated well in assessment
supplement observations of assessees’ behaviors centers. To fill in these gaps and to get additional
as they progressed through assessment center insights to dimensions that are assessed in
simulations. AT&T dropped these instruments assessment centers, many organizations supple-
after they converted their research assessment ment their assessment centers with self-reports
centers to operational assessment centers run and with evaluations by the assessee’s boss and
by the Bell operating companies. AT&T dropped workplace peers or subordinates. In the usual
the tests for two reasons: (1) the operational situation, an assessee is given six questionnaires
assessment centers used managers (rather than that list the target dimensions with definitions.
psychologists) as assessors, and (2) paper-and- The assessee completes one and gives the other
pencil instruments were disputed during this five to his/her boss, peers, or subordinates. All
period (1960s) because of possible adverse questions are sent directly to a central location
WHAT IS AN ASSESSMENT CENTER?

impact on protected groups. Most organizations where a computer summarizes the data and
that adopted the assessment center methodology prepares a report.

6
© Development Dimensions International, Inc., MMII. All rights reserved.
The combination of assessment center, self-, tic instrument for many positions. Managers agree
and boss/peer/subordinate evaluations of a on the importance of thorough and accurate diag-
common set of dimensions makes a powerful noses, but are reluctant to spend the time needed
impact on assesses. The feedback counselor to produce the excellent diagnoses that the
and the assessee can compare and contrast assessment center methodology yields.
each dimension’s ratings from each source
(self, others, and the assessment center). Deformalizing the Method
Based on these insights, they can define A number of organizations in the United States
developmental actions more accurately. and overseas have overcome the implementation
problems noted earlier by making their assess-
New Methodologies
ment centers less formal and rigid while keeping
The biggest drawback in the ongoing use of the basic components that provide validity.
traditional assessment centers is the amount of Organizations do this by incorporating the assess-
managerial time required. In a typical assessment ment center method into an organization’s day-to-
center, a manager leaves his/her job for two or day activities, rather than by having their man-
three days to observe participants’ performance agers go off to a designated place, or to a “center.”
in simulations and then spends an additional day
The individual to be assessed is given a list of
or two meeting with other observers to make final
managers responsible for filling the position.
evaluations. Although managers recognize the
The assessee then schedules his/her own meet-
importance of selection and promotion decisions,
ings with these managers over a period of several
they are often reluctant to devote this much con-
weeks, according to the schedules of all parties.
centrated time to assessment. A related problem
The managers involved fit the time for the
is the formality of the traditional assessment
exercises into their usual activities.
center, which tends to make the center an “event.”
This may build expectations and call attention to During these meetings the managers put the
who is being assessed and who has not been assessee through the same job simulations
asked to participate. The traditional assessment used in formal assessment centers. For example,
center also forces organizations to put people one manager might interview the assessee about
through the process in groups; the method is why he or she took certain actions in the In-basket
useless when there are only two candidates exercise; another might have the assessee
for a position. present findings from an analysis and planning
exercise; and a third might observe the assessee
These constraints have limited assessment center
in a one-to-one interaction with another manager
method applications in some organizations to only
who role-plays a subordinate.
a few selection or promotion decisions. As a
result, many important and effective applications, At an appointed time the managers (assessors)
such as defining training needs, have not been meet to hold an assessor discussion that works
utilized widely. Although organizations recognize exactly like such discussions in a traditional
the increasing importance of accurately diagnosing assessment center. The assessors give actual
training needs before sending people to training examples of the participant’s behavior to back-up
programs, the problems associated with staffing their ratings on each of the dimensions they
WHAT IS AN ASSESSMENT CENTER?

developmental assessment centers often make evaluated. After sharing all their observations,
their use prohibitive, even though assessment the assessors reach consensus on the individual’s
center methodology is the best available diagnos- strengths and weaknesses in each dimension.

7
© Development Dimensions International, Inc., MMII. All rights reserved.
Then, if the purpose of the assessment center is with the assessor. Together, they make a decision
to provide the basis for selection or promotion on the dimension rating for the exercise.
decisions, the assessors make an overall evalua-
At the integration meeting, a computer integrates
tion. If the objective of assessment is to diagnose
all the behavioral observations across exercises
training needs, the assessors’ final step is to
and presents the data in a convenient way for
develop a profile of the assessee’s strengths
assessor analysis and decision making. In some
and developmental needs.
organizations, an expert system substitutes for
All key components of the assessment center the integration meeting. This mathematical data
method are present: multiple job simulations; integration is possible because of the high reliability
use of behavior observed in simulations to predict of the assessor exercise dimensional ratings,
future behavior in the target job; organization of where reliabilities of .90 and higher are common.
observed behavior around job-related dimensions;
The computer prints out a detailed final report
and a systematic data integration session involving
giving dimensional ratings with behavioral exam-
several assessors who have observed participants
ples. The computer system decreases assessor
independently in the simulations. Only the rigidity
time by more than half and dramatically decreases
is removed. This allows even the smallest organi-
assessor and administrator training time.
zation to apply the assessment center method in
making selection/promotion decisions. Use of Outside Assessors

Using Videotape To Record Behavior Because of downsizing, etc., there are fewer
middle managers to act as assessors. Thus,
Another increasingly popular technology is the
more than half of the organizations operating
use of videotape equipment to capture assessee
assessment centers in the United States have
behavior. Rather than having assessors observe
turned to trained outsiders to administer and
individuals in simulations, participant’s behavior
assess candidates.
is recorded on videotape. The tape and the
assessees’ written output then can be sent
virtually anywhere and assessors can view and
CONTACT INFORMATION evaluate the taped and written performance at
their convenience. After each assessor has
WORLD HEADQUARTERS
PITTSBURGH observed and evaluated the assigned simulation,
412.257.0600
a standard data integration session can be held,
EMAIL: INFO@DDIWORLD.COM or the data can be integrated by a computer using
WWW.DDIWORLD.COM/LOCATIONS
an expert system.

Automated Integration of Data

Software programs can expedite the assessment


process, and are therefore advocated by many
assessors and administrators. In a common
system assessors input their observations directly
WHAT IS AN ASSESSMENT CENTER?

into computers. The computer organizes behavior


by dimension and feeds it back to the assessor in
a way that facilitates the rating of each dimension.
The computer, using an expert system, then
checks the rating and if the computer’s rating dif-
fers from that of the assessor, a second assessor
reviews the data and shares his or her insights

8
MKTACAR01-12020MA © Development Dimensions International, Inc., MMII. All rights reserved.

You might also like