- What practices are used in the performance appraisal process?
Organizations use numerous methods to evaluate personnel. We will summarize several popular techniques. Although countless variations on these themes can be found, the basic methods presented provide a good summary of the commonly available techniques. Following this review, we will consider the various strengths and weaknesses of each technique. Six techniques are reviewed here: (1) graphic rating scales, (2) critical incident technique, (3) behaviorally anchored rating scales, (4) behavioral observation scales, (5) management by objectives, and (6) assessment centers.
Graphic Rating Scales
Certainly, the most popular method of evaluation used in organizations today is the graphic rating scale. One study found that 57 percent of the organizations surveyed used rating scales, and another study found the figure to be 65 percent.5 Although this method appears in many formats, the supervisor or rater is typically presented with a printed or online form that contains both the employee’s name and several evaluation dimensions (quantity of work, quality of work, knowledge of job, attendance). The rater is then asked to rate the employee by assigning a number or rating on each of the dimensions. An example of a graphic rating scale is shown in Table 8.1.
|A Sample of a Typical Graphic Rating Scale|
|Name ________________Dept. ______________Date _______________|
|Quantity of work||Outstanding||Good||Satisfactory||Fair||Unsatisfactory|
|Volume of acceptable work under normal conditions|
|Quality of work||Outstanding||Good||Satisfactory||Fair||Unsatisfactory|
|Thoroughness, neatness, and accuracy of work|
|Knowledge of job||Outstanding||Good||Satisfactory||Fair||Unsatisfactory|
|Clear understanding of the facts or factors pertinent to the job|
|Personality, appearance, sociability, leadership, integrity|
|Ability and willingness to work with associates, supervisors, and subordinates toward common goal|
|Conscientious, thorough, accurate, reliable with respect to attendance, lunch periods, reliefs, etc.|
|Earnestness in seeking increased responsibilities Self-starting, unafraid to proceed alone|
By using this method, if we assume that evaluator biases can be minimized, it is possible to compare employees objectively. It is also possible to examine the relative strengths and weaknesses of a single employee by comparing scores on the various dimensions.
However, one of the most serious drawbacks of this technique is its openness to central tendency, strictness, and leniency errors. It is possible to rate almost everyone in the middle of the scale or, conversely, at one end of the scale. In order to control for this, some companies have assigned required percentage distributions to the various scale points. Supervisors may be allowed to rate only 10 percent of their people outstanding and are required to rate 10 percent unsatisfactory, perhaps assigning 20 percent, 40 percent, and 20 percent to the remaining middle categories. By doing this, a distribution is forced within each department. However, this procedure may penalize a group of truly outstanding performers or reward a group of poor ones.
Critical Incident Technique
With the critical incident technique of performance appraisal, supervisors record incidents, or examples, of each subordinate’s behavior that led to either unusual success or unusual failure on some aspect of the job. These incidents are recorded in a daily or weekly log under predesignated categories (planning, decision-making, interpersonal relations, report writing). The final performance rating consists of a series of descriptive paragraphs or notes about various aspects of an employee’s performance (see Table 8.2).
|An Example of Critical Incident Evaluation|
|Source: Adapted from R. Daft and R. Steers, Organizations: A Micro/Macro Approach (Glenview, III.: Scott, Foresman and Company, 1986), p. 129.|
The following performance areas are designed to assist you in preparing this appraisal and in discussing an individual’s performance with her. It is suggested that areas of performance that you feel are significantly good or poor be documented below with specific examples or actions. The points listed are suggested as typical and are by no means all-inclusive. Examples related to these points may be viewed from either a positive or negative standpoint.
The critical incident method provides useful information for appraisal interviews, and managers and subordinates can discuss specific incidents. Good qualitative information is generated. However, because little quantitative data emerge, it is difficult to use this technique for promotion or salary decisions. The qualitative output here has led some companies to combine the critical incident technique with one of the quantitative techniques, such as the rating scale, to provide different kinds of feedback to the employees.
Behaviorally Anchored Rating Scales
An appraisal system that has received increasing attention in recent years is the behaviorally anchored rating scale (BARS). This system requires considerable work prior to evaluation but, if the work is carefully done, can lead to highly accurate ratings with high inter-rater reliability. Specifically, the BARS technique begins by selecting a job that can be described in observable behaviors. Managers and personnel specialists then identify these behaviors as they relate to superior or inferior performance.
An example of this is shown in Exhibit 8.4, where the BARS technique has been applied to the job of college professor. As shown, as one moves from extremely poor performance to extremely good performance, the performance descriptions, or behavioral anchors, increase. Oftentimes, six to ten scales are used to describe performance on the job. Exhibit 8.4 evaluates the professor’s organizational skills. Other scales could relate to the professor’s teaching effectiveness, knowledge of the material, availability to students, and fairness in grading. Once these scales are determined, the evaluator has only to check the category that describes what she observes on the job, and the employee’s rating is simultaneously determined. The BARS technique has several purported advantages. In particular, many of the sources of error discussed earlier (central tendency, leniency, halo) should be significantly reduced because raters are considering verbal descriptions of specific behaviors instead of general categories of behaviors, such as those used in graphic rating scales. In addition, the technique focuses on job-related behaviors and ignores less relevant issues such as the subordinate’s personality, race, or gender. This technique should also lead to employees being less defensive during performance appraisals, because the focus of the discussion would be actual measured behaviors, not the person. Finally, BARS can aid in employee training and development by identifying those domains needing most attention.
On the negative side, as noted above, considerable time and effort in designing the forms are required before the actual rating. Because a separate BARS is required for each distinct job, it is only cost-efficient for common jobs. Finally, because the technique relies on observable behaviors, it may have little applicability for such jobs in such areas as research science (and sometimes management), where much of the work is mental and relevant observable behaviors are difficult to obtain.
Behavioral Observation Scales
The behavioral observation scale (BOS) is similar to BARS in that both focus on identifying observable behaviors as they relate to performance. It is, however, less demanding of the evaluator. Typically, the evaluator is asked to rate each behavior on a scale from 1 to 5 to indicate the frequency with which the employee exhibits the behavior. Evaluation of an employee’s performance on a particular dimension is derived by summing the frequency ratings for the behaviors in each dimension.
For example, in Table 8.3 we can see an example of a form to evaluate a manager’s ability to overcome resistance to change. The rater simply has to circle the appropriate numbers describing observed behaviors and get a summary rating by adding the results. The BOS technique is easier to construct than the BARS and makes the evaluator’s job somewhat simpler. Even so, this is a relatively new technique that is only now receiving some support in industry.
|Example of a Behavioral Observation Scale for Managers: Overcoming Resistance to Change|
|Almost Never||Almost Always|
|Source: Adapted from K. Wexley and G. Latham, Increasing Productivity Through Performance Appraisal, 3rd ed. Englewood Cliffs, NJ: Prentice Hall, 2001.|
|1. Describes the details of the change to subordinates||1||2||3||4||5|
|2. Explains why the change is necessary||1||2||3||4||5|
|3. Discusses how the change will affect the employee||1||2||3||4||5|
|4. Listens to the employee’s concerns||1||2||3||4||5|
|5. Asks the employee for help in making the change work||1||2||3||4||5|
|6. If necessary, specifies the date for a follow-up meeting to respond to employee’s concerns||1||2||3||4||5|
Management by Objectives
A popular technique for evaluating employees who are involved in jobs that have clear quantitative output is management by objectives (MBO). Although the concept of MBO encompasses much more than just the appraisal process (incorporating an organization-wide motivation, performance, and control system), we will focus here on its narrower application to evaluating employee performance. MBO is closely related to the goal-setting theory of motivation.
Under MBO, individual employees work with their supervisor to establish goals and objectives for which they will be responsible during the coming year. These goals are stated in clear language and relate to tasks that are within the domain of the employee. An example of these goals for a sales representative is shown in Table 8.4. Following a specified period of time, the employee’s performance is compared to the preset goals to determine the extent to which the goals have been met or exceeded.
|MBO Evaluation Report for Sales Representative|
|Goals Categories||Goal||Actual Performance||Variance|
|1. Number of sales calls||40||38||95%|
|2. Number of new customers contacted||10||10||100%|
|3. Number of customer complaints||5||10||50%|
|4. Sales of product #1||10,000 units||11,000 units||110%|
|5. Sales of product #2||15,000 units||14,000 units||93%|
|6. Sales of product #3||25,000 units||30,000 units||120%|
Several advantages of MBO have been observed. These include the ability to do better planning; improved motivation, because of knowledge of results; fairer evaluations, done on the basis of results rather than personality; improved commitment through participation; and improved supervisory skills in such areas as listening, counseling, and evaluating. On the negative side, however, MBO has been criticized because it emphasizes quantitative goals at the expense of qualitative goals and often creates too much paperwork. It is difficult to compare performance levels among employees because most are responsible for different goals. Sometimes the implementation of MBO goals are autocratic and therefore ineffective or even counterproductive. As discussed in the study of motivation, goals must be accepted to be effective. Finally, in order to be successful, MBO implementation must have constant attention and support from top management; MBO does not run itself. In the absence of this support, the technique loses legitimacy and often falls into disrepair.
A relatively new method of evaluation is the assessment center. Assessment centers are unique among appraisal techniques in that they focus more on evaluating an employee’s long-range potential to an organization than on her performance over the past year. They are also unique in that they are used almost exclusively among managerial personnel.
An assessment center consists of a series of standardized evaluations of behavior based on multiple inputs. Over a two- or three-day period (away from the job), trained observers make judgments on managers’ behavior in response to specially developed exercises. These exercises may consist of in-basket exercises, role-playing, and case analyses, as well as personal interviews and psychological tests. An example of an assessment center program is shown in Table 8.5.
|Example of Two-Day Assessment Center Schedule|
|Day #1||Day #2|
|8:00–9:00 A.M.||Orientation session||8:00–10:30 A.M.||In-basket exercise|
|9:00 –10:30 A.M.||Psychological testing||10:30–10:45 A.M.||Coffee break|
|10:30–10:45 A.M.||Coffee break||10:45–12:30 P.M.||Role-playing exercise|
|10:45–12:30 P.M.||Management simulation game||12:30–1:30 P.M.||Lunch|
|12:30–1:30 P.M.||Lunch||1:30–3:15 P.M.||Group problem-solving exercise|
|1:30–3:15 P.M.||Individual decision-making exercise||3:15–3:30 P.M.||Coffee break|
|3:15–3:30 P.M.||Coffee break||3:30–4:30 P.M.||Debriefing by raters|
|3:30–4:30 P.M.||Interview with raters|
On the basis of these exercises, the trained observers make judgments on employees’ potential for future managerial assignments in the organization. More specifically, information is obtained concerning employees’ interpersonal skills, communication ability, creativity, problem-solving skills, tolerance for stress and ambiguity, and planning ability. This technique has been used successfully by some of the largest corporations in the United States, including AT&T, IBM, and General Electric.
Results from a series of assessment center programs appear promising, and the technique is growing in popularity as a means of identifying future managerial potential. For example, Coca-Cola USA experimented with using assessment centers to select its managerial personnel. After a detailed study, the company found that those selected in this way were only one-third as likely to leave the company or be fired than those selected in the traditional way. Although the assessment center approach added about 6 percent to the cost of hiring, the lower turnover rate led to large overall savings.6
Some problems with the technique have been noted. In particular, because of the highly stressful environment created in assessment centers, many otherwise good managers may simply not perform to their potential. Moreover, the results of a poor evaluation in an assessment center may be far-reaching; individuals may receive a “loser” image that will follow them for a long time. And, finally, there is some question concerning exactly how valid and reliable assessment centers really are in predicting future managerial success.7 Despite these problems, assessment centers remain a popular vehicle in some companies for developing and appraising managerial potential.
Tesla’s Performance Review
At Tesla, the automotive giant, the standards are set extremely high for their employees. In 2017, Tesla conducted its annual performance reviews as it does each year. Due to the review process, the company sees both voluntary and involuntary departures. During the review process, the managers discuss “results that were achieved, as well as how those results were achieved” with their employees.* Tesla also has a performance recognition and compensation program that includes equity rewards as well as promotions in some cases, along with the constructive feedback.
The departure of employees during the review period is not unique to Tesla; however, in 2017 there was a large exodus of approximately 700 employees following their employee reviews. Elon Musk, who recently has stepped down from the role of chairman and has been under scrutiny for his behavior,* saw the media coverage of this news as “ridiculous.”
“You have two boxes of equal ability, and one’s much smaller, the big guy’s going to crush the little guy, obviously,” states Musk. “So, the little guy better have a heck of a lot more skill or he’s going to get clobbered. So that is why our standards are high . . . if they’re not high, we will die.”
Overall, approximately 17 percent of their employees were promoted, almost half in manufacturing. As Tesla continues to grow and develop new vehicles, it is consistently pushing the boundaries and pushing its employees to new limits. Performance reviews are of the highest importance for Tesla’s business to succeed; the company needs the best people with the best skills. It is constantly growing and attempting to “suck the labor pool dry” to fill positions at many of its locations and factories.
- What factors do you feel could have changed in Tesla’s approach to its performance reviews?
- How can a high-pressure environment affect an employee’s performance? What factors should be considered to combat these issues?
Sources: K. Korosec. “Tesla Fires Hundreds of Workers After Their Annual Performance Review.” Fortune, October 14, 2017, http://fortune.com/2017/10/13/tesla-fires-employees/; D. Muoio. “Tesla fired 700 employees after performance reviews in the third quarter.” Business Insider, November 1, 2017, https://www.businessinsider.com/tesla-fired-700-employees-performance-reviews-2017-11; J. Wattles. “Elon Musk agrees to pay $20 million and quit as Tesla chairman in deal with SEC.” Money, September 30, 2018, https://money.cnn.com/2018/09/29/technology/business/elon-musk-tesla-sec-settlement/index.html.
Comparison of Appraisal Techniques
It is important to consider which appraisal technique or set of techniques may be most appropriate for a given situation. Although there is no simple answer to this question, we can consider the various strengths and weaknesses of each technique. This is done in Table 8.6. It is important to keep in mind that the appropriateness of a particular appraisal technique is in part a function of the purpose for the appraisal. For example, if the purpose of the appraisal is to identify high potential executives, then assessment centers are more appropriate than rating scales.
|Major Strengths and Weaknesses of Appraisal Techniques|
|Rating Scales||Critical Incidents||BARS||BOS||MBO||Assessment Centers|
|Amount of time required||Low||Medium||High||Medium||High||High|
|Potential for rating errors||High||Medium||Low||Low||Low||Low|
|Acceptability to subordinates||Low||Medium||High||High||High||High|
|Acceptability to superiors||Low||Medium||High||High||High||High|
|Usefulness for allocating rewards||Poor||Fair||Good||Good||Good||Fair|
|Usefulness for employee counseling||Poor||Fair||Good||Good||Good||Good|
|Usefulness for identifying promotion potential||Poor||Fair||Fair||Fair||Fair||Good|
As would be expected, the easiest and least expensive techniques are also the least accurate. They are also the least useful for purposes of personnel decisions and employee development. Once again, it appears that managers and organizations get what they pay for. If performance appraisals represent an important aspect of organizational life, clearly the more sophisticated—and more time-consuming—techniques are preferable. If, on the other hand, it is necessary to evaluate employees quickly and with few resources, techniques such as the graphic rating scale may be more appropriate. Managers must make cost-benefit decisions about the price (in time and money) they are willing to pay for a quality performance appraisal system.
- What are the techniques and scales used in performance appraisals?
- What are MBOs, and how do they relate to performance appraisals?
- What are assessment centers?