Ranking and Rating Scales in Performance Management – A Comprehensive Guide for aPHR Exam Preparation
Why Ranking and Rating Scales Matter in Performance Management
Ranking and rating scales are among the most widely used tools in performance appraisal systems. For HR professionals—and for anyone preparing for the aPHR certification exam—understanding these methods is essential because they form the backbone of how organizations evaluate, compare, and develop their employees. These tools directly influence compensation decisions, promotions, training needs analysis, succession planning, and legal defensibility of employment decisions. A poorly designed rating or ranking system can lead to bias, legal challenges, and employee disengagement, which is why HR must understand both the strengths and limitations of each approach.
What Are Ranking and Rating Scales?
At the broadest level, performance appraisal methods can be divided into two categories: ranking methods (which compare employees against each other) and rating methods (which evaluate each employee against a set standard or criteria). Let's explore each in detail.
1. Ranking Methods
Ranking methods involve ordering employees from best to worst based on overall performance or specific criteria. These are relative comparison methods because an employee's evaluation depends on how they compare to their peers rather than against an absolute standard.
a) Simple (Straight) Ranking
The supervisor lists all employees in order from highest performer to lowest performer. This is the most basic method. It is easy to understand but becomes impractical with large groups and provides no detail about why one employee ranks higher than another.
b) Alternation Ranking
The evaluator first selects the best employee, then the worst, then the second best, then the second worst, and so on, alternating until all employees are ranked. This makes it easier to identify extremes and works inward to the middle, reducing difficulty in differentiating among average performers.
c) Paired Comparison
Every employee is compared one-on-one with every other employee. The employee who is judged better in each pair receives a point. After all comparisons are made, employees are ranked by total points. The formula for the number of comparisons needed is: n(n-1)/2, where n equals the number of employees. For example, with 10 employees, you would need 45 comparisons. This method becomes very time-consuming with larger groups.
d) Forced Distribution (Forced Ranking / Vitality Curve)
Employees are sorted into predetermined performance categories following a fixed distribution—for example, 10% outstanding, 20% above average, 40% average, 20% below average, and 10% poor. This method was famously used by General Electric under Jack Welch (the "rank and yank" system). It prevents leniency bias and central tendency but can be controversial because it forces managers to label a set percentage as low performers even if all employees are performing well.
Key Characteristics of Ranking Methods:
- They are comparative (relative) in nature
- They are simple and inexpensive to implement
- They do not provide detailed feedback about specific performance dimensions
- They can be difficult to defend legally because they lack objective criteria
- They become cumbersome as the number of employees increases
- They may foster unhealthy competition among employees
2. Rating Scale Methods
Rating methods evaluate each employee independently against defined criteria or standards. These are absolute methods because the evaluation does not depend on how other employees perform.
a) Graphic Rating Scale
This is the most common and oldest form of performance appraisal. The evaluator rates employees on various traits or behaviors (e.g., quality of work, dependability, initiative, communication) using a numerical scale, typically ranging from 1 to 5 or 1 to 7. Each point on the scale may have a descriptor (e.g., 1 = Unsatisfactory, 3 = Meets Expectations, 5 = Outstanding).
Advantages: Easy to develop, administer, and quantify; allows comparison across employees using numerical scores; covers multiple dimensions of performance.
Disadvantages: Highly susceptible to rater biases (halo effect, leniency, central tendency, recency bias); trait definitions may be vague or interpreted differently by different raters.
b) Behaviorally Anchored Rating Scale (BARS)
BARS combines elements of the critical incident method and graphic rating scales. Each performance dimension is anchored by specific behavioral examples at various points along the scale. For instance, for "customer service," a 5 might be anchored with "Proactively follows up with customers within 24 hours to ensure satisfaction," while a 1 might be "Ignores customer complaints and fails to return calls."
Advantages: Reduces ambiguity by providing concrete behavioral examples; improves inter-rater reliability; is more legally defensible; provides clearer feedback to employees.
Disadvantages: Time-consuming and expensive to develop because each job requires its own set of behavioral anchors; requires significant job analysis and input from subject matter experts.
c) Behavioral Observation Scale (BOS)
Similar to BARS but instead of anchoring with specific examples, BOS asks raters to indicate the frequency with which an employee exhibits specific behaviors (e.g., "Almost Never" to "Almost Always"). This is based on the critical incident technique and focuses on observable, measurable behaviors.
Advantages: Focuses on actual observed behavior rather than subjective traits; provides quantitative data; reduces some rater biases.
Disadvantages: Also time-consuming to develop; may result in lengthy evaluation forms.
d) Mixed Standard Scale
This method presents evaluators with sets of three statements per dimension: one representing good performance, one average, and one poor. The statements are mixed randomly on the form, and the rater indicates whether the employee's performance is better than, equal to, or worse than each statement. This design helps detect inconsistent ratings.
e) Management by Objectives (MBO)
Although MBO is more of a goal-setting approach, it functions as a rating method because employees are evaluated against specific, measurable objectives they helped set. Performance is rated based on whether goals were met, exceeded, or not achieved.
Advantages: Highly objective; employees have buy-in because they participate in goal setting; clearly linked to organizational objectives.
Disadvantages: Focuses primarily on results, potentially ignoring important behaviors; may encourage short-term thinking; goals may become outdated if business conditions change.
Key Characteristics of Rating Methods:
- They are absolute (non-comparative) in nature
- They evaluate each employee independently against a standard
- They provide more detailed, dimension-specific feedback
- They are generally more legally defensible (especially BARS and BOS)
- They can be affected by various rater errors and biases
Common Rater Errors to Understand
Both ranking and rating methods are subject to errors, but rating scales are particularly vulnerable:
- Halo Effect: One positive trait influences the evaluation of all other traits
- Horn Effect: One negative trait influences the evaluation of all other traits
- Central Tendency: The rater avoids extremes and rates everyone as average
- Leniency Bias: The rater gives everyone high ratings regardless of actual performance
- Strictness Bias: The rater gives everyone low ratings regardless of actual performance
- Recency Bias: The rater focuses on the most recent behavior rather than the entire evaluation period
- Contrast Effect: An employee's rating is influenced by the ratings of previously evaluated employees
- Similar-to-Me Bias: The rater gives higher ratings to employees who share similar characteristics
Forced distribution ranking was specifically designed to counteract leniency and central tendency biases.
How Ranking and Rating Scales Work in Practice
In most organizations, the performance management process follows these steps:
1. Job Analysis: Identify the key duties, responsibilities, and competencies for each role
2. Selection of Method: HR selects the appropriate appraisal tool(s) based on organizational needs, size, resources, and culture
3. Rater Training: Supervisors are trained on how to use the selected tool, recognize biases, and provide constructive feedback
4. Evaluation Period: Managers observe and document employee performance throughout the review cycle
5. Appraisal Meeting: The manager and employee discuss the evaluation, provide feedback, and set goals for the next period
6. Administrative Decisions: Results inform compensation adjustments, promotions, training plans, or corrective action
Organizations often combine methods—for example, using a graphic rating scale for individual evaluation and forced distribution for calibrating results across departments to ensure consistency.
Comparing Ranking vs. Rating Methods: A Quick Reference
Ranking Methods:
- Compare employees to each other (relative)
- Best for small groups
- Simple and quick
- Limited feedback value
- Lower legal defensibility
- Prevent leniency/central tendency (especially forced distribution)
Rating Methods:
- Compare employees to standards (absolute)
- Scalable to large groups
- More detailed feedback
- Can be affected by multiple rater biases
- Higher legal defensibility (especially BARS)
- More useful for employee development
Exam Tips: Answering Questions on Ranking and Rating Scales in Performance Management
Tip 1: Know the Classification
The most fundamental distinction the aPHR exam tests is whether a method is comparative (ranking) or absolute (rating). If a question describes employees being compared to each other, it's ranking. If employees are measured against a standard or scale, it's rating. Memorize which methods fall into each category.
Tip 2: Recognize Methods from Descriptions
Exam questions often describe a scenario rather than naming the method. For example: "A manager compares each employee to every other employee in pairs" = Paired Comparison. "Employees are rated on a 1-5 scale for traits like dependability and quality of work" = Graphic Rating Scale. "Each point on the scale includes a specific behavioral example" = BARS. Practice identifying methods from their descriptions.
Tip 3: Understand Advantages and Disadvantages
Many questions ask which method is best for a given situation or what the primary advantage/disadvantage of a method is. Key associations to memorize:
- Graphic Rating Scale = most common, simplest, but most prone to bias
- BARS = most legally defensible rating method, reduces ambiguity, but expensive/time-consuming to develop
- Forced Distribution = prevents leniency, but can be seen as unfair and demotivating
- Paired Comparison = most thorough ranking method, but impractical for large groups
- MBO = most objective and participative, but focuses on results over behaviors
Tip 4: Connect Methods to Rater Errors
If a question asks which method best reduces a specific rater error, remember:
- Forced distribution reduces leniency and central tendency
- BARS reduces halo/horn effect and ambiguity
- Rater training reduces all biases but does not eliminate them
- BOS reduces subjectivity by focusing on observable behavior frequency
Tip 5: Think About Legal Defensibility
Questions about legal challenges to performance appraisals often involve discrimination claims. Methods that are more job-related, based on observable behaviors, documented, and consistently applied are more legally defensible. BARS and BOS tend to be the most defensible. Simple ranking and graphic rating scales are the least defensible because they can be vague and subjective.
Tip 6: Watch for Keyword Triggers
- "Predetermined percentages" or "bell curve" = Forced Distribution
- "Behavioral examples at each scale point" = BARS
- "Frequency of observed behaviors" = BOS
- "Best to worst" or "top to bottom" = Simple/Straight Ranking
- "Best, then worst, then second best" = Alternation Ranking
- "Each compared to every other" = Paired Comparison
- "Goals and objectives mutually set" = MBO
- "Traits on a numerical scale" = Graphic Rating Scale
Tip 7: Eliminate Wrong Answers Strategically
If you're unsure, eliminate options that don't match the comparative/absolute nature of the scenario. If the question is about development feedback, eliminate ranking methods (they don't provide detailed feedback). If the question is about preventing inflated ratings, look for forced distribution or calibration methods.
Tip 8: Remember the Practical Limitations
The aPHR exam may test practical considerations:
- Ranking methods become impractical with large numbers of employees
- Paired comparison requires n(n-1)/2 comparisons (know this formula)
- BARS requires separate development for each job family
- Forced distribution can damage morale in high-performing teams
- MBO may not capture how results were achieved (behaviors and ethics)
Tip 9: Connect to the Bigger Picture
Performance appraisal methods don't exist in isolation. Be prepared for questions that connect these tools to broader HR functions: compensation (merit pay tied to ratings), training and development (identifying skill gaps through rating dimensions), employee relations (handling disputes over forced ranking outcomes), and legal compliance (ensuring appraisals don't have adverse impact on protected groups).
Tip 10: Practice with Scenario-Based Questions
The aPHR exam emphasizes application over memorization. Practice questions that present a workplace scenario and ask you to recommend the best appraisal method or identify potential problems with a current system. Always consider the organization's size, resources, goals, and the specific problem being addressed when selecting your answer.
Final Summary
Ranking and rating scales are foundational tools in performance management. Ranking methods (simple ranking, alternation ranking, paired comparison, and forced distribution) compare employees against each other and are best for simple, quick evaluations in small groups. Rating methods (graphic rating scale, BARS, BOS, mixed standard scales, and MBO) measure employees against defined standards and provide richer, more actionable feedback. For the aPHR exam, focus on distinguishing between these categories, understanding each method's unique characteristics, knowing their strengths and weaknesses, and being able to apply this knowledge to realistic HR scenarios. Mastering these concepts will not only help you pass the exam but also prepare you for effective HR practice.
