Selection Methods and Validity

Introduction

Selection methods and validity are foundational concepts in workforce planning and talent acquisition. Understanding how to assess the effectiveness and fairness of hiring tools is critical for HR professionals preparing for the SPHR exam. This guide explores why these concepts matter, how they function, and strategies for answering related exam questions.

Why Selection Methods and Validity Are Important

In modern HR practice, organizations must:

• Reduce hiring costs by identifying the most predictive assessment tools
• Minimize legal risk by ensuring selection methods don't discriminate against protected groups
• Improve quality of hire by selecting candidates who will perform well on the job
• Enhance employee retention through better job-candidate matching
• Demonstrate fairness to job applicants and stakeholders
• Comply with EEOC guidelines and the Uniform Guidelines on Employee Selection Procedures

Without valid selection methods, organizations risk hiring underperforming employees, facing litigation, and damaging their employer brand.

What Are Selection Methods and Validity?

Selection Methods Defined

Selection methods are tools and procedures used to evaluate job candidates and make hiring decisions. Common methods include:

• Interviews (structured, unstructured, behavioral)
• Written tests (cognitive ability, personality assessments)
• Work samples and simulations
• Background checks
• Reference checks
• Medical exams
• Situational judgment tests

Validity Defined

Validity refers to the extent to which a selection method accurately measures what it is intended to measure and predicts job performance. In other words, does the tool actually work?

Validity answers the question: Does this selection method identify candidates who will succeed in the role?

Types of Validity

1. Content Validity

Definition: The degree to which a selection method measures the knowledge, skills, abilities, and other characteristics (KSAOs) actually needed for the job.

Example: A typing test for a data entry position has content validity because typing speed is essential to job performance.

How it's established: Through job analysis, subject matter expert review, and ensuring test items directly relate to job duties.

2. Criterion-Related Validity

Definition: The degree to which a selection method predicts job performance or other relevant outcomes.

Two subtypes:

• Predictive Validity: Measures the extent to which a selection tool predicts future job performance. The tool is administered before hire, and performance is measured later. This is the gold standard but requires time and effort to establish.
• Concurrent Validity: Measures the extent to which a selection tool correlates with current job performance. The tool is administered to current employees whose performance is already known.

Example: Administering a cognitive ability test to job applicants, then comparing their test scores to their performance reviews six months after hire, demonstrates predictive validity.

3. Construct Validity

Definition: The degree to which a selection method measures the theoretical constructs or psychological traits (like leadership, problem-solving, or teamwork) believed to be important for job success.

Example: An assessment tool designed to measure leadership potential has construct validity if it accurately captures the underlying leadership traits needed for management roles.

How Selection Methods and Validity Work Together

The Selection Process

Organizations follow this process:

1. Conduct job analysis to identify KSAOs
2. Select assessment tools (interviews, tests, etc.)
3. Validate the tools to ensure they measure relevant KSAOs and predict performance
4. Apply the tools consistently to all candidates
5. Track outcomes to monitor effectiveness
6. Update or replace tools as needed based on validation data

The Validity Coefficient

Validity is often expressed as a correlation coefficient ranging from 0.0 to 1.0:

• 0.0 to 0.3: Low validity (weak predictor)
• 0.3 to 0.5: Moderate validity (reasonable predictor)
• 0.5 and above: High validity (strong predictor)

For example, research shows that structured interviews typically have a validity coefficient of 0.5-0.6, while unstructured interviews have lower validity around 0.2-0.3.

Legal and Regulatory Considerations

The Uniform Guidelines on Employee Selection Procedures

The Uniform Guidelines, endorsed by the EEOC, OFCCP, DOJ, and EEOC, require:

• Validity evidence for any selection procedure that has adverse impact on protected groups
• Documentation of validation studies
• Fairness across demographic groups
• Regular review and updating of selection procedures

Adverse Impact

Adverse impact occurs when a selection method eliminates protected group members at a higher rate than other candidates. The four-fifths rule is used: if a selection method's acceptance rate for one group is less than 80% of the acceptance rate for another group, adverse impact is presumed.

When adverse impact is identified, the organization must provide validity evidence or modify the selection method.

Common Selection Methods and Their Validity

How to Answer Exam Questions on Selection Methods and Validity

Question Type 1: Definition and Concept Questions

Question Example: "Which of the following best defines criterion-related validity?"

Strategy:

• Remember the core definition: validity measures whether a selection method predicts job performance
• Distinguish between the three types: content (measures relevant KSAOs), criterion-related (predicts job performance), construct (measures underlying traits)
• Use the question context to identify which type is being asked about

Sample Answer: "Criterion-related validity is the degree to which a selection method correlates with job performance or outcomes. It answers whether the assessment tool successfully predicts who will perform well in the role."

Question Type 2: Scenario and Application Questions

Question Example: "An organization is developing a selection method for a customer service role. Which of the following would provide the strongest evidence of validity?"

Strategy:

• Identify the job duties and required KSAOs from the scenario
• Match selection methods to those KSAOs
• Consider which method would best predict job performance
• Evaluate the validity research: work samples and structured interviews typically have the highest validity

Sample Answer: "A structured interview focused on customer service scenarios combined with a work sample (e.g., responding to customer inquiries) would provide strong evidence of validity because both methods directly measure KSAOs essential to the role and have been shown to predict customer service performance."

Question Type 3: Legal Compliance and Adverse Impact Questions

Question Example: "A cognitive ability test eliminates 40% of minority candidates but only 25% of non-minority candidates. What should the organization do?"

Strategy:

• Calculate or identify adverse impact (using the four-fifths rule)
• Understand the organization's obligations under the Uniform Guidelines
• Recognize that the organization must either provide validity evidence or discontinue the test
• Consider alternative methods that might reduce adverse impact

Sample Answer: "The organization has identified adverse impact (40% elimination rate vs. 25% is below the four-fifths threshold). Under the Uniform Guidelines, the organization must provide strong validity evidence showing the test is job-related. If validity cannot be demonstrated, the organization should consider alternative selection methods with lower adverse impact, such as structured interviews or work samples, or modify the assessment to eliminate bias."

Question Type 4: Validation Study and Evidence Questions

Question Example: "How would you establish the criterion-related validity of a selection method?"

Strategy:

• Distinguish between predictive and concurrent validity approaches
• Describe the steps: administer the selection tool, measure job performance, calculate correlation
• Recognize practical considerations (time, cost, sample size)

Sample Answer: "To establish criterion-related validity through a predictive approach, administer the selection method to all job applicants, hire candidates based on normal selection criteria, and measure their job performance after six months to one year. Calculate the correlation between assessment scores and performance ratings. A correlation of 0.5 or higher indicates good validity. Alternatively, use concurrent validity by administering the assessment to current high and low performers and comparing their scores."

Exam Tips: Answering Questions on Selection Methods and Validity

Tip 1: Memorize the Three Types of Validity

• Content Validity: "Measures what it should measure" (KSAOs)
• Criterion-Related Validity: "Predicts job performance" (predictive or concurrent)
• Construct Validity: "Measures underlying psychological traits"

Create a mental image or mnemonic to remember these distinctions.

Tip 2: Know the Validity Hierarchy

When questions ask which method is "most valid," remember this rough hierarchy:

1. Assessment centers and work samples (0.6-0.7)
2. Structured interviews and cognitive ability tests (0.5-0.6)
3. Personality tests (0.2-0.4)
4. Unstructured interviews and reference checks (0.2-0.3)

Tip 3: Link Selection Methods to Job Analysis

Always connect selection methods to job analysis and KSAOs. Questions often test whether you understand that valid selection methods directly measure job-related competencies.

Tip 4: Understand Adverse Impact and the Four-Fifths Rule

Practice calculating or identifying adverse impact:

• If Group A has an 80% selection rate and Group B has 60%, adverse impact exists (60/80 = 0.75, which is below 0.80)
• Know the organization's burden: provide validity evidence or change the method
• Recognize that even a valid test might require modification if it creates adverse impact

Tip 5: Distinguish Between Validity and Reliability

• Validity: Does it measure what it should? (effectiveness)
• Reliability: Does it measure consistently? (consistency)

A test can be reliable but not valid. For example, a test might consistently measure height, but height may not be valid for predicting job performance.

Tip 6: Apply the Uniform Guidelines

When exam questions involve adverse impact or legal compliance:

• Reference the Uniform Guidelines on Employee Selection Procedures
• Remember that organizations must validate any selection method that has adverse impact
• Know that validation can take time and resources, so organizations should use well-researched methods when possible

Tip 7: Use Practical Examples

To answer scenario questions effectively:

• Imagine yourself implementing the selection method
• Consider: "Does this actually measure job success?"
• Think about potential biases or fairness issues
• Example: A physical fitness test for a desk job would lack content validity and likely create adverse impact

Tip 8: Recognize the Role of Job Analysis

Remember that job analysis is the foundation for valid selection:

• Job analysis identifies KSAOs
• Selection methods are chosen to measure those KSAOs
• Validity is demonstrated by showing the method measures job-relevant factors

Questions often test whether you connect these dots.

Tip 9: Answer Strategic Thinking Questions

Some questions ask what should be done, not just what can be done:

• Best practice: Use multiple selection methods to reduce bias
• Best practice: Validate selection methods regularly
• Best practice: Train interviewers to conduct structured interviews
• Best practice: Monitor selection data for adverse impact

Tip 10: Study Real-World Validation Examples

Familiarize yourself with published validity research on common selection methods:

• Research shows structured interviews are more valid than unstructured interviews
• Cognitive ability tests predict performance across many job types
• Work samples have high validity but are expensive to develop
• Personality tests vary in validity depending on the trait and job

Understanding these real-world findings helps you answer application questions.

Practice Question Examples

Question 1:

"An HR department administers a new assessment to entry-level accountants and tracks their job performance evaluations two years later. The correlation between assessment scores and performance ratings is 0.55. This demonstrates which type of validity?"

Answer: Predictive validity. The assessment was given before employment, and job performance was measured later, establishing that the assessment predicts future success.

Question 2:

"A selection method for a software developer role requires candidates to code a sample program within two hours. This method most directly demonstrates which type of validity?"

Answer: Content validity. The work sample directly measures the key skill (coding) required for the job, ensuring the method assesses job-relevant competencies.

Question 3:

"Your organization's new screening test eliminates 50% of women applicants but only 30% of men applicants. What is the first step you should take?"

Answer: Conduct a validity study to determine if the test is job-related and predicts job performance. If valid, analyze whether the test can be modified to reduce adverse impact while maintaining predictive power. If not valid, discontinue or modify the test to comply with the Uniform Guidelines.

Conclusion

Understanding selection methods and validity is essential for SPHR exam success and effective HR practice. Remember that valid selection methods improve hiring quality, reduce legal risk, and promote fairness. By mastering the three types of validity, memorizing validity research, understanding adverse impact, and applying the Uniform Guidelines, you'll be well-prepared to answer exam questions and lead effective talent acquisition initiatives in your organization.

Key Takeaway: Valid selection methods are the bridge between job analysis and successful hiring decisions. They ensure you're measuring what matters and predicting who will succeed.