You are here

FAU Collections » FAU Research Repository » FAU Theses and Dissertations

predictive validity and adverse impact of an assessment center, a multirater appraisal system and top-down appraisal for selecting retail store managers

Download pdf | Full Screen View

Date Issued:
2003
Summary:
This study compares the levels of criterion-related validity and the extent of statistical adverse impact against minorities based on supervisors' top-down (TD) performance appraisals, a multirater appraisal (MRA) system and a traditional assessment center (AC). Data from all three sources were collected as a part of a predictive validity study using criterion data completely independent of the predictor data and where managers who provided criterion data had no knowledge of the predictor scores. The performance of the selected managers was used as the dependent variable. This is the first study in which direct comparisons were made for predictive validity and adverse impact among these three methods of staffing decisions for the same subjects. As hypothesized, the assessment center (uncorrected r = .32) and multirater methods (uncorrected r = .31) had the highest levels of predictive validity. The predictive validity of the top-down managerial assessment was significantly lower than the other two methods, and the correlation with subsequent managerial performance was not statistically significant (uncorrected r = .13). It was also hypothesized that multirater appraisal and assessment centers would result in less adverse impact than top-down appraisal. After examination by several commonly used methods, only partial support was found for these hypotheses. Analyses using the 80% rule and z-scores found that data from the AC and MRA methods did not indicate adverse impact against minorities while TD data resulted in adverse impact. Possible reasons for the discrepant findings of the various methods of analysis and implications for expert witness testimony are discussed.
Title: The predictive validity and adverse impact of an assessment center, a multirater appraisal system and top-down appraisal for selecting retail store managers.
156 views
20 downloads
Name(s): Tyler, Catherine L.
Florida Atlantic University, Degree Grantor
Bernardin, Harold John, Thesis Advisor
Type of Resource: text
Genre: Electronic Thesis Or Dissertation
Issuance: monographic
Date Issued: 2003
Publisher: Florida Atlantic University
Place of Publication: Boca Raton, Fla.
Physical Form: application/pdf
Extent: 145 p.
Language(s): English
Summary: This study compares the levels of criterion-related validity and the extent of statistical adverse impact against minorities based on supervisors' top-down (TD) performance appraisals, a multirater appraisal (MRA) system and a traditional assessment center (AC). Data from all three sources were collected as a part of a predictive validity study using criterion data completely independent of the predictor data and where managers who provided criterion data had no knowledge of the predictor scores. The performance of the selected managers was used as the dependent variable. This is the first study in which direct comparisons were made for predictive validity and adverse impact among these three methods of staffing decisions for the same subjects. As hypothesized, the assessment center (uncorrected r = .32) and multirater methods (uncorrected r = .31) had the highest levels of predictive validity. The predictive validity of the top-down managerial assessment was significantly lower than the other two methods, and the correlation with subsequent managerial performance was not statistically significant (uncorrected r = .13). It was also hypothesized that multirater appraisal and assessment centers would result in less adverse impact than top-down appraisal. After examination by several commonly used methods, only partial support was found for these hypotheses. Analyses using the 80% rule and z-scores found that data from the AC and MRA methods did not indicate adverse impact against minorities while TD data resulted in adverse impact. Possible reasons for the discrepant findings of the various methods of analysis and implications for expert witness testimony are discussed.
Identifier: 9780496426591 (isbn), 12050 (digitool), FADT12050 (IID), fau:8963 (fedora)
Note(s): Thesis (Ph.D.)--Florida Atlantic University, 2003.
Subject(s): Assessment Centers (Personnel Management Procedure)
Employee Selection
Executive Ability--Testing
Held by: Florida Atlantic University Libraries
Persistent Link to This Record: http://purl.flvc.org/fcla/dt/12050
Sublocation: Digital Library
Use and Reproduction: Copyright © is held by the author with permission granted to Florida Atlantic University to digitize, archive and distribute this item for non-profit research and educational purposes. Any reuse of this item in excess of fair use or other copyright exemptions requires permission of the copyright holder.
Use and Reproduction: http://rightsstatements.org/vocab/InC/1.0/
Host Institution: FAU
Is Part of Series: Florida Atlantic University Digital Library Collections.