The Angoff Method and Rater Analysis: Enhancing Cutoff Score Reliability and Accuracy

• Main Author: Baker, Charles E., 1957-
• Other Authors: Johnson, Douglas A.
• Format: Others
• Language: English
• Published: University of North Texas 1993
• Subjects: cutting score methodology; Angoff method; cutting scores; Employment tests > Texas > Fort Worth > Evaluation.
• Online Access: https://digital.library.unt.edu/ark:/67531/metadc500345/

At times called a philosophy and other times called a process, cutting score methodology is an issue routinely encountered by Industrial/Organizational (I/0) psychologists. Published literature on cutting score methodology appears much more frequently in academic settings than it does in personnel settings where the potential for lawsuits typically occurs more often. With the passage of the 1991 Civil Rights Act, it is no longer legal to use within-group scoring. It has now become necessary for personnel psychologists to develop more acceptable selection methods that fall within established guidelines. Designating cutoff scores with the Angoff method appears to suit many requirements of personnel departments. Several procedures have evolved that suggest enhancing the accuracy and reliability of the Angoff method is possible. The current experiment investigated several such procedures, and found that rater accuracy methods significantly enhance cutoff score reliability and accuracy.