How many judges should there be in a group?

Thomas Saaty
Joseph M. Katz Graduate School of Business
University of Pittsburgh
United States
Mujgan Sagir Ozdemir
Eskisehir Osmangazi University
Industrial Engineering

Publication date: Dec, 2014

Journal: Annals of Data Science
Vol.: 1- Issue: 43163- Pages: 359-368

Abstract: This paper briefly examines the question of how many judges are needed to obtain valid and consistent judgments when using the analytic hierarchy process. It turns out that if a judge is experienced and well versed in an area, he can be sufficient to provide the judgments instead of diluting his accuracy with the participation of others who may not be as good. How to discover such a person requires criteria used to judge his adequacy and that of others.

Keywords: Analytic Hierarchy Process, Social choice function, Level hierarchy, Aggregation, Group order, AHP, Group decision making