Constructing and Validating a Performance Evaluation System for Highly Qualified Specialists: A Mixed-Methods Approach Based on Rough Set Theory and Analytic Hierarchy Process

Sumei Zhuang

doi:10.62051/ajmse.v1n2.17

Authors

Sumei Zhuang Graduate University of Mongolia, Ulaanbaatar, 999097, Mongolia

DOI:

https://doi.org/10.62051/ajmse.v1n2.17

Keywords:

Performance Evaluation System, Highly Qualified Specialists, Rough Set Theory, Analytic Hierarchy Process, Confirmatory Factor Analysis, Chinese Enterprises

Abstract

The effective performance evaluation of highly qualified specialists (HQS) remains a persistent challenge for Chinese enterprises transitioning to knowledge-intensive operations. Traditional evaluation systems, designed for routine work, fail to capture the multidimensional nature of HQS contributions, which encompass cognitive engagement, value congruence, and affective attachment. This study addresses this gap by developing and validating a comprehensive performance evaluation system specifically tailored to HQS. Using a mixed-methods design, the study first identified 22 candidate indicators through literature review and expert interviews. Rough set theory was then applied to reduce redundant indicators, yielding a parsimonious 17-indicator system organized across four dimensions: work engagement (5 indicators), organizational identification (4 indicators), value identification (4 indicators), and emotional belonging (4 indicators). Analytic Hierarchy Process (AHP) was subsequently employed to determine indicator weights, revealing that value identification (weight = 0.4564) and emotional belonging (weight = 0.2219) are the most influential criterion-level dimensions. At the indicator level, company culture (0.1896) and management systems (0.1336) emerged as the most heavily weighted individual measures. Confirmatory factor analysis (CFA) of survey data from 562 HQS in Chinese enterprises demonstrated good model fit (χ²/df = 2.462, GFI = 0.940, CFI = 0.939, RMSEA = 0.051), providing empirical validation of the proposed system. This study contributes a theoretically grounded, empirically validated, and practically operational evaluation system that enables Chinese enterprises to assess HQS performance more comprehensively and systematically.

Downloads

Download data is not yet available.

References

[1] Drucker, P. F. (1959). Landmarks of Tomorrow: A Report on the New "Post-Modern" World. Harper & Row.

[2] Davenport, T. H. (2002). Thinking for a Living: How to Get Better Performance and Results from Knowledge Workers. Harvard Business School Press.

[3] Zhuang, S. M. (2026). Optimizing the Performance Evaluation System for Highly Qualified Specialists in Chinese Enterprises [Doctoral dissertation, Graduate University of Mongolia].

[4] Meyer, J. P., & Allen, N. J. (1991). A three-component conceptualization of organizational commitment. Human Resource Management Review, 1(1), 61–89.

[5] Campbell, J. P. (1990). Modeling the performance prediction problem in industrial and organizational psychology. In M. D. Dunnette & L. M. Hough (Eds.), Handbook of Industrial and Organizational Psychology (2nd ed., Vol. 1, pp. 687–732). Consulting Psychologists Press.

[6] Schaufeli, W. B., Salanova, M., González-Romá, V., & Bakker, A. B. (2002). The measurement of engagement and burnout: A confirmative analytic approach. Journal of Happiness Studies, 3(1), 71–92.

[7] Ashforth, B. E., & Mael, F. (1989). Social identity theory and the organization. Academy of Management Review, 14(1), 20–39.

[8] Ryan, R. M., & Deci, E. L. (2000). Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being. American Psychologist, 55(1), 68–78.