Psychological Development and Education ›› 2016, Vol. 32 ›› Issue (1): 121-128.doi: 10.16187/j.cnki.issn1001-4918.2016.01.16

Previous Articles    

A Reliability Generalization of the Big-Five Factor Personality Tests in China

LUO Jie1,2, ZHOU Yuan1,2, CHEN Wei1,2, PAN Yun1,2, ZHAO Shouying1,2   

  1. 1. School of Educational Science, Guizhou Normal University, Guiyang 550001;
    2. Guizhou General Colleges Key Laboratory of Fundamental Psychology and Cognitive Neuroscience, Guiyang 550001
  • Online:2016-01-15 Published:2016-01-15

PDF (PC)

Abstract: In this paper, we attempted to analysis the reliability generalization on studies of the Big-Five factor personality tests during the last 20 years (1994~2013) in China. The results showed that:(1) Among all studies, 68.15% caused reliability induction phenomenon. (2) In the unweighted estimating, the lowest reliability coefficient was found for the Agreeableness and Openness, whereas the highest was found for the Neuroticism and Conscientiousness. What's more, the reliabilities from Chinese researchers were less than Western counterparts, except the Openness. And the latter had higher variance, except the Extraversion. With the meta-analysis of coefficient alpha, the coefficient alpha of Neuroticism was the highest, whereas Agreeableness and Openness were the lowest, in the random effects model. (3) The result of multivariate regression analysis indicated that sample characteristics such as the mean of scores, regional differences between the south and the north, inventory origin had predictive functions on the reliability for Neuroticism; inventory origin, paper types, testing version, and testing pointing were the main predictor variable for the reliability for Extraversion; sample size, paper types, and inventory origin had predictive functions on the reliability for Openness; paper origin, paper types, the number of the items, and sample types had predictive functions on the reliability for Agreeableness; inventory origin, the number of the items, paper types, and testing pointing were the main predictor variable for the reliability for Conscientiousness.

Key words: Big-Five factor personality tests, reliability generalization, alpha coefficient, meta-analysis

CLC Number: 

  • B844

Adelson, J. L., & McCoach, D. B. (2010). Measuring the mathematical attitudes of elementary students:The effects of a four-point or five-point likert-type scale. Educational and Psychological Measurement, 70(5), 796-807.

Berry, J. W. (1989). Imposed etics emics derived etics:the operationalization of a compelling idea. International Journal of Psychology, 24(6), 721-735.

Botella, J., Suero, M., & Gambara, H. (2010). Psychometric inferences from a meta-analysis of reliability and internal consistency coefficients. Psychological Methods, 15(4), 386-397.

Burisch, M. (1984). You don't always get what you pay for:Measuring depression with short and simple versus long and sophisticated scales. Journal of Research in Personality, 18(1), 81-98.

Caprara, G. V., Barbaranelli, C., Borgogni, L., & Perugini, M. (1993). The big five questionnaire:a new questionnaire to assess the five factor model. Personality and Individual Differences, 15(3), 281-288.

Caruso, J. C. (2000). Reliability generalization of the NEO personality scales. Educational and Psychological Measurement, 60(2), 236-254.

Caruso, J. C., & Edwards, S. (2001). Reliability generalization of the Junior Eysenck Personality Questionnaire. Personality and Individual Differences, 31(2), 173-184.

Chang, L. (1994). A Psychometric evaluation of four-point and six-point likert-type scales in relation to reliability and validity. Applied Psychological Measurement, 18(3), 205-215.

Costa, P. T., Jr., & McCrae, R.R. (1992). NEO-PI-R professional manual. Odessa, FL:Psychological Assessment Resources. Inc.

Credé, M., Harms, P., Niehorster, S., & Gaye-Valentine, A. (2012). An evaluation of the consequences of using short measures of the Big Five personality traits. Journal of Personality and Social Psychology, 102(4), 874-888.

Duijsens, I. J., & Diekstra, R. W. (1995). The 23BB5:a new bipolar Big Five questionnaire. Personality and Individual Differences, 19(5), 753-755.

Feldt, L. S., & Brennan, R. L. (1989). Reliability. In Linn, R. L. (Ed.), Educational measurement (3rd ed., pp. 105-146). New York:American Council on Education and Macmillan.

Goldberg, L. R. (1992). The development of markers for the Big-Five factor structure. Psychological Assessment, 4(1), 26-42.

Hakstian, A. R., & Whalen, T. E. (1976). A k-sample significance test for independent alpha coefficients. Psychometrika, 41(2), 219-231.

Hedges, L.V. & Olkin, I. (1985). Statistical methods for meta-analysis. Orlando, FL:Academic Press.

Higgins, J.P.T. & Thompson, S.G. (2002). Quantifying heterogeneity in a meta-analysis. Statistics in Medicine, 21(11), 1539-1558.

John, O. P., Donahue, E. M., & Kentle, R. L. (1991). The Big Five Inventory-Versions 4a and 54. Berkeley:University of California at Berkeley, Institute of Personality and Social Research.

John, O. P., Naumann, L. R., & Soto, C. J. (2008). Paradigm shift to the integrative Big Five trait taxonomy:History, measurement, and conceptual issues. In John, O. P., Robins, R. W., & Pervin, L. A. Handbook of Personality:Theory and Research (3th). New York:The Guilford Press, 114-158.

Lachin, J. M. (2004). The role of measurement reliability in clinical trials. Clinical Trials, 1(6), 553-566.

McCrae, R. R., & Costa, P. T., Jr. (1989). More reasons to adopt the five-factor model. American Psychologist,44(2), 451-452.

McCrae, R. R., & Terracciano, A. (2005). 78 members of the personality profiles. Universal features of personality traits from the observer's perspective:Data from 50 cultures. Journal of Personality and Social Psychology, 88(3), 547-561.

Rammstedt, B., & John, O. P. (2007). Measuring personality in one minute or less:A 10-item short version of the big five inventory in English and German. Journal of Research in Personality, 41(1), 203-212.

Rodriguez, M. C., & Maeda, Y. (2006). Meta-analysis of coefficient alpha. Psychological Methods, 11(3), 306-322.

Saucier, G. (1994). Mini-markers:a brief version of Goldberg's unipolar Big-Five markers. Journal of Personality Assessment, 63(3), 506-516.

Shields, A. L., Howell, R. T., Potter, J. S., & Weiss, R. D. (2007). The michigan alcoholism screening test and its shortened form:a meta-analytic inquiry into score reliability. Substance Use and Misuse, 42(11), 1783-1800.

Thompson, B., & Vacha-Haase, T. (2000). Psychometrics is datametrics:the test is not reliable. Educational and Psychological Measurement, 60(2):174-195.

Vacha-Haase, T. (1998). Reliability generalization:exploring variance in measurement error affecting score reliability across studies. Educational and Psychological Measurement, 58(1), 6-20.

Vacha-Haase, T., Henson, R., & Caruso, J. C. (2002). Reliability generalization:moving toward improved understanding and use of score reliability. Educational and Psychological Measurement, 62(4), 562-569.

Vacha-Haase, T., Kogan, L. R., Tani, C. R., & Woodall, R. A. (2001). Reliability generalization:exploring variation of reliability coefficients of MMPI clinical scales scores. Educational and Psychological Measurement, 61(1), 45-59.

Vacha-Haase, T., Kogan, L. R., & Thompson, B. (2000). Sample compositions and variabilities in published studies versus those in test manuals:validity of score reliability inductions. Educational and Psychological Measurement, 60(4), 509-522.

Viswesvaran, C., & Ones, D. S. (2000). Measurement error in "Big Five Factors" personality assessment:reliability generalization across studies and measures. Educational and Psychological Measurement, 60(2), 224-235.

Wheeler, D. L., Vassar, M., Worley, J. A., & Barnes, L. L. B. (2011). A reliability generalization meta-analysis of coefficient alpha for the maslach burnout inventory. Educational and Psychological Measurement, 71(1), 231-244.

Wilkinson, L. (1999). The American Psychological Association (APA) Task Force on Statistical Inference. Statistical methods in psychology journals:Guidelines and explanations. Educational and Psychological Measurement, 54(8), 594-604.

Yang, J., McCrae, R. R., Costa, P. T. Jr., Dai, X. Y., Yao, S. Q., Cai, T. S., & Gao, B. L. (1999). Cross-Cultural Personality Assessment in Psychiatric Populations:The NEO-PI-R in the People's Republic of China. Psychological Assessment, 11(3), 359-368.

戴晓阳, 吴依泉. (2005). NEO-PI-R在16~20岁人群中的应用研究. 中国临床心理学杂志, 13(1), 14-18.

戴晓阳, 姚树桥, 蔡太生, 杨坚. (2004). NEO个性问卷修订本在中国的应用研究. 中国心理卫生杂志, 18(3), 170-174.

关丹丹, 张厚粲. (2004). 信度的再认识与信度概括化研究. 心理科学, 27(2), 445-448.

黄希庭, 范蔚. (2001). 人格研究中国化之思考. 西南师范大学学报(人文社会科学版), 27(6), 45-50.

黄希庭. (2004). 再谈人格研究的中国化. 西南师范大学学报(人文社会科学版), 30(6), 5-9.

焦璨, 吴利, 张敏强, 张文怡. (2009). 信度概化研究的新进展评析. 学术研究, 40(2), 54-59.

焦璨, 张洁婷, 吴利, 张敏强. (2010). MMPI在中国应用的信度概化研究. 华南师范大学学报(社会科学版), 36(4), 48-52.

焦璨, 张敏强, 张洁婷, 吴利, 张文怡. (2011). EPQ信度概化的跨文化比较及其启示. 心理科学, 34(6), 1488-1495.

黎红艳, 徐建平, 陈基越, 范业鑫. (2015). 大五人格问卷(BFI-44)信度元分析——基于信度概化方法. 心理科学进展, 23(5), 755-765.

罗杰, 戴晓阳. (2011a). "大五"人格测验在我国使用情况的元分析. 中国临床心理学杂志, 19(6), 740-742.

罗杰, 戴晓阳. (2015b). 中文形容词大五人格量表的初步编制Ⅰ:理论框架与测验信度. 中国临床心理学杂志, 23(3), 381-385.

罗杰, 赵守盈, 潘运, 戴晓阳. (2013). 青少年时间管理倾向量表的信度概化分析. 中国心理卫生杂志, 27(4), 305-309.

王登峰. (1994). 人格特质研究的大五因素分类. 心理学动态, 2(1), 34-41.

王孟成, 戴晓阳, 姚树桥. (2010). 中国大五人格问卷的初步编制Ⅰ:理论框架与信度分析. 中国临床心理学杂志, 18(5), 545-548.

温忠麟, 叶宝娟. (2011). 测验信度估计:从α系数到内部一致性信度. 心理学报, 43(7), 821-829.

杨坚. (1997). 个性结构研究中的五因素模式. 中国临床心理学杂志, 5(1), 56-60.

周晖, 钮丽丽, 邹泓. (2000). 中学生人格五因素问卷的编制. 心理发展与教育, 16(1), 48-54.
[1] XIE Heping, WANG Yanqing, WANG Fuxing, ZHOU Zongkui, DENG Sue, DUAN Zhaohui. Generative Drawing Effect in Memory and Its Boundary Conditions: A Meta-analysis [J]. Psychological Development and Education, 2024, 40(1): 29-43.
[2] NIU Xiang, RAN Guangming. The Association between Peer Relationship and Preschoolers' Problem Behavior: A Three-level Meta-analysis [J]. Psychological Development and Education, 2023, 39(4): 473-487.
[3] CHENG Yangchun, HUANG Jin. Association between the Approximate Number System and Mathematical Competence: A Meta-analysis [J]. Psychological Development and Education, 2023, 39(3): 379-390.
[4] GAO Feng, BAI Xuejun, ZHANG Peng, CAO Haibo. A Meta-analysis of the Relationship between Parenting Styles and Suicidal Ideation in Chinese Adolescents [J]. Psychological Development and Education, 2023, 39(1): 97-108.
[5] XIE Yuntian, SHI Zifu, YIN Lin, LAN Luo. A Meta-analysis of the Relationships between Chinese Parenting Styles and Children’s Academic Achievement [J]. Psychological Development and Education, 2022, 38(3): 366-379.
[6] SHI Guochun, ZHAO Dongyan, FAN Huiyong. Changes in College Students' Physical Self-esteem in 2004~2016: A Cross-temporal Meta-analysis [J]. Psychological Development and Education, 2021, 37(5): 648-659.
[7] NIU Kaining, LI Mei, ZHANG Xiangkui. The Relationship Between Adolescents' Friendship Quality and Subjective Well-being: A Meta-analysis [J]. Psychological Development and Education, 2021, 37(3): 407-418.
[8] YAN Zhiqiang, SU Yanjie. Difference between Cognitive Empathy and Affective Empathy in Development: Meta-analysis Preliminary Exploration [J]. Psychological Development and Education, 2021, 37(1): 1-9.
[9] XIN Sufei, YUE Yangming, XIN Ziqiang. A Cross-temporal Meta-analysis of Changes in Chinese Old People's Mental Health During 1996—2016 [J]. Psychological Development and Education, 2020, 36(6): 753-761.
[10] LEI Lili, RAN Guangming, ZHANG Qi, MI Qianwen, CHEN Xu. The Associations between Parenting Styles and Anxiety in Preschool-age Children: A Three-level Meta-analysis [J]. Psychological Development and Education, 2020, 36(3): 329-340.
[11] LI Song, RAN Guangming, ZHANG Qi, HU Tianqiang. A Meta-analysis of the Relationship between Self-efficacy and Mental Health with Chinese Samples [J]. Psychological Development and Education, 2019, 35(6): 759-768.
[12] ZHOU Li, WANG Fuxing, XIE Heping, CHEN Jiaxue, XIN Liang, ZHAO Qingbai. Does Emotional Design in Multimedia Learning Facilitate Learning? A Meta-analysis [J]. Psychological Development and Education, 2019, 35(6): 697-709.
[13] XIN Sufei, WANG Yixin. A Cross-Temporal Meta-analysis of Changes in Chinese College Students' Achievement Motivation During 1999~2014 [J]. Psychological Development and Education, 2019, 35(3): 288-294.
[14] XIN Sufei, YUE Yangming, XIN Ziqiang, LIN Chongde. Changes in Chinese Old People's Social Support During 1996~2015: A Cross-Temporal Meta-Analysis [J]. Psychological Development and Education, 2018, 34(6): 672-681.
[15] ZHANG Mei, SUN Dongqing, XIN Ziqiang, HUANG Silin. Changes in Impoverished College Students' Mental Health in China: A Cross-temporal Meta-analysis 1998-2015 [J]. Psychological Development and Education, 2018, 34(5): 625-632.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of Psychological Development and Education
Supported by Beijing Magtech Co.Ltd