Psychological Development and Education ›› 2017, Vol. 33 ›› Issue (4): 504-512.doi: 10.16187/j.cnki.issn1001-4918.2017.04.15

Previous Articles    

Reporting and Interpreting Multidimensional Test Scores:A Bi-factor Perspective

GU Honglei1, WEN Zhonglin2   

  1. 1. School of Education Science, Xinyang Normal University, Xinyang 464000;
    2. Center for Studies of Psychological Application/School of Psychology, South China Normal University, Guangzhou 510631
  • Online:2017-07-15 Published:2017-07-15

Abstract: Empirical psychological, educational and social scientists are often confronted with multifaceted tests which are comprised of several related dimensions or subtests. This study is organized as follows:Firstly, the measurement models of multidimensional scales were reviewed and evaluated. Secondly, some statistical indices (i.e., ECV, PUC and four types of reliability coefficients) based on bi-factor modeling were calculated and interpreted. Thirdly, based on different research purposes, we summarized and proposed two analysis processes about multidimensional measurement, and both of them took the simplicity and accuracy into account simultaneously. Finally, as an example, the bi-factor model of the Machiavellianism Personality Scale (MPS) was analyzed, and the following questions were clarified for applied researchers:Do total scores generally reflect variation on a single latent variable? Is it justified to report the subscale scores? After partitioning out variability attributed to the total score, could subscales still provide reliable information? Could a complex multidimensional measurement be modeled using a simple unidimensional CFA?

Key words: multidimensional test, bi-factor model, homogeneity coefficient, ECV

CLC Number: 

  • B844

Armon, G., & Shirom, A. (2011). The across-time associations of the five-factor model of personality with vigor and its facets using the bifactor model. Journal of Personality Assessment, 93, 618-627.

Bentler, P. M. (2009). Alpha, dimension-free, and model-based internal consistency reliability. Psychometrika, 74, 137-143.

Bonifay, W. E., Reise, S. P., Scheines, R., & Meijer, R. R. (2015). When are multidimensional data unidimensional enough for structural equation modeling? An evaluation of the DETECT multidimensionality index. Structural Equation Modeling, 22, 504-516.

Caci, H., Morin, A. J., & Tran, A. (2015). Investigation of a bifactor model of the strengths and difficulties questionnaire. European Child & Adolescent Psychiatry, 24, 1291-1301.

Carmines, E. G., & Zeller, R. A. (1979). Reliability and validity assessment. Beverly Hills, CA:Sage.

Chen, F. F., Hayes, A., Carver, C. S., Laurenceau, J. P., & Zhang, Z. (2012). Modeling general and specific variance in multifaceted constructs:A comparison of the bifactor model to other approaches. Journal of Personality, 80, 219-251.

Chen, F. F., West, S. G., & Sousa, K. H. (2006). A comparison of bifactor and second-order models of quality of life. Multivariate Behavioral Research, 41, 189-225.

Cole, D. A., & Preacher, K. J. (2014). Manifest Variable Path Analysis:Potentially Serious and Misleading Consequences Due to Uncorrected Measurement Error. Psychological Methods, 19, 300-315.

Cornick, J. E. (2015). Factor Structure of the Exercise Self-Efficacy Scale. Measurement in Physical Education and Exercise Science, 19, 208-218.

Dahling, J. J., Whitaker, B. G., & Levy, P. E. (2009). The development and validation of a new Machiavellianism scale. Journal of Management, 35, 219-257.

Gignac, G. E. (2008). Higher-order models versus direct hierarchical models:g as superordinate or breadth factor? Psychology Science Quarterly, 50, 21-43.

Gu, H., Wen, Z., & Fan, X. (2015). The Impact of Wording Effect on Reliability and Validity of the Core Self-Evaluation Scale (CSES):A Bi-factor Perspective. Personality and Individual Difference, 83, 142-147.

Gu, H., Wen, Z., & Fan, X. (2017a). Structural validity of the Machiavellian Personality Scale:A bifactor exploratory structural equation modeling approach. Personality and Individual Differences, 105, 116-123.

Gu, H., Wen, Z., & Fan, X. (2017b). Examining and Controlling for Wording Effect in a Self-Report Measure:A Monte Carlo Simulation Study. Structural Equation Modeling:A Multidisciplinary Journal, 24, 545-555.

Henry, D., Gorman-Smith, D., Schoeny, M., & Tolan, P. (2014). "Neighborhood Matters":Assessment of Neighborhood Social Processes. American Journal of Community Psychology, 54, 187-204.

Hull, J. G., Lehn, D. A., & Tedlie, J. C. (1991). A general approach to testing multifaceted personality constructs. Journal of Personality and Social Psychology, 61, 932-945.

Hyland, P. (2015). Application of bifactor models in criminal psychology research:a guide to researchers. Journal of Criminal Psychology, 5, 65-74.

Lilleoja, L., Dobewall, H., Aavik, T., Strack, M., & Verkasalo, M. (2016). Measurement equivalence of Schwartz's refined value structure across countries and modes of data collection:New evidence from Estonia, Finland, and Ethiopia. Personality and Individual Differences, 102, 204-210.

Mészáros, V., Ádám, S., Szabó, M., Szigeti, R., & Urbán, R. (2014). The Bifactor Model of the Maslach Burnout Inventory-Human Services Survey (MBI-HSS)-An Alternative Measurement Model of Burnout. Stress and Health, 30, 82-88.

Muthén, B. O., Kaplan, D., & Hollis, M. (1987). On structural equation modeling with data that are not missing completely at random. Psychometrika, 52, 431-462.

Reise, S. P. (2012). The rediscovery of bifactor measurement models. Multivariate Behavioral Research, 47, 667-696.

Reise, S. P., Bonifay, W. E., & Haviland, M. G. (2013). Scoring and modeling psychological measures in the presence of multidimensionality. Journal of Personality Assessment, 95, 129-140.

Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013). Multidimensionality and structural coefficient bias in structural equation modeling:A bifactor perspective. Educational and Psychological Measurement, 1, 5-26.

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016a). Applying Bifactor Statistical Indices in the Evaluation of Psychological Measures. Journal of Personality Assessment, 98, 223-237.

Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016b). Evaluating Bifactor Models:Calculating and Interpreting Statistical Indices. Psychological Methods, 21, 137-150.

Wang, M. T., Fredricks, J. A., Ye, F., Hofkens, T. L., & Linn, J. S. (2016). The Math and Science Engagement Scales:Scale development, validation, and psychometric properties. Learning and Instruction, 43, 16-26.

Wechsler, D. (2008). Wechsler Adult Intelligence Scale-Fourth Edition. San Antonio, TX:Pearson Assessment.

顾红磊, 王才康. (2012). 项目表述效应的统计控制:以中文版生活定向测验为例. 心理科学, 35, 1247-1253.

顾红磊, 温忠麟. (2014). 项目表述效应对自陈量表信效度的影响——以核心自我评价量表为例. 心理科学, 37, 1245-1252.

顾红磊, 温忠麟, 方杰. (2014). 双因子模型:多维构念测量的新视角. 心理科学, 37, 973-979.

侯杰泰, 温忠麟, 成子娟. (2004). 结构方程模型及其应用. 北京:教育科学出版社.

温忠麟, 刘红云, 侯杰泰. (2012). 调节效应和中介效应分析. 北京:教育科学出版社.

温忠麟, 叶宝娟. (2011). 测验信度估计:从α系数到内部一致性信度. 心理学报, 43, 821-829.

温忠麟, 叶宝娟. (印刷中). 多变量分析热点:中介效应和调节效应. 见莫雷, 刘鸣(主编). 当代心理学研究. 北京:科学出版社.

吴艳, 温忠麟. (2011). 结构方程建模中的题目打包策略. 心理科学进展, 19, 1859-1867.

叶宝娟, 温忠麟. (2012). 测验同质性系数及其区间估计. 心理学报, 44, 1687-1694.
[1] CHEN Qingqiu, XU Hua, WU Nan. The Occurrence and Development of Children's Gratitude Awareness in Helping Situations [J]. Psychological Development and Education, 2018, 34(4): 403-409.
[2] XU Lulu, WU Peipei, HE Wen. Meta-Stereotype Threat Effects on Intergroup Relations among Impoverished Undergraduates: A Moderated Mediation Model of Intergroup Anxiety and Self-esteem [J]. Psychological Development and Education, 2018, 34(4): 426-433.
[3] LI Weijia, HU Qingfen. The Variety of Position Representation in Reorientation: Evidence from Virtual Reality Experiment [J]. Psychological Development and Education, 2018, 34(4): 385-394.
[4] XIANG Ling, FAN Shuxian, CHEN Jiali, WANG Baoxi. A Study on the Characteristics of Cognitive Control of Adolescent with Learning Disabilities [J]. Psychological Development and Education, 2018, 34(4): 410-416.
[5] HOU Fen, WU Xinchun, ZOU Shengqi, LIU Chang, HUANG Binbin. The Association between Parental Involvement and Adolescent's Prosocial Behavior: The Mediating Role of Parent-child Attachment [J]. Psychological Development and Education, 2018, 34(4): 417-425.
[6] KAN Jiaqi, LIU Siman, SHI Jiahui, YAN Qi, GUO Junbin, WANG Zhengyan. The Associations among Maternal and Grandparents' Mind-mindedness, Mother-Infant Attachment and Infants' Cognition under the Background of Grandmother Co-parenting: A Moderated Mediation Model [J]. Psychological Development and Education, 2018, 34(4): 395-402.
[7] TIAN Yunlong, YU Chengfu, LIN Shuang, YE Shimin, ZHANG Xiaolin, LIU Yi, LU Hong, ZHANG Wei. Parental Corporal Punishment, School Engagement and Internet Gaming Addiction among Adolescents: Parent-Adolescent Relationship as a Moderator [J]. Psychological Development and Education, 2018, 34(4): 461-471.
[8] LI Ruoxuan, ZHU Wenlong, LIU Hongrui, YAO Meilin. How Parental Educational Expectations Influence Student Academic Burnout: The Mediating Role of Educational Involvement and Moderating Role of Family Functioning [J]. Psychological Development and Education, 2018, 34(4): 489-496.
[9] PENG yuan, ZHU lei, WANG zhenhong. Association between Parental Emotion Expressiveness and Adolescents' Behavior Problem: the Mediating Role of the Parent-Child Attachment and Loneliness [J]. Psychological Development and Education, 2018, 34(4): 504-512.
[10] JIANG Yongqiang, SHAO Yuntian, LIN Xiuyun, HE Xianyou. The Associations among Class Group Attachment, Self-compassion, and Learning Burnout among Junior Middle School Students [J]. Psychological Development and Education, 2018, 34(4): 472-480.
[11] FAN Hang, ZHU Zhuan, MIAO Lingtong, LIU Shen, ZHANG Lin. Impact of Parents' Marital Conflict on Adolescent Depressive Symptoms: A Moderated Mediation Model [J]. Psychological Development and Education, 2018, 34(4): 481-488.
[12] YE Baojuan, ZHU Lijun, FANG Xiaoting, LIU Mingfan, WANG Kaikai, YANG Qiang. The Effect of Perceived Stress on College Students' Depression: Moderated Mediating Effect [J]. Psychological Development and Education, 2018, 34(4): 497-503.
[13] DING Zien, WANG Xiaohan, LIU Qinxue. The Relationship between College Students' Self-esteem and Cyber Aggressive Behavior: the Role of Social Anxiety and Dual Self-consciousness [J]. Psychological Development and Education, 2018, 34(2): 171-180.
[14] LIU Xueping, CHEN Zizhuo, HUANG Wen, PENG Huamao. The Definitions and Predictors of Successful Aging [J]. Psychological Development and Education, 2018, 34(2): 249-256.
[15] YAN Zhiqiang, SU Yanjie. Gender Difference in Empathy: The Evidence from Meta-analysis [J]. Psychological Development and Education, 2018, 34(2): 129-136.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
Copyright 2018 © Editorial office of Psychological Development and Education
Supported by Beijing Magtech Co.Ltd