心理发展与教育 ›› 2017, Vol. 33 ›› Issue (1): 122-128.doi: 10.16187/j.cnki.issn1001-4918.2017.01.14

• 理论与方法 • 上一篇    

高校教师教学水平评价多元概化理论权重效应分析

黎光明, 张敏强   

  1. 华南师范大学心理学院、心理应用研究中心, 广州 510631
  • 出版日期:2017-01-15 发布日期:2017-01-15
  • 通讯作者: 黎光明,E-mail:Lgm2004100@sina.com E-mail:Lgm2004100@sina.com
  • 基金资助:

    2014年国家自然科学基金面上项目（31470050）；教育部人文社会科学研究青年基金项目（12YJC190016）；广州市教育科学十二五规划2012年度面上一般课题（12A019）；广东省2015度高等教育教学改革项目（粤教高函[2015]173号）；华南师范大学2014年度校级高等教育教学研究和改革项目（教学[2014]52号）。

Weight Effect Analysis of Multivariate Generalizability Theory for Teaching Level Evaluation of College Teachers

LI Guangming, ZHANG Minqiang   

  1. School of Psychology, Center for Studies of Psychological Application in South China Normal University, Guangzhou 510631
  • Online:2017-01-15 Published:2017-01-15

PDF (PC)

被引次数

2

摘要： 探讨高校教师教学水平评价多元概化理论合成信度的权重效应。使用"高校教师教学水平评价问卷"，要求534名学生对16名教师进行评价，对收集到的数据作嵌套设计的多元概化理论分析。结果表明：（1）在高校教师教学水平评价中，多元概化理论合成信度估计权重、先验权重和效果权重产生不同效应；（2）结合高校教师教学水平评价，在充分分析三种权重对合成信度影响的基础上，提出了多元概化理论"合成信度三种权重效应分析模式图"，能为正确使用多元概化理论权重提供科学参考。

关键词: 高校教师, 教学水平评价, 多元概化理论, 权重效应, 合成信度

Abstract: Exemplified teaching level evaluation for college teachers, the paper explored if the weights had an effect on composite reliability of multivariate generalizability theory (MGT). By the designed questionnaire of teaching level evaluation for college teachers, 534 students were asked to evaluate 16 english teachers. We used MGT to analyze the multivariate nested collected data. The results showed that:(1) as for teaching level evaluation for college teachers, three weights, i.e. estimation weights, priori weights and effective weights, had a large difference for composite reliability of MGT; (2)exemplified the teaching level evaluation and based on a full analysis about three weights how to affect the composite reliability, this study proposed a pattern of three weights effect analysis for composite reliability of MGT, which could provide a scientific reference for the proper use of weight in MGT.

Key words: college teachers, teaching level evaluation, multivariate generalizability theory (MGT), weight effect, composite reliability

中图分类号: 

  • B844

Brennan, R. L. (2001a). Generalizability theory. New York:Springer-Verlag.

Brennan, R. L. (2001b). Manual of mGENOVA. Iowa City, IA:Iowa Testing Programs, University of Iowa.

Casabianca, J. M., Lockwood, J. R., & McCaffrey, D. F. (2015). Trends in classroom observation scores. Educational and Psychological Measurement. 75(2), 311-337.

Chang, L., & Hocevar, D. (2000). Models of generalizability theory in analyzing existing faculty evaluation data. Applied Measurement in Education,13(3), 255-275.

Crooks, T. J., & Kane, M. T. (1981). The generalizability of student rating of instructors:Item specificity and section effects. Research in Higher Education, 15(4), 305-313.

Dolmans, D. J., Wolfhagen, H. P., Scherpbier, A. J., & van der Vleuten, C. P. (2003). Development of an instrument to evaluate the effectiveness of teachers in guiding small groups. Higher Education, 46(4), 431-446.

Kolen, M. J., & Brennan, R. L. (2004). Test equating, linking, and scaling:Methods and practices (2nd ed.). New York:Springer-Verlag.

Marcoulides, G. A. (1994). Selecting weighting schemes in multivariate generalizability studies. Educational and Psychological Measurement, 54(1), 3-7.

Meyer, J. P., Liu, X., & Mashburn, A. J. (2014). A practical solution to optimizing the reliability of teaching observation measures under budget constraints. Educational and Psychological Measurement, 74(2), 280-291.

Shin, Y., & Raudenbush, S. W. (2012). Confidence bounds and power for the reliability of observational measures on the quality of a social setting. Psychometrika, 77(3), 543-560.

漆书青, 戴海崎, 丁树良. (2002). 现代教育与心理测量学原理. 北京:高等教育出版社.

王烨晖, 边玉芳, 辛涛. (2011). 垂直等值的应用及最新发展述评. 心理学探新, 31(5), 472-476.

杨志明, 张雷. (2003). 测评的概化理论及其应用. 北京:教育科学出版社.
[1] 黎光明, 陈子豪, 张敏强. 高校教师教学水平评价概化理论预算限制下最佳样本量估计[J]. 心理发展与教育, 2020, 36(3): 378-384.
[2] 韩明, 董学安, 范丹, 何先友. 高校教师心理契约问卷的编制[J]. 心理发展与教育, 2010, 26(3): 315-321.
[3] 韩明, 董学安, 范丹, 何先友. 高校教师心理契约问卷的编制[J]. 心理发展与教育, 2010, 26(3): 315-321.
[4] 韩明, 董学安, 范丹, 何先友. 高校教师心理契约问卷的编制[J]. 心理发展与教育, 2010, 26(3): 315-321.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
版权所有 © 2018 《心理发展与教育》编辑部
地址：北京新街口外大街19号北京师范大学院内　 邮政编码：100875
联系电话：010-58807700 E-mail:pdae@bnu.edu.cn
本系统由北京玛格泰克科技发展有限公司设计开发