第五十ㄧ輯.第二期 - 2005-06-30

後設評鑑研究:以 2001 年大學校院 實施自我評鑑計畫成果報告書為例

A Metaevaluation Study of Self-evaluation for Taiwan’s Colleges and Universities

作 者:
黃曙東 蘇錦麗 / Shu-Tung Huang Jin-Li Su
關鍵字:
大學評鑑、後設評鑑、評鑑報告、檢核表、內部評鑑/ 自我評鑑 / university evaluation, metaevaluation, evaluation report, checklist, internal evaluation/self-evaluation
  • 摘要
  • 英文摘要
  • 參考文獻
  • 全文下載
本研究旨在建構一套具有信度與效度的後設評鑑檢核表,以分析 2001 年 9 所實施自我評鑑計畫大學校院的成果報告書,判斷其優缺點,進而推論 34 所母群 體大學的整體報告書品質,並瞭解 34 所大學實施自我評鑑計畫之現況。 本研究採用文件分析及專家檢核方法。首先,分析七年內國內外 22 篇後設評 鑑研究報告。其次,依據美國線上評鑑資源圖書館(OERL)所建構的品質結論 報告準則,並經專家審核與研究者試評,修正完成方案評鑑報告檢核表,包括執 行摘要、受評方案描述、評鑑概述、評鑑設計、分析程序及結果與建議共六大項 27 個品質準則項目、三等量表,以及每項目之量的判斷依據;再者,由兩位研究 者據之檢核,以判斷 9 所大學校院成果報告書的優缺點,進而推論 34 所大學整體 報告書的品質。最後,提出結論與建議。
In 2001, 34 of Taiwan’s colleges and universities participated in a Self-Evaluation Project (SEP), and this study set out to analyze the effectiveness of the SEP. More specifically, it set out to understand the quality (or accuracy) of the self-evaluations reported by these institutions and to determine certain problematic aspects of the current implementation of the SEP. The research methods used include content analysis and experts’ reviews. The authors asked 3 experts to revise the Quality Criteria for Reports checklist developed by the On-Line Evaluation Resource Library and, in order to construct proper validity and reliability for this checklist, randomly selected 9 colleges and universities as samples. This metaevaluation study indicated both the strengths and weaknesses of the system of self-evaluation used by these colleges and universities. In this paper the authors report these findings and also give some suggestions for a more effective self-evaluation process in the future.