本研究旨在建構一套具有信度與效度的後設評鑑檢核表,以分析 2001 年 9
所實施自我評鑑計畫大學校院的成果報告書,判斷其優缺點,進而推論 34 所母群
體大學的整體報告書品質,並瞭解 34 所大學實施自我評鑑計畫之現況。
本研究採用文件分析及專家檢核方法。首先,分析七年內國內外 22 篇後設評
鑑研究報告。其次,依據美國線上評鑑資源圖書館(OERL)所建構的品質結論
報告準則,並經專家審核與研究者試評,修正完成方案評鑑報告檢核表,包括執
行摘要、受評方案描述、評鑑概述、評鑑設計、分析程序及結果與建議共六大項
27 個品質準則項目、三等量表,以及每項目之量的判斷依據;再者,由兩位研究
者據之檢核,以判斷 9 所大學校院成果報告書的優缺點,進而推論 34 所大學整體
報告書的品質。最後,提出結論與建議。
In 2001, 34 of Taiwan’s colleges and universities participated in a Self-Evaluation
Project (SEP), and this study set out to analyze the effectiveness of the SEP. More specifically,
it set out to understand the quality (or accuracy) of the self-evaluations reported
by these institutions and to determine certain problematic aspects of the current
implementation of the SEP. The research methods used include content analysis and
experts’ reviews. The authors asked 3 experts to revise the Quality Criteria for Reports
checklist developed by the On-Line Evaluation Resource Library and, in order to construct
proper validity and reliability for this checklist, randomly selected 9 colleges and
universities as samples. This metaevaluation study indicated both the strengths and
weaknesses of the system of self-evaluation used by these colleges and universities. In
this paper the authors report these findings and also give some suggestions for a more
effective self-evaluation process in the future.