Design of the Evaluation Report – Chapter 9, Appendices B&C
1. Does the College Honors Program meet the information literacy objective?
To develop those abilities essential to liberal arts education, which include
a. Thinking logically and creatively, analytically and synthetically, and abstractly and concretely
b. Reading, observing, and listening carefully and critically
c. Writing and speaking clearly and coherently
d. Accessing, evaluating, and using information effectively and ethically
2. Do College Honors Program students’ final honors projects demonstrate a high level of information literacy, including appropriate utilization of library and other resources?
Activities to Observe
I don’t believe there will be any specific activities to observe, as this evaluation is limited to analyzing final honors projects quantitatively, and college documents.
Citation references of final honors projects. These data sources will be analyzed through use of MSAccess and MSExcel software. College documents such as objectives and Honors Program information.
Population Sample Design
Due to small sample size, 100% of 2012 final honors projects will be evaluated.
Final honors projects will be collected from the Honors Program by the Collection Development Librarian. The evaluator will enter citation information into a customized database in MSAccess. Aggregate data will be evaluated through MSAccess and MSExcel.
The individual responsible for this evaluation project is the Librarian/Collection Development Coordinator
The following analysis will be made: citation totals, formats, age, website domains, and availability (both print and online), by academic discipline. This analysis will enable the evaluator to determine utilization of library and other information resources for final honors projects, and to indirectly determine levels of information literacy, and whether the information literacy objectives are being met in the Honors Program.
Primary audience: Administrators. Secondary audience: Accreditors, Honors Program Faculty, Librarians
In Appendix B – evaluation report – I first noticed the list of objectives. I will need to specify not only the college-wide educational objectives that apply to the Honors Program, but the specific objectives of the Honors Program as well. I’ve noticed so far that most of the evaluation methods described are qualitative in nature such as self-assessments and surveys. My methodology will be primarily quantitative in nature with review and analysis of references utilized in cumulative projects to indirectly determine information literacy. I expect that later sections on methodology and analysis in the book address this methodology as well. I found it interesting that the report in Appendix B presented the findings within the framework of the objectives. I’m looking forward to the Recommendation stages based on the findings and discussion.
I like how the evaluation contract in Appendix C really lays out the expectations for each part of the evaluation and report, including costs. Because my evaluation reports are informal and in-house, I’ve never really reviewed a formal evaluation report. While I may not need something this formal for evaluations that are expected as part of my job (certainly not the costs portion!), it would certainly help to replicate parts of this to clarify expectations.