Blazing an evaluation pathway: Lessons learned from applying utilization-focused evaluation to a conservation education program

Research
TitleBlazing an evaluation pathway: Lessons learned from applying utilization-focused evaluation to a conservation education program
Publication TypeJournal Article
Year of Publication2010
AuthorsFlowers, AB
JournalEvaluation and Program Planning
Volume33
Issue2
Pagination165 - 171
Date Published2010/05/01/
ISBN Number0149-7189
Keywordsanimals, Conservation Education, Educational Assessment, Evaluation Methods, Found in search, Include2, Interviews, Montana, NCH2, NEWR, outdoor education, Probably include, Program Effectiveness, program evaluation, Quasiexperimental Design, Reviewed, Reviewed2, State Agencies, State Programs, Student Surveys, Teacher Surveys, Teaching Methods, wildlife
AbstractIn 2005, state fish and wildlife agency wanted to examine how one of its conservation education programs was providing science-based understanding and outdoor experiences by evaluating students' knowledge, skills, attitudes and intended behavioral outcomes related to fish, fishing and aquatic habitats in Montana. A key factor in this study was the acceptance by program stakeholders to conduct the evaluation using a utilization-focused evaluation approach to promote usability and accuracy of evaluation results. Using a quasi-experimental non-equivalent group design, more than 2000 students in participating classrooms throughout Montana received a pre-survey, post-survey and an extended post-survey; 114 teachers participated in an Internet survey and 16 program instructors took part in a structured open-ended telephone interview. The participatory approach and mixed methods enhanced abilities to interpret results of student surveys in particular. The user-focused approach was discovered to be personal and situational, allowed the facilitation of the evaluation process with consideration for increased application of evaluation findings and implementation of recommendations from beginning to end. Further development of evaluation pathways is needed to more effectively evaluate outcomes and implement practical and transferable measures to determine if environmental education activities produce desired participant outcomes. (Contains 4 tables.)
Short TitleEvaluation and Program Planning