Evaluation & Assessment

Evaluation and assessment are critical components of any program, but it is often challenging to have time, funding, and staff expertise to engage in high-quality evaluation and assessment activities. The following resources include user-friendly instruments, websites, and evaluation guides to help girl-serving STEM programs effectively evaluate and assess their efforts.

AWE Resources

AWE, the NSF-funded Assessing Women and Men in Engineering Project, offers assessment surveys, literature resources, and capacity building tools for STEM outreach and education personnel.

Use AWE surveys to understand whether your outreach activities are achieving the goals that you want them to.

AWE surveys—redesigned with NGCP outreach activities in mind—are tested, realizable and easily personalized to your activities. AWE surveys are easily accessible as paper downloads on the AWE website, following a quick, free registration. Exportable online versions are also available. Download the AWE Survey Implementer Guide at the same time to support your use and adaptation.

AWE support tools include:

  • Literature Overviews— Browse these to find out more about the girls you serve
  • Spreadsheets for survey data entry
  • Tips on assessment
  • Much more

Find out more:
AWE Website – Access to all AWE products and tools (with a quick free registration)
AWE Overview – An overview of the AWE project and assessment tools

Developing Measurable Objectives
This powerpoint presentation, developed by AWE, walks through the process of developing clear, measurable objectives.
http://www.ngcproject.org/documents/Developing_Measurable_Objectives.pdf

Webinars

The following webinars related to evaluation and assessment are archived and can be accessed at any time. Accompanying PowerPoint slides are also available for download.  

Good Assessment = Success: Developing Assessment Based Outreach Activities
Barbara Bogue and Rose Marra, co- founders of the AWE Project, share effective strategies for developing assessment based programs and provide an overview of high quality pre- college survey instruments (that get at more than participant satisfaction).
http://www.ngcproject.org/event/good-assessment-success-developing-assessment-based-outreach 

Using the Data: How to Plan, Develop and Use Program Evaluation to Build a Better Program
Collecting data from participants and other stakeholders is an integral part of any informal education program, but the real benefit comes from using the data to inform program planning and delivery. In this webinar learn about methods for collecting evaluation data and how a summer engineering camp is using evaluation to maximize its impact.
http://www.ngcproject.org/event/using-data-how-plan-develop-and-use-program-evaluation-build-better-program

Other Evaluation Resources

Assessment Tools in Informal Science
This searchable collection of assessment tools for informal science learning provides practitioners, evaluators, researchers, and policy makers with the necessary information to choose appropriate tools for assessing program quality and outcomes for children and youth.
http://atis.pearweb.org/

Harvard Family Research Project
The Harvard Family Research Project provides a variety of evaluation-related publications and resources, including The Evaluation Exchange, a one-of-a-kind periodical that contains new lessons and emerging strategies for evaluating programs and policies, particularly those focused on children, families, and communities.
http://hfrp.org/evaluation  

InformalScience.org Website
This website includes a collection of evaluation resources related to informal science, including evaluation publications, online evaluation sources, how-to manuals, and evaluation reports that projects have shared.
http://informalscience.org/evaluation

National Science Foundation Framework for Evaluating Impacts of Informal Science Education Projects
This book introduces a framework for evaluating the impacts of informal science education projects, including guidance on measuring specific STEM-related impact categories (knowledge, attitudes, behavior) and project types (exhibitions, mass media, youth and community programs and collaborations).
http://informalscience.org/documents/Eval_Framework.pdf

National Science Foundation 2010 User-Friendly Handbook for Project Evaluation
This handbook is aimed at people who need to learn more about both what evaluation can do and how to do an evaluation, including overviews of evaluation types, steps in doing an evaluation, quantitative and qualitative data collection, and culturally responsive evaluation strategies.
http://informalscience.org/documents/TheUserFriendlyGuide.pdf

Online Evaluation Research Library
This National Science Foundation-supported website provides a large collection of sound plans, reports, and instruments from past and current project evaluations in several content areas and guidelines for how to improve evaluation practice using the Web site resources.
http://oerl.sri.com/

The Field-tested Learning Assessment Guide (FLAG)
This online collection of STEM-related assessment tools is designed primarily for classroom STEM instructors, but also relevant for informal STEM educators. Assessment tools are sorted by discipline, purpose, and technique.
http://www.flaguide.org/tools/newsearch.php

Toolfind
This online directory is designed to help professionals in youth-serving programs find measurement tools for up to 11 youth outcome areas. Tools included in this database address elementary, middle and/or high school students and youth, parent, staff, and teacher respondents.
http://www.toolfind.org/

W.K. Kellogg Foundation Evaluation Handbook
This comprehensive handbook from the W.K. Kellogg Foundation provides a framework for thinking about evaluation as a relevant and useful program tool and outlines a blueprint for designing and conducting evaluations.
http://www.wkkf.org/knowledge-center/resources/2010/W-K-Kellogg-Foundation-Evaluation-Handbook.aspx

W.K. Kellogg Foundation Logic Model Development Guide
This guide was developed to provide practical assistance to nonprofits engaged in this process. In the pages of this guide, we hope to give staff of nonprofits and community members alike sufficient orientation to the underlying principles of "logic modeling" to use this tool to enhance their program planning, implementation, and dissemination activities.
http://www.wkkf.org/knowledge-center/resources/2006/02/WK-Kellogg-Foundation-Logic-Model-Development-Guide.aspx