Resources

Resources

Learning about evaluation

ARC is dedicated to helping programs meet their evaluation needs. Below are some links and resources we hope you will find informative and useful. If you have other questions, please feel free to contact us and we will be glad to help.

	Answers to basic questions about program evaluation
	Useful links

Questions to answer before beginning an evaluation

1. What is program evaluation?

Broadly, there are two types to consider. Process evaluations help mentoring programs assess whether they are making strong matches. Outcome evaluations focus more on assessing the benefits youth are deriving. Most of our evaluations include aspects of outcome and process evaluation that show what the mentoring is accomplishing for youth, and how.

2. Why do an evaluation?

Evaluation should be integral to any program's efforts to make strong matches that last long enough to benefit youth. Even mentoring programs that attend carefully to published best practices may not be successful at implementing them. Program evaluation shows how well programming is implementing best practices, demonstrates positive outcomes, and highlights areas programs can improve. Effective evaluation also helps programs compete for funds.

3. How much evaluation do you need?

Unless fulfilling an evaluation requirement or seeking to attract government or foundation funding, programs benefit most from program evaluations done at regular intervals to ensure that services are as effective as they should be. Between these evaluations, programs should monitor their matches to ensure that match quality remains high.

4. Why work with an external evaluator?

Whether you decide to work with ARC or not, it is in your program's best interests to conduct an external evaluation, which means making sure an objective expert designs and oversees it. Evaluators with inadequate education or experience can place programs at risk for serious practical and ethical problems, including: failing to identify and demonstrate positive outcomes; basing programmatic decisions on inaccurate findings; and, eroding grantor confidence by presenting untenable findings. Hiring an evaluation specialist can be more expensive than keeping an evaluation in-house, but the costs of not doing so can be prohibitive.

[top of page]

Program Evaluation Links

The following link provides an excellent overview of why and how to do program evaluation, written expressly for program managers (from the Office of Planning, Research and Evaluation, a unit within the Administration for Children and Families):

http://www.acf.hhs.gov/programs/opre/other_resrch/pm_guide_eval/reports/pmguide/pmguide_toc.html

The following link provides a useful overview of program evaluation terms and procedures (from the Web Center for Social Research Methods):

http://www.socialresearchmethods.net/kb/intreval.htm

Resources Specifically Designed for Mentoring Programs

Dr. Jean Rhodes provides an excellent overview of what mentoring programs should know when considering an evaluation at the following link (MENTOR/National Mentoring Partnership, 2006).

http://www.mentoring.org/program_staff/evaluation/program_evaluation.php

ARC's article on how to select surveys in the tookit, "How to Build a Successful Mentoring Program Using the Elements of Effective Practice" (MENTOR/National Mentoring Partnership, 2005).

http://www.mentoring.org/_DownloadFiles/Mentor%20Tool%20Kit_full.pdf (page 189)

[top of page]