Evaluation Services

Overview

As competition for limited funding resources grows, it becomes increasingly important for both funders and funded nonprofits alike, to report program outcomes and impacts that would not have occurred without the program implementation and intervention. 

An Evaluation is a tool.  As an organizational tool, an evaluation will provide an assessment of program performance, and at the same time can be used to provide continuing programmatic feedback so that adjustments can be made in order to better achieve the stated program goals and objectives .  

 As a tool, the intended purpose of an evaluation is to determine one or all of the following three key issues:

        1.  Whether the identified approach is being implemented according to the plan                       
             Process-Based Evaluation

     2.  Whether the program is doing the right activities to achieve the established outcomes 

             Outcome-Based Evaluation                                                      

        3.  Whether and to what extent organization/program is meeting the stated goals                
             Goals-Based  Evaluation

Taken together, the types of evaluations listed above, will provide the necessary, documented information that both organizations and funders need in order to articulate the community impact of funded interventions and/or programs.

A Logic Model is also a tool.  It is a visual diagram that is used to plan, communicate and evaluate either a program or intervention.  It is a path to follow to achieve the intended results.  It is created to show the relationship of many of the program components such as the relationship between resources and activities; activities and outputs; outputs and outcomes; and outcomes to community impact or intended effects.

A Logic Model is not meant to be a static document, but rather a dynamic document that is reviewed periodically to determine whether there is fidelity to the process, to review whether the outputs are consistent with the original expectations, to identify new information or evidence that impacts the implementation, and whether there have been changes in context or in resources.  If, upon review, there have been changes within the environment of the logic model, then the logic model should be revised to reflect the new environment.

The use of the logic model as a planning tool

As a planning tool, a logic model clarifies the sequence of outcomes and the relationship 
between activities and specific outcomes.

A logic model helps to:

     �  Examine/refine the program mission and vision, goals and objectives, preferably with     
         stakeholders. 
     �  Identify the most important desired outcomes. 
     �  Identify the critical path. If efforts must be reduced, which paths are most effective, are
         likely to get you there quickest, and/or are most cost-effective?

     �  Identify existing and needed, or weak and strong, components of the program and ways
         to enhance performance.

Much of the benefit of constructing program logic models comes from the process of 
discussing, analyzing, and justifying the expected relationships and linkages between 
activities and expected outcomes with staff and partners.

Use of the logic model as an evaluation tool

A logic model is often used to guide evaluation planning. It can help you:

     � Determine what to evaluate.

     � Identify appropriate evaluation questions based on the program.

     � Know what information to collect to answer these questions�the indicators.

     � Determine when to collect data.

     � Determine data collection sources, methods, and instrumentation

The United States Department of Health and Human Services, specifically through the  
Center For Disease Control states that logic models increase the likelihood that program efforts
will be successful because they:

     � Communicate the purpose of the program and expected results. 

     � Improve program staff expertise in planning, implementation, and evaluation.

     � Incorporate findings from other research and demonstration projects.

Ultimately, the key to programmatic/intervention responsiveness and effectiveness is to
combine program planning, design and implementation with evaluation.

Services 

Logic Model Development

                 �   As a planning tool
                 �   As an evaluation tool 
 

Process-Based Evaluation  ♦ ♦  ♦  Outcomes-Based Evaluation  ♦  ♦  ♦   Goals-Based Evaluation

            1. Review of evaluation parameters and scope                                            
                �  Thorough review
                �  Follow-up discussions
                �  Finalize what is to be evaluated
                
            2. Evaluation Planning, Design and Implementation
                �  Review of evaluation requirements and logic model/project outline and timetable
                �  Information gathering
                � Convening staff, stakeholders, partners, collaborators for evaluation planning and design meetings
                �  Finalizing evaluation components, activities and partners

            3. Evaluation Report
                �  Preparation of draft sections and review with organization
                �  Preparation of final evaluation

            4.Overall Evaluation Management
                �    All of the above, as needed
                �    Evaluation planning and scheduling of tasks
                �    Management and supervision of the evaluation team
                �    Management and supervision of the full evaluation process

S.E. Milne & Associates, LLC

Susan E. Milne, MSW,  MBA 
Phone:  843-838-9332;   mobile:   843-592-2296;  Fax:  843-838-9339  

  semilne.associates@gmail.com     www.semilne.com