Evaluation

calibreProject evaluation will involve a significant integration of relevant information generated during development and implementation. The evaluation is organized around two areas of interest to measure the quality and relevance of the project:

A) OUTCOMES AND IMPACT ASSESSMENT

evaluacion-integral-de-la-calidad

evaluation is a crucial Pact project component because it provides validation of innovations that can be later incorporated into the Social Services System as a whole.

There will be comprehensive assessment of the quality and convenience of the direct results of the project, of changes in the behaviour, attitudes and capacities of the actors involved (partners and beneficiaries), of the organisational and cultural change that is generated with the new care system and of the impacts on stakeholders.

The evaluation will be based on the outcomes map and the results of the project. The relevance of the project and the benefits of its development will be evaluated taking counterfactual operating factors into account.

Given the marked strategic nature of the evaluation in PACT, the involvement of an expert partner directly was considered: the team of researchers from the Department of Sociology and Social Work at the University of Valladolid, who will focus on four essential tasks:

  1. Preparation of the evaluation plan and tools
  2. Evaluation of the initial situation
  3. Evaluation and monitoring during the pilots: field notebooks and Delphi study with the partners and the beneficiaries.
  4. Evaluation after the pilots:

Evaluación

The evaluation will have different analysis methodologies based on the nature of the information to be analysed:

– Before and after the pilot study different dimensions of the system (role of professionals, role of the users, configuration of the relations of the care network, collaborative culture oriented to the solution of the problem through case management…) will be analysed. At the end of the project, the change produced by the different actions carried out will be evaluated and this will be done by comparison with the results in a control group (DiD method).

– In addition, the beneficiaries selected will relate to a series of control cases with the same characteristics, to correctly estimate the contribution and real impact of the project in terms of achievements for the employment or employability and lower dependency on public resources, avoiding established conclusions on the effects of the project, when they can be related to the dynamics of social change (Matching method).

There will be an evaluation and monitoring of the lessons learned in the project, with a system of qualitative assessment by professional participants in the pilot studies and a panel of experts who will provide useful information that can be used as guidance for the model transfer and its development in other areas or territories (Delphi method).

This way, the evaluation will generate the following deliverables that will collect all of the above:

  • Evaluation plan.
  • Evaluation tools.
  • Followed-up report on lessons learned.
  • Intermediate report on the evaluation of the pilots.
  • Final pilot evaluation report.

B) INDEPENDENT EVALUATION

estetoscopio

the independent evaluation will take on how the project is being carried out through a continuous control of quality that allows the improvement of processes and products and services created –formative evaluation- and the results obtained with regard to the expected results, used resources and achieved objectives –summative evaluation-.

Process evaluation of the project will be entrusted to a firm or external evaluator, through outsourcing of the task, to enhance the evaluator role as a “critical friend” with independent perspective.

EVALUATION TOOLS

evaluación– Elaboration of questionnaires to Administration and Third Sector technicians.

– Socioeconomic analysis of the context in Castilla y León.

– SWOT analysis.

write-593333_640

– Participant observation.

– Questionnaires to managers and professionals who participate in local work teams.

analítica

– DIF IN DIF

– MATCHING

– SOCIAL NETWORK ANALYSIS

Facebook

Get the Facebook Likebox Slider Pro for WordPress