Work in Méri

Focus group in Bito

Work in Guédé-Chantier

Objectives: Assess the design of the program; analyze the coordination between the partner entities and the degree of participation of the different actors, especially women, in the whole process; assess effectiveness and efficiency in obtaining results; assess the sustainability of the flow of results generated and estimate the impact.

Work done: The evaluation methodology was developed taking the program as the main level of analysis, but also addressing the analysis at the institutional level and a specific analysis by component. Evaluation activities included telematic meetings, face-to-face and telematic interviews, focus groups with the target population and visits to program activities. The evaluation report analyzed the planning and management of the program and each of the 5 components (Training of elected officials, Communal Development Plans, Access to water, Economic activities for women, Nutrition). Conclusions were drawn up by evaluation criteria, lessons were collected and recommendations proposed. The work was carried out in close collaboration with a Món-3 representative and a local consultancy.

Results: At the end of the fieldwork, the preliminary results were shared with Món-3 and local actors. The final evaluation report was drawn up and reviewed by the participating actors.

Date: June-September 2021 

Initial workshop

Final workshop

Objectives: Assess the design and execution of the program; analyse whether transformative educational processes have been generated or supported; extract lessons and elements of reflection and learning in relation to the identification and design of the program; analyse the use of resources in obtaining results; make recommendations.

Work done: The evaluation methodology was reviewed and agreed, including the overall analysis of the program and a more specific analysis for each educational dimension. The collection of information included: the compilation of essential documentation on the main products of the program; online meetings with the participating entities; two workshops with the ODG and ODESC teams, at the beginning and at the end; 18 online interviews with participants; analysis of 16 products of the program, shared with the respective actors (7 research studies, 2 books, 4 awareness websites, 1 documentary, 1 didactic unit for formal education, 1 work group).

Results: Evaluation report, including: context and program synthesis; analysis of program planning and management; analysis of the 5 components of the program (networking; research; communication and awareness; training; mobilization and political influence); conclusions by evaluation criteria; lessons learned and recommendations.

Date: August-October 2021 

Visit to beneficiaries

Workshop

Evaluation participants

Objectives: Assess the pertinence in relation to the external and internal context during the period 2015-19; evaluate the effectiveness and efficiency in achieving the results of the projects and their contribution to the plan; estimate the effects on the target population and sustainability; assess the application of programmatic approaches; collect lessons to incorporate in the new strategy; facilitate a workshop to kick off the planning of the next 2021-25 strategy.

Work done: We started from the consultation of the documentation of: context; country program planning and management; sectorial and operational strategies; methodological and management tools; research studies produced. We review a large sample of project final reports and evaluations. We did 30 interviews with actors (Oxfam staff, local partners, local authorities and public institutions, donors, United Nations agencies) and meetings with staff by sector at the Bria base. We visited the activities at the Bria base in the different sectors of intervention. We analysed the key elements of the country strategy (objectives, context analysis, theory of change, programmatic approaches, strategic framework) and developed recommendations for the new strategy (theory of change, role of the actors, lines of action , learning and innovation). We drew up a synthesis of the main results, lessons learned and challenges in the different lines of programmatic action (Water, hygiene and sanitation; Food security and livelihoods; Protection and gender; Capacities of Humanitarian NGOs; CSO networks and women's leadership; Reserach, campaigns and advocacy). Finally, in collaboration with an expert consultant in the Central African context, we facilitated a three-day workshop where 45 people (Oxfam, local partners and institutions, donors) participated to share the evaluation, analyse the evolution of the context and trends, and draw up a first planning framework for the next period 2021-25.

Results: Evaluation report of the 2015-20 country strategy. Review of the theory of change and recommendations for the next strategy 2021-25. Preliminary planning framework for the next strategy 2021-25.

Date: September-December 2020 

Preparatory work with team

Discussion group

Evaluation workshop

Objectives: Verify compliance with the criteria established by the Andalusian Cooperation Agency: Effectiveness, Efficiency, Impact, Sustainability, Coordination and complementarity, Gender and cultural diversity.

Work done: We developed and agreed on the evaluation methodology and the techniques and tools for data collection. The collection of information included: semi-structured interviews with the people responsible for the project, technical staff, community animators and local authorities; visits to the realizations of the project in 4 communities; discussion groups in the 4 communities; evaluation workshop with the project partners and representatives of the 4 grassroots organizations. At the end of the fieldwork, we shared the preliminary results of the evaluation with the project partners.

Results: Final evaluation report, including: summary of the context and the project; analysis of project planning and management; analysis of the 4 project components (family farming, cereal processing, milk processing, strengthening of grassroots organizations); conclusions by evaluation criteria and recommendations.

Date: September-November 2018 

Meeting with families

Focal group

Field visit

Objectives: Assess the project according to the the evaluation criteria: Relevance, Effectiveness, Efficiency, Impact and Sustainability.

Work done: We analized how the projet fits in the intervention context; the planning and management mechanisms; the various components of the project; the achievement of results in each component. For the analysis: we studied the available documentation; we conducted interviews with the actors and field visits, focus groups in 8 villages, an evaluation questionnaire for 54 peasant families; we collected and processed data about agricultural production and marketing from a sample of 240 families; we ran an evaluation workshop with the project staff.

Results: The preliminary results were shared with the local partner and were taken as the basis for the preparation of the final evaluation report of the project.

Date: June to September 2017 

Meeting in a community

Focus group with women

Workshop with project team

Objectives: Assess the results of the project and the suitability of the project strategies with a view to achieving the results; the efficiency of the resources used and the management mechanisms; the impact and sustainability of the results. Reflection on the added value, the future of the intervention and the institutional reinforcement of Caritas for it.

Work done: The context of the project was reviewed in relation to the logic of intervention; the logic was studied and the program was reconstructed based on its key components and strategies; the different strategies and the achievement of results were analyzed. Interviews, field visits, focus groups and evaluation workshops were carried out in the three intervention districts. 410 questionnaires to peasant families were collected and analyzed.

Results: Evaluation report.

Date: June to July 2016 

Focal grup with students

Focal group with teachers

Meeting with students

Objectives: Assess the scope of the results, analyze the strategy of the program based on rights, particularly in gender; Assess the effectiveness of alliances with local partners for institutional strengthening; Assess the suitability of the MEAL system.

Work done: The gender issue was analyzed in the intervention districts in relation to the province and the country as a whole. The intervention logic was analyzed, identifying the program components, strategies and result areas to be analyzed. Strategies and results were analyzed, identifying the findings on which the conclusions and recommendations of the evaluation were based. The project information was systematized and evaluation activities were carried out in the 4 intervention districts (29 individual interviews, 8 group interviews, 26 focus groups, collection of 53 questionnaires to program actors and stakeholders).

Results: Evaluation workshops were held with the partners of the Program in the two intervention provinces. The preliminary results were shared and the final report was prepared.

Date: March to April 2016 

Objectives: to identify needs and perspectives of displaced people in Kachin and Northern Shan to define a return and humanitarian intervention strategy for a group of 9 local NGOs: Joint Strategy Team (JST), Metta Foundation.

Work done: Training for interviewers, data collection via surveys in 42 camps for displaced persons, as well as interviews with key informants. In total, 783 people were consulted.

Results: preparation of a diagnostic document and recommendations for an intervention in camps for displaced persons and for an eventual return of the displaced population. Also preparation of an advocacy document.

Date: June 2015 

Objectives: To carry out an analysis of the results of a sample of all Oxfam project evaluations in the period 2012-2013.

Work done: This process included: (a) the direct review of 16 evaluations in 3 thematic axes and (b) the review of external reports on another 30 evaluations.

Results: 3 synthesis documents of findings and learning were produced, one by thematic axis; as well as a document of global conclusions and recommendations.

Date: October 2014 to February 2015 

Objectives: Mixed evaluation of the Impact of the work of RDT in India.

Work done: A mixed evaluation process was conceived with the RDT team, to generate learning and ownership of the evaluation results. Data were collected through a survey in 11 villages where RDT works as well as in 11 control villages, to a total of 800 families. Secondary information from external sources and internal studies carried out by RDT were also reviewed.

Results: Based on the data collected, an Impact Evaluation document was drafted that explores the changes in the lives of the people whom RDT has accompanied.

Date: January to December 2015 

Meeting with beneficiaries, San Mateo

Field visit Tintay

Socialization of evaluation results

Objectives: To assess the project relevance, coherence of the design, achievement of objectives and results, coverage of target population, adequacy of intervention strategies and project efficiency. To estimate the effects on target population and sustainability.

Work done: It was analysed how the project fits into the context; how the project was managed and implemented; the effectiveness of the strategies applied in the five components and the achievement of results. Evaluation activities included interviews with project partners, initial and final workshops with partner’s staff, interviews with authorities at regional level and 3 districts of intervention, 7 meetings with target population and visits to farms and production modules in 6 communities.

Results: Preliminary evaluation results were socialized with project partners at the end of the field work; a final evaluation report was written.

Date: September-October 2014

Food reception

Food distribution

Focus group

Objectives: Know the needs of the population of the municipality of La Garriga (Barcelona) and critically analyze how the project responds to them; identify the actors who participate or can participate, analyze the role they develop and explore how the impact of the project could be increased.

Work done: The information of the local and national context was studied, including the policies that apply; semi-structured interviews were carried out with the project's user families, volunteers and traders of food products from the weekly market; in-depth interviews with the social techniciens of the City Council; surveys and interviews with clients of the weekly market; a participatory workshop with users and volunteers from the project.

Results: The evaluation report was drawn up and its socialization at the municipal level was prepared.

Date: April to September 2015 

Thematic group with institutions

Group interview in Ibo

Objectives: To understand and evaluate the program logic and its relevance in the current context of the province of Cabo Delgado and Mozambique; to analyse the management model of the program in terms of planning, coordination, management and investment of resources; to know the results achieved by the program and their sustainability.

Work done: In the frame of a consultancy of ACE Consultants, we led and coordinated the implementation of the evaluation through a team which included two Mozambican experts. The intervention logic was rebuilt in order to focus the object to evaluate. The different elements of this logic and the program intervention in 11 areas of public finances were analysed. Field work included a total of 45 interviews with program actors, 5 thematic group discussions, 3 focus groups at district level and 2 meetings with all program actors. A total of 40 questionnaires were filled by members of the Monitoring Committee, Directors of Department and technical staff.

Results: Preliminary evaluation results were socialised with all actors; a final evaluation report was written in Portuguese and Spanish.

Date: May-August 2014

Workshop with families, Barkaa, Oman

Female FutbolNet, Muscat, Oman

Male FutbolNet, Doha

Objectives: Gather quantitative and qualitative data to monitor the project implementation and assess the satisfaction of stakeholders and estimate effects on the target population.

Work done: As part of the consultancy led by the DEP Institute, two monitoring trips were made to Oman and one to Qatar. Nine program venues were visited in both countries, carrying out a total of 51 interviews (young participants, relatives of participants, coaches and other actors); participatory observations were conducted in 9 training sessions; 7 focus groups were facilitated. The collected data was systematized and analysed to produce project monitoring reports, assessing the results to date and presenting conclusions and suggestions for improvement.

Results: Three monitoring reports, two for the program in Oman and one for Qatar.

Date: April-June 2014

Fostering development through migration

Purpose: To determine the scope of the intervention, based on the analysis of the results that have been achieved and their contribution to achieving its objectives. It also focused on the internal management structures and working procedures of the project as well as the relationships between its various stakeholders.

Work process: We revised the project literature, carried out 4 field trips to Cabo Verde, Senegal, Ivory Coast and Morocco, collected 43 questionnaires from participants and carried out 67 semi-structured interviews with key stakeholders. Also we used non-participant observation at one project seminar. Additionally, the lead evaluator facilitated a participative workshop with all three consortium agencies to jointly analyse the highlights of the project.

Results: A final evaluation report was produced and presented to the consortium lead.

Date: December 2013 to March 2014

Socialization workshop

 Objectives: To conduct a critical analysis of the return program, assess the implementation of planned activities, assess the achievement of expected results and appreciate the effects on returnees.

Work done: The analysis paid attention to the return migration policies of the EU and Latin American countries, the role and capacity of the network, the selection of beneficiaries, the strategies to support reintegration, the effects on the returnees and the sustainability of the return. Evaluation activities included the study of the project context, the processing of the available monitoring data, interviews with managers and technical staff of all project partners from different European and Latin American countries.

Results: Available monitoring data was systematized; evaluation results were socialized in a workshop with all partner organizations; a final evaluation report was written.

Date: November 2013 to February 2014

Focus group pregnant women, Mangunde

Agriculture school in Estaquinha

Evaluation workshop in Beira

Objectives: To produce an analysis of each project results in terms of their Pertinence, Effectiveness, Efficiency, Impact and Sustainability. To frame the analysis in the overall partnership between ESMABAMA and Manos Unidas for the period 2010-13, systematising the learning in the different intervention sectors and producing recommendations for the next years.

Work done: A Mozambican consultant joined the Baobab team. The analysis was organised in six sectors or areas of activity (basic education, access to health, agriculture schools, agriculture activities, institutional development and gender). Interviews were conducted with the program staff, public administrations and traditional and religious authorities. Workshops and focus groups were done with the teams of ESMABAMA in the headquarters and in three of the four missions, as well as groups of target population. A systematization of the current program situation in the different sectors was elaborated, considering all available documentation and an extensive process of data collection with an important collaboration from the ESMABAMA team.

Results: The preliminary results of the evaluation field work were discussed with the ESMABAMA team. The final results of the evaluation were also discussed with key persons who have participated in the program in the last years. An evaluation report of the ESMABAMA-Manos Unidas program was produced and specific reports for the two projects were written.

Dates: August to November 2013

Field visit in Oriani, Haiti

Workshop beneficiaries in Nan Plezi

Workshop with beneficiaries in Tierra Nueva

Objectives: Evaluate the pertinence of the programs in both countries, the strategies executed, the efficiency of the management models, the achievement of results, the impact and the sustainability of development processes. To transfer to the program 2011-14 the lessons learnt in the final evaluation of the program 2008-12.

Work done: Two experts from Haiti and one from Dominican Republic joined the Baobab team. The actions in the different intervention zones were visited. Workshops and focal groups with beneficiaries were conducted, as well as interviews with authorities and workshops with the staff of the program partners. The intermediate evaluation 2011-14 was designed in order to complement the works of the final evaluation of the former program, including a set of thematic workshops with members from the different grassroots organisations and public institutions and administrations. During the intermediate evaluation, lessons learnt from the former evaluation were considered and the intervention strategies, management models and monitoring and evaluation systems were revisited. A set of proposals were developed to guide the future evolution of the programs.

Results: In both countries, the preliminary results of the evaluations were discussed with the program partners. A report of the final evaluation 2008-12 and another report of the intermediate evaluation were written.

Dates: February to September 2013

A girl decorating the Day Care Centre's door

Purpose: To determine the extent to which the project has contributed to supporting and protecting vulnerable street girls in Kinshasa.

Work process: The evaluation was undertaken by a baobab consultant in partnership with a Congolese expert in street children. The work was done over a 2,5 month period with a 15 day field work stage. This included visits to project sites, interviews with staff, other relevant partners and authorities, focus groups with parents, girls and other beneficiaries of project activities and a workshop with WCUK and its local partner OSEPER.

Results: Before the end of the fieldwork stage we had a brief session with staff to share our preliminary findings and receive their feedback. Afterwards an evaluation report was produced.

Date: June to August 2013

MME partnership logo

Purpose: To determine the scope of the intervention, based on the analysis of the results that have been achieved and their contribution to achieving its objectives. It will also focus on the internal management structures and working procedures of the project as well as the relationships between its various stakeholders.

Work process: We revised the project literature, carried out two on-line surveys in two languages, addressed to over 450 project participants, conducted semi-structured interviews with 22 stakeholders and used non-participant observation at one project seminar. Additionally, the lead evaluator facilitated a participative workshop with all three consortium agencies to jointly analyse their internal management structures, working procedures and relationship.

Results: An intermediate evaluation report was produced and presented to all consortium agencies.

Date: October 2012 to February 2013

Textile entrepreneurship, Tegucigalpa

Evaluation workshop, Amarateca

Young entrepreneurs in El Bálsamo

 Objectives: To evaluate the progress to achieve the expected results and the efficiency of the planning and coordination processes; to analyse the relationship of the program with public policies; to assess the performance of the activities; to produce recommendations for the next implementation period.

Work done: Two evaluators from Honduras and one from El Salvador joined the Baobab team. The field work covered the five territories where the seven partners of the program work. The evaluation analyse was organised in six components and 26 types of activities, grouping and comparing lessons and learning from the different program actions. In each territory a set of interviews, meetings and workshops were done with partners staff, AECID and other institutions and actors; the activities of the program were visited, conducting workshops and focus groups with beneficiaries.
Results: In both countries the preliminary results of the evaluation were shared with program partners at the end of the field work. A report of the intermediate evaluation was written.

Dates: October 2012 to January 2013

Beneficiary family

Meeting with user's grup

Evaluation workshop

Objectives: To assess the relevance, the efficacy, the sustainability and the impact and the efficiency of a solar irrigation project.

Work done: We worked in a team with an Indian expert. Interviews and meetings with FVF and RDT (FVF in India) staff were conducted in the four areas of intervention in Anantapur. We visited a sample of drip irrigation and solar systems and we conducted focal groups with beneficiary families and user’s groups. An evaluation workshop with representatives of the beneficiaries and of RDT staff was facilitated.

Results: The preliminary results of the evaluation were socialized with RDT at the end of the fieldwork. A final evaluation report was written.

Dates: July – September 2012

Women?s group in Bouna

Farmer?s group in Zisgré

Evaluation workshop, Dédougou

Objectives: To assess the relevance, to verify the achievement of goals and results, to estimate the impact and to study the sustainability of the development processes promoted by OCADES and Manos Unidas in each project.

Work done: The job was done in partnership with an expert from Burkina. We studied and analyzed the agricultural production systems, the product transformation systems, the income generating activities and the saving and credit schemes. In each project we visited a sample of producers groups and women’s associations involved in the different areas of activity. Focal groups were conducted with producers groups and women’s groups and a global evaluation workshop was facilitated per each project with a large participation of beneficiaries from the different communities.

Results: At the end of the field work the preliminary results were socialized with OCADES in Kaya and Dédougou. A final evaluation report was written per each project.

Dates: May to August 2012

Brochure of the rural development master

Objectives: To assess the design, the execution, the results achieved and the sustainability of the program implemented by the NGO Món-3 and the University Gaston Berger in the region of Saint-Louis. 

Work done: We studied the program activities and literature, organized in five components. Interviews were conducted with the different university actors in Saint-Louis and Barcelona. Focal groups were done and questionnaires were filled in by current and former master students. Evaluation workshops were conducted with managers and members of the producers organizations.

Results: The preliminary results of the evaluation were socialized with the University Gaston Berger and Món-3. A final evaluation report was presented.

Dates: March to May 2012

Mechanics workshop, El Progreso

Evaluation workshop, El Progreso

Mechanics classroom, Ciudad Sandino

Objectives: To analyze the relevance, coherence, effectiveness and efficiency of the technical education projects in four centres in El Progreso (Honduras) and Ciudad Sandino (Nicaragua).

Work done: All available context information, project documents and sources of verification were reviewed and studied. The laboratories and classrooms in both countries were visited. Direct observation of the teaching sessions and informal exchanges students and instructors were conducted. Semi-structured interviews with key informants were done also carried out, and polls were administered to current and former students. An evaluation workshop with all project actors was facilitated in each educational centre.

Results: The preliminary results of the evaluation work were socialized with the local partners at the end of the field work. An evaluation report was written for each country, and reviewed by project partners. 

Dates: October 2011 to January 2012

Aquaculture project in Bombita

Coffee processing, Neyba

Workshop with beneficiaries, Barahona

 Objectives: To analyze the consistency of the program design, the efficiency of the program implementation and administration, the achievement of expected results and its overall impact. 

Work done: The IDIAF’s (Dominican Institute of Agriculture and Forestry Research) institutional background was explored as well as the context of its program components: coffee, small livestock, apiculture and aquaculture. We systematized the evolution of the program since its inception in 2005 until its evaluation in 2011. Its field activities were visited, and interviews, meetings and workshops with groups of beneficiaries and key informants were carried out. 

Results: During the field work stage the preliminary results of the evaluation were discussed with the coordinators of the different program components. An evaluation report was then submitted and reviewed with the program partners.

Dates: July 2011 to January 2012

The news

Purpose: To provide information on the implementation of the Paris Cooperation Programme during the period 2009-2011.

Work process: Baobab was part of a European wide evaluation team. Our role was to carry out assessment missions to 5 West African countries (Senegal, Gambia, Ghana, Equatorial Guinea and Mali) to collect in-depth information on progress made on the Paris Action Plan's activities. This was done through interviews to key stakeholders, mostly civil servants from migration-related ministries but also academics and other civil society representatives.

Results: Five country sheets were produced analysing national progress towards the Paris Action Plan. Also we co-drafted the overall evaluation paper on the Rabat process including recommendations on needs, priorities and proposals for action for Euro-African cooperation on migration for the period 2012-2014.

Date: July to September 2011.

Teams

Purpose: To analyze the contribution of various thematic regional groups towards achieveing Oxfam's objectives in South America.

Work process: We analyzed the regional structure of Oxfam in South America, each group's mandate and their progress reports. We co-designed surveys to assess Oxfam staff's perception of the performance and achievements of each group. Finally we interviewed Oxfam's Regional Directors, the heads of each group and other key informants.

Results: We produced a draft report evaluating the impact of the regional groups' work. This was discussed with Oxfam's Regional Management Team and we also received comments from the leaders of each regional group. This feedback helped produce the final report.

Date: March to May 2011.

Dzaleka Refugee Camp

Ouadda school

Workshop, Ouadda

Objectives: To evaluate the effects of the educational programmes in the refugee camp of Dzaleka in Malawi and with internally displaced communities in the East of the Central African Republic.

Work done: Literature review of both project documentation and context background. Revision of project management tools. Semi-structured interviews and workshops with the project actors and focal groups with samples of beneficiaries too. Visits to beneficiaries and project activities.

Results: The preliminary results of the evaluation were socialized with the local partners at the end of the field work. An evaluation report was written for each project, which was reviewed by partners.

Dates: January to June 2011

Workshop with all project actors, Giteranyi, Burundi

 Objectives: To evaluate the intervention and make recommendations to assist the return of refugees to their communities of origin in Giteranyi (Muyinga, Burundi).

Work done: The evaluation team included a Burundian expert in gender. The context of the project was studied and the project management documentation and tools were reviewed. A set of visits, interviews and focal groups with project beneficiaries were done in different sites. A one-day workshop was organised with representatives of all beneficiary communities and project partners.

Results: The preliminary results of the evaluation were socialized at the end of the field work. A final evaluation report was written and reviewed by the project partners.

Dates: January to April 2011

Community Development Committee, Benekal

Purpose: To analyse the program's achievements and to make recommendations for the future.

Work process: We set up a team with an Indian consultant from Andhra Pradesh and developed a participative methodological approach which would allow us to determine whether the program had attained its results. We interviewed FVF and its local partner, RDT, and visited the communities in which the project had been implemented. There we held workshops with representatives of the local communities and of women organisations. Finally we interviewed the local housing authorities.

Results: We presented our preliminary findings in a session with RDT in India and then we produced our final report.

Date: January-March 2011.

Mapping key players

Describing key players, Senegal

Map of actors, Morocco

Purpose: To assess institutional coordination mechanisms between public bodies on migration and development issues.

Work process: We teamed up with an expert in migration in the West Africa region. After a review of relevant literature, we developed a questionnaire that was addressed to all ministries with a mandate on migration issues. We carried out field visits to every country and interviewed relevant public stakeholders and some civil society actors as well as donors. This helped us identify all key players, their mandates and which coordination and policy coherence mechanisms were in place.

Results: The results of the field visits were presented to FIIAPP in a meeting and a final report was then submitted.

Date: October 2010- February 2011.

Field visit in Haiti

Meeting with beneficiaries in Haiti

Workshop in Dominican Rep.

Objectives: to evaluate the relevance of the program, the adequacy and sustainability of the implementation strategies, the results that had been achieved and the efficiency of the management models.

Work done: We formed a team with a Haitian expert. The evaluation was designed to analyze the strategies applied in the different thematical and geographical areas. Meetings were conducted in both countries with partners and with AECID officials. All project sites were visited and six workshops were held with groups of beneficiaries in the main project sites. Five formal meetings were held with other participants and finally various experts and key actors were interviewed.

Results: The preliminary results of the evaluation were socialised at the end of the fieldwork, in both countries. Then an intermediate evaluation report was produced, which was reviewed by CESAL and finalised.

Date: September to December 2010

Videoclip participating in the competition

Objectives: To assess the results achieved by the program, to analyze its strengths and weaknesses and to make recommendations on its continuation and improvement.

Work done: The institutional context of Manos Unidas in Catalonia was studied as well as its development education (DE) program's place within the catalan DE context. Data for the evaluation was systematised, including hundreds of interviews to participants. The different lines of action (educational materials for schools, exhibitions, comic editing, videoclip competition, Internet game and associated workshops, campaigning activities, and media), methodologies applied and institutional capacities were assessed. The added value and opportunities of the DE program of Manos Unidas were identified.

Results: A report that systematizes the DE program was written, assessing the results achieved up to date and making recommendations for its future development.

Dates: May and June 2010

Workshop participants, Tizi-Ouzou

Purpose: To analyse the program's achievements and to make recommendations for its second term.

Work process: We proposed a participative methodological approach which would allow us to determine whether the program had attained its results. We visited three regions in Algeria: Alger, Tizi-Ouzou and Oran, where we interviewd SI's local partners (AMUSNAW, ACDC and AFEPEC), the OTC and local authorities. We also held workshops with a sample of the program's beneficiaries. Finally we interviewed local experts in civil society and other development agencies working in the country.

Results: We produced our report and presented its findings in two sessions, a preliminary one held in Algeria and another one in Spain, at SI's headquarters.

Date: April-May 2010.

Workshop on development policy

Objectives: To evaluate the projects' results, strengths and weaknesses, and to make recommendations about the future of this type of intervention within SETEM.

Work done: We studied the project and the partner's relevance -Africa Fair Trade Network (AFN)- within the current context of Fair Trade in Africa. Meetings with SETEM staff and telephone interviews with several AFN stakeholders were conducted. The evaluation was used to bring together a wide representation of SETEM staff to discuss lessons learnt through their development program. Two workshops were run, facilitated by an expert in participative techniques.

Results: Preliminary results were submitted to SETEM and AFN,  and adjusted with their recommendations. As well as the final evaluation report, a draft development policy document was written, to feed into their current strategic planning process.

Dates: May, June and December 2009

Workshop with partners, Butembo

Objectives: To evaluate the pertinence of the program, the ownership by program partners, its management and the results achieved.

Work done: it was formed a team composed by baobab, a Congolese expert and a Dutch facilitator to conduct some participative workshops. The evolution of the VSF program in Kivu was studied, analyzing how the program fits into the current context of the region, with particular attention to the elements required to build a long-term solid program in food sovereignty and human rights. Meetings and interviews were conducted with all the program partners and other stakeholders and role players in all geographical zones of work. A wide range of program activities in each of the intervention axis and geographical zones were also visited. Four days of participative workshops were conducted with an average of 30 people coming from the different role players (communities, community based groups, partners and VSF).

Results: The preliminary results of the evaluation were discussed in Kirumba and Butembo with the program partners. A summary version of the evaluation report was produced for discussion and revision with the program partners. The final version of the mid-term report was presented to VSF.

Date: June to September 2009
 

Rural Haiti

Purpose: To analyse the program's achievements and to make recommendations for its second term.

Work process: We proposed a participative methodological approach which would allow us to determine whether the program had attained its results. We visited the southeast department in Haiti and the area of Pedernales in the Dominican Republic where we held workshops in every commune where the program intervenes, a total of 5. Representatives of various target groups ( SI's local partners, the program's beneficiaries and the local authorities) took place in them. We also organized various focus groups with beneficiaries and interviewed government bodies and other development agencies working in the region.

Results: We produced our report and presented its findings in two sessions, a preliminary one held in Haiti and another one in Spain, at SI's headquarters.

Date: May - August 2009.

Meeting with beneficiaries, Mocimboa da Praia

Objectives: To evaluate the results achieved till today and to make recommendations to adjust the program actions for the second half of the program.

Work done: It was formed a team including baobab and a Mozambican expert on education. It was analyzed in deep the adjustment of the program within the educational system in Mozambique, particularly in the province of Cabo Delgado, and the adjustment with the institutional priorities of Caritas. Meetings with the different program partners were conducted; other education stakeholders and role players in education in Cabo Delgado and at national level were also interviewed; and the different activities of the program all around the province were visited, running meetings with the different groups of beneficiaries.

Results: The preliminary results of the evaluation were presented in Pemba to the program partners, to Caritas in Maputo, and to Caritas in Madrid; a draft report of the evaluation was revised by the program partners and AECID in Mozambique, and the feedback was introduced in the final version of the mid-term evaluation report.

Date: March to June 2009
 

Bollol Dogo cooperative

Well at Fondé Elimane

Harmatin wind

Purpose: To analyse the project's contribution towards a sustainable livelihood for the rural communities of the Senegal river valley.

Work process: We proposed a methodological approach which would allow us to determine whether the project had attained its objective, which was to help the river valley communities achieve food security. We visited the region of Brakna and interviewed most of the beneficiary cooperatives. We also spoke to local government officials, the Ministry of Agriculture, local experts and various development agencies, so as to analyze their strategies of work and capture their opinion on the project.

Results: We produced our report and presented its findings in two sessions, a preliminary one held in Mauritania and another one in Spain, at Mon 3's headquarters.

Date: January - February 2009.

Meeting with beneficiaries, Ziginchor

Purpose: Monitoring and assessment of the program of Asamblea de Cooperación por la Paz (ACPP), and ex-ante evaluation of two programs submitted to a tender of “La Caixa” in 2008-09. 

Work process: In the case of the running program of ACPP, we visited the actors and activities in the region of Ziginchor, and assessed the expected results of the program. For the new programs, we visited the applying organisations, their partners and beneficiary groups in Saint Louis, Louga and Dakar, and we evaluated the quality of their proposals and how they matched the requirements of “La Caixa”.

Results: An evaluation report was prepared for each program, assessing the capacities of the applying organisations and their partners, and evaluating the following criteria: relevance, design coherence, efficacy, efficiency, impact and sustainability. For the running program, we did recommendations to improve some aspects of planning, implementation and systematization of lessons learned. For the new programs, we did recommendations to the approval process of “La Caixa”.

Date: November 2008 to January 2009
 

Mural at La Habana

Purpose: To analyze the OI joint programs' achievements from 2005 to 2008.

Work process: We developed a methodology to study the performance of Oxfam's new management and leadership model, implemented since 2005. We also analyzed the effectiveness of Oxfam's Cuba strategic plan and its relevance with regard to the local and regional context.

Results: We produced a report in which we assessed the results achieved by Oxfam's joint program since 2005, both in terms of management model, program execution, and strategic vision. We made recommendations regarding the program's design, it's management structure and the focus of its strategic plan.

Date: October to December 2008.

Discussion group with beneficiaries.

Purpose: This evaluations' objective was to analyse the results achieved by the Catalan Development Agency (ACCD) in El Salvador from 2002 to 2006.

Work process: Three areas of work were analyzed: water and environment, livelihoods, and empowerment of women, for a total of 11 projects implemented by NGO's with the ACCD's financial support. The evaluation also examined whether the Agency's work took into account the four cross-cutting principles identified in its 2003-2006 Strategic Plan: democratic governance and strengthening of the social fabric; a culture of peace and human rights; equality between women and men and a sustainable environment.
This work was carried out by reviewing documentation and through a field visit to El Salvador in which individual and group interviews were carried out with experts, partners and beneficiaries.

Results: The evaluation report which was produced analyzed the results attained by each individual project and sectorally, with regard to the following evaluation criteria: effectiveness, efficiency, impact, pertinence and sustainability. Project, sectoral and general recommendations were made. These referred to the institutional and methodological aspects of the work evaluated as well as to the logic of each intervention. Finally observations were made on the added value of each participating NGO.

Date: October 2007 to February 2008.