Robbie Gregorowski is an Associate Director at Itad and has over 10 years of consulting experience providing monitoring, evaluation and learning services to a range of international organisations including the Rockefeller Foundation, Bill and Melinda Gates Foundation, Her Majesty’s Government (HMG) – DFID, DEFRA and DECC, the Global Environment Facility (GEF), the European Commission (EC), UN agencies, and the World Bank.
Beyond his core M&E experience, he has expertise in the domains of innovation for development, evidence-informed policy processes, capacity development, and knowledge brokering and networking. As an Associate Director, he plays a strategic leadership role within Itad, overseeing the Private Sector Development and Climate Change teams
In 2009, he created and continues to lead Itad’s Climate Change theme, managing a core team of M&E experts and positioning Itad as a thought leader in the field of climate change M&E and resilience measurement. As a team, they are responsible for delivering Itad’s £6m portfolio of resilience M&E projects across the spheres of climate resilience, sustainable development, urban resilience, disaster risk management, and climate policy. In terms of designs and methods, Robbie is an advocate and practitioner of robust mixed-methods and has particular interest and expertise in Realist Evaluation, Theory of Change, and Contribution Analysis.
In 2016-17 Robbie is undertaking two major M&E roles:
BRACED is the world’s largest resilience strengthening programme. As Head of M&E for the £140m DFID Building Resilience and Adaptation to Climate Extremes and Disasters Programme (BRACED) programme, Robbie is leading a 6-person core M&E team, designing a results reporting system across 15 NGO consortia in 12 countries, and delivering a £3m portfolio of programme evaluation activities.
HMG Climate Change Compass represents the first time that three British government departments have come together to systematically generate evidence and learning from across a large and complex fund. As Project Director for Itad on the project, Robbie is responsible for overseeing Itad’s role to generate robust evidence and learning across the £3.8bn ICF project portfolio, and working across DFID, DEFRA and DECC to ensure our support informs future HMG climate investment and programming priorities.
Robbie holds an MSc (Distinction) in Development Studies from the School of Oriental and African Studies (SOAS) at the University of London and has completed an Individual Professional Qualification in Project Appraisal & Impact Analysis also from University of London.
Robbie’s career in international development is driven by a strong commitment to contribute to a more compassionate, equitable, and sustainable world.
Find out more about Robbie in his 60 Second Interview.
Itad is a UK-based independent management consultancy established in 1984 and one of few companies globally whose long-term core business has been the design and operation of monitoring and evaluation policies, strategies and systems. Robbie has led Itad's climate resilience portfolio since he joined the company in 2009. He has considerable expertise in monitoring and evaluation, particularly in the fields of climate change resilience, evidence-informed policy, and organisational assessment.
Maxwell Stamp PLC
Maxwell Stamp is a multi-disciplinary management consultancy specialising in international development economics. Robbie helped establish and develop the Livelihoods and Rural Development Practice Area into the highest billing and most successful business area in under 2 years. He won and managed several high profile impact evaluation, policy research, and M&E assignments for the World Bank and DFID including an impact and institutional evaluation of the Social Fund for Development in Yemen and a high profile piece of political economy policy research informing UK Government strategy and programming decisions in Afghanistan. He also made multiple short term consultancy inputs on large-scale multi-sectoral development programmes including DFID's Chars Livelihoods Programme in Bangladesh and the World Bank's National Solidarity Programme in Afghanistan.
HTSPE / UK Department for International Development
HTSPE (www.htspe.com) is a management and sustainable development consultancy specialising in poverty reduction in developing countries. Robbie worked as the Assistant Programme Manager managing DFID's US$36m Natural Resource Systems Programme (DFID-NRSP). He planned and supervised innovative action-research projects that generated new knowledge to improve livelihoods through partnerships with 50 institutions worldwide.
(CIFF) - Project Director
Managing to a team of Itad-led consultants, researchers, climate experts and evaluators applying a mixed methodology approach. Evaluation methods include contribution analysis and process tracing.
(DFID) - Itad Project Director
In partnership with IMC, Itad has begun establishing a monitoring, evaluation and learning platform for the ICF, a major cross UK government mechanism to help the world’s poorest adapt to climate change and promote cleaner, greener growth. Robbie is project directing the evaluation component of the project.
(DFID) - Principal Consultant and Evaluator
Robbie is head of M&E for the Knowledge Manager consortium established to provide monitoring, evaluation and learning for DFID’s Building Resilience and Adaptation to Climate Extremes and Disasters (BRACED) programme. BRACED was launched in 2014 to respond to the changing magnitude and frequency of some of these climate extremes. The BRACED programme aims to build resilience in a selection of countries in the Sahel and elsewhere in Africa and Asia, through an NGO challenge fund. An estimated 5 million people will be benefit from the support. As a core partner of the Knowledge Manager (KM) consortium for BRACED, Itad is responsible for leading all monitoring and evaluation (M&E) aspects of the KM grant. This includes assessing how interventions can be designed and implemented to successfully build resilience and what lessons these generate for application in other climate vulnerable states.
(The Rockefeller Foundation) - Grant Director / Resilience Advisor
Through Robbie, Itad has been engaged by the Rockefeller Foundation's Resilience Team to provide targeted support across the Foundation to better understand and mainstream resilience concepts and approaches in their work. Robbie is leading and coordinating a range of strategic advisory and knowledge services related to resilience-building across a range of sectors - urban resilience, human health, and ecosystems - relevant to the Foundation's work.
The outputs produced will showcase how resilience can practically be infused through development work worldwide. As a result of this support, the RF Resilience Team will be better equipped to use resilience as a lens in creating and implementing a range of global initiatives, and the U.S. and international development and evaluation communities will gain practical information on applying and evaluating resilience in economic and social development programmes.
(The World Bank) - Project Director / Evaluator
Itad was selected by the World Bank to lead the Independent Evaluation of the Development Grants Facility (DGF) Financed Track 1 of the Global Facility for Disaster Risk Reduction and Recovery (GFDRR). Established in 2006, the Global Facility for Disaster Reduction and Recovery (GFDRR) is a partnership of 41 countries and 8 international organisations committed to helping developing countries reduce their vulnerability to natural hazards and adapt to climate change. DGF Financed Track 1 responds to disaster risk reduction needs at the global and regional levels in accordance with the Hyogo Framework Agreement (HFA) priorities. It is jointly run by the World Bank and the UN International Strategy for Disaster Reduction (UNISDR).
Robbie assembled a small team of climate resilience and disaster risk reduction experts and evaluators. The evaluation involved i) An assessment of the partnership between GFDRR and UNISDR, ii) An assessment of the specific results produced under Track 1 and iii) A set of lessons and recommendations in order to strengthen strategic cooperation between GFDRR and UNISDR in the future. In order to better understand the partnership between the two institutions, the team applied a Contribution Analysis-based approach to establish a coherent set of partnership change pathways. The evidence to support these pathways was then assembled using an integrated qualitative and quantitative set of mixed methods, drawing on a standardised case study methodology.
(The Global Environment Facility (GEF) Evaluation Office) - Team Leader / Evaluator
The Global Environment Facility provides support to address global environmental concerns and since its inception in 1991 has provided $11billion in grants to projects in developing countries and countries with economies in transition. The GEF Evaluation Office (GEF EO) is independent of GEF management and is administered by the World Bank. Capacity development on environmental issues is a key aspect of GEF work administered under their Enabling Activities modality.
Robbie was asked by the GEF EO to constitute and lead a multi-disciplinary team charged with reviewing the latest thinking on capacity development and then to develop a conceptual framework for the GEF, called Capacity Development 2 (CD2). The team assessed what capacity, and capacity development mean, forming the idea that capacity involves the ability of a society or sector to continue to develop necessary skills, behaviours, networks and institutions that enable communities to adapt and self-renew into the future. Having created the CD2 concept and framework, the team were tasked with defining how CD 2 approaches and tools can be deployed to better support GEF EA modality in the future.
(Rockefeller Foundation) - Grant Director / Team Leader
The Rockefeller Foundation has translated its original mission of promoting the well-being of humanity into two overarching goals: expanding opportunity through equitable growth, and strengthening resilience to acute crises and chronic stresses. Itad was awarded an Evaluation Advisers Grant for 2013/14 to enhance the impact of the Foundation's work, as well as the sustainability of its results, through knowledge and practical support that can help improve the planning, monitoring, evaluation and scaling of successful interventions.
Based on his close working relationship with The Rockefeller Foundation's Evaluation Office, Robbie was engaged by the Foundation to provide them with on-going strategic advisory services in the field of monitoring and evaluation. Robbie leads and coordinates a team of experienced evaluation professionals, advisors and trainers, who are considered global 'thought leaders', to support the planning, monitoring, evaluation commitments and needs of RF Initiative teams and key grantees, particularly in the development and use of theory of change, results-oriented PM&E, innovative approaches to evaluation, measuring impact, development of indicators, measuring network effectiveness and advice to strengthen the RF Evaluation Office overall.
(World Bank, USA, Finland) - Lead Evaluator
Project description: infoDev is a global partnership program within the World Bank Group that aims to create opportunities for inclusive growth, job creation and poverty reduction. It was originally established to promote the use of information and communications technologies for development (ICT4D), but has since expanded to assist governments and innovative, technology-enabled small and medium enterprises (SMEs) to grow jobs, improve capacity and skills, increase access to finance and markets, ensure the appropriate enabling policy and regulatory environment for business to flourish, and test innovative solutions in developing country markets. The purpose of this evaluation is to assess the performance of the infoDev program over the last four years, i.e from fiscal years 2007-2011. The evaluation will draw lessons from the years under review, identify successes, assess the effectiveness of the evolution of infoDev?s work program, and provide recommendations to the Secretariat, the World Bank and infoDev?s donors and partners on how to address any potential issues or shortcomings it identifies.
Activities: ITAD is undertaking this headline World Bank organisational and programme evaluation in partnership Universalia. Together ITAD and Universalia provide the necessary combination of expertise and experience expertise in managing independent external evaluations of World Bank trust funds and global partnership programmes, evaluating knowledge services, platforms and networks, and sector expertise in market development, innovation, job creation and pro-poor growth. The evaluation comprises: (a) a review of the effects of the significant changes in infoDev's external and internal contexts; (b) a review of the overall performance of the InfoDev programme; and (c) a review of infoDev's performance and capacities as an organisational entity. ITAD is providing three of the six core team members, including ITAD?s Principal Consultant, Robbie Gregorowski, as the lead evaluator for the review of the Creating Sustainable Businesses in the Knowledge Economy (CSBKE) - http://www.infodev.org/en/Topic.28.html. The evaluation methodology developed by ITAD and Universalia comprises: a Theory of Change (ToC) approach for addressing the questions about infoDev's overall programme effectiveness and the extent to which infoDev can credibly claim contribution to higher order objectives; and Universalia?s Institutional Organisational Assessment (IOA) framework for analysing the organisation's capacities, culture, environment and performance.
(DFID, UK, Bangladesh, Columbia, Ethiopia, Kenya, Qatar, Rwanda) - Deputy Team Leader / Evaluator
Project description: CDKN (www.cdkn.org) is a large and complex programme whose main purpose is to help decision-makers in developing countries design and deliver climate compatible development. CDKN do this by providing demand-led research and technical assistance, and channelling the best available knowledge on climate change and development to support policy processes at the country level. ITAD has been contracted by DFID to provide both mid-term and final independent external evaluations of CDKN.
ITAD's agile, comprehensive and complementary team comprises a Core Evaluation Team supported by 3 Country Counterparts / Regional Advisers and 4 Niche Experts, with unique skills and comprehensive expertise in Climate Compatible Development M&E from local level up to national and international institutions, as well as international thought leadership on theory of change, VfM approaches, and the evaluation of knowledge services.
Activities: The CDKN evaluation team has been asked to provide an assessment of: the extent to which CDKN is performing against its original Terms of Reference and logical framework; the impact of the programme to date within CDKN Dimensions of Change; the extent to which the CDKN approach and design ensures good value for money; and, to test the assumptions that underpin CDKN?s theory of change. ITAD?s overall approach and evaluation framing is based around theory of change, questioning of the critical assumptions underlying CDKN and a learning-based approach. ITAD designed a simple yet elegant and robust approach and method combing purposive and random sampling techniques, applied through a triangulated mixed-method involving interviews, desk-based research and country visits to Bangladesh, Columbia, Ethiopia, Kenya, Qatar, and Rwanda.
(UNISDR / UNOPS, UK, Switzerland, Belgium, Thailand, Panama, Egypt, Kenya) - Team Leader / Evaluator
Project description: PreventionWeb (www.preventionweb.net) is the United Nations International Strategy for Disaster Reduction (UNISDR) knowledge portal 'serving the information needs of the disaster reduction community.' Its objective is to coordinate the implementation of the Hyogo Framework for Action 2005-15: Building the resilience of Nations and Communities to disasters. The evaluation focusses on evaluating the effectiveness and impact of PreventionWeb and other UN information services and their ability to meet current and evolving information needs of existing and new DRR stakeholders. As such the evaluation combines a technical usability assessment of the website with a broader remit to 'position' UNISDR's strategy to respond to future DRR needs and target audiences.
Activities: As Team Leader, Robbie is responsible for the overall management and delivery of the evaluation. The evaluation is based around a theory of change approach whereby PreventionWeb's objective to coordinate DRR knowledge and information is placed in the context of a higher order development outcome in terms of the behavioural change expected of UNISDR's priority audience. UNISDR's strategy involving PreventionWeb is then assessed in relation to this desired outcome. Robbie leads a six-person team from inception (defining a mixed-method approach combining technical usability and accessibility assessments with more qualitative approaches including semi-structured interviews and key stakeholder focus groups), across six country visits (Geneva, Brussels, Bangkok, Nairobi, Cairo, and Panama), a period of desk-based analysis and triangulation, culminating in the delivery and presentation of a Final Report to UNISDR Special Representative to the Secretary General for Disaster Risk Reduction in Geneva.
(Swiss Development Cooperation (SDC) , Bangladesh) - CC expert / Trainer
Project description: Robbie Gregorowski and Julian Barr were contracted by Verulam Associates to plan and facilitate a 4-day climate change (CC) training course in Dhaka, Bangladesh in May 2012. The course was one of series of training and capacity building events under a Swiss Development Cooperation (SDC) contract to help Bangladesh to develop the capacity of Local Government Institutions (LGIs). Participants from three local government organisations attended the training course: 1 Rural Development Agency, 2 BARD - Bangladesh Academy for Rural Development, and 3 National Institute for Local Government.
Activities: The course was designed to provide a comprehensive introduction to climate change concepts and issues (mitigation and adaptation)as well as supporting local government participants to better integrate climate change concerns into their jobs. The objectives of the training were three-fold, to enable participants to: 1.Explain the likely main consequences of climate change on Bangladesh. 2.Identify how climate change can be mainstreamed the planning and budget cycle of local government. 3.Appreciate the main approaches to climate change adaption across a number of themes and sectors. To integrate the CC course objectives with the overall CDLG objective, the course was planned and delivered around a standard government planning / policy cycle: 1 Planning for CC, 2 Delivering practical responses to CC, 3 Budgeting for CC, and 4 M&E of CC effectiveness.
(CARE International, Worldwide) - Strategy reviewer
Project description: ITAD was commissioned by CARE International to undertake a review of their organisation-wide climate change sector strategy - the Climate Change Strategic Plan (CCSP). The TORs required ITAD to assess CARE's climate change results under the strategy as well as inform the evolution and strategic direction of the CCSP in the future. A particular focus of the review was on how best to 'mainstream' climate change concerns across CARE's network of 70 country offices and 12 Members so that, as a coherent whole, its field programming and advocacy activities efficiently, effectively and sustainably address the threat posed by climate change. The TORs also covered how best to raise CARE's profile and effectiveness as an international NGO advocating on climate change issues on behalf of climate vulnerable households and communities.
Activities: Robbie, ITAD's climate change M&E expert, was directly approached and engaged by the CARE Poverty Environment and Climate Change Network (PECCN) to conduct the CCSP review. Based on a mixed method combining interviews, web surveying and document analysis, he presented a practical and manageable set of recommendations aimed at further enhancing the management efficiency, climate outcomes and impact, and organisational sustainability of the strategy. Specific recommendations related to developing a more coherent and explicit theory of change for the CCSP, more clearly defining the respective roles and responsibilities of different stakeholders within the CARE 'family', and enhancing the CCSP?s results focus through the design of a simple yet robust M&E system to identify and credibly claim success.
(Rockefeller Foundation, Kenya, Uganda, USA, UK) - Evaluator
Project description: The Rockefeller Foundation seeks to help poor and vulnerable people benefit from more equitable economic growth and increased resilience to climate change. The assignment covered two interrelated bodies of work: the African Agriculture Resilience component of the larger Climate Change Resilience Initiative, and the Land-based Carbon Markets for Poverty Reduction Initiative. Given their complementary nature the Foundation now wishes to merge these two bodies of work under one Initiative called Climate Smart Rural Development (CSRD).
Activities: The purpose of this evaluation is to learn from the experience of implementation of the two components of work to guide the planning and management of these two components into the CSRD Initiative. ITAD examined the relevance, cost effectiveness, and efficiency of the two Initiatives as well as Rockefeller's niche and contribution to the evolution of the emerging ideas on agricultural resilience in African and the potential of carbon markets for poverty reduction. ITAD used a mixed methods approach starting with a detailed desk-based analytical review of the portfolio followed by field visits to selected grants in seven countries. A Theory of Change approach was used to assist Rockefeller establish a coherent results chain as well as improve the planning of the CSRD initiative through a better identification of risks and assumptions.
(DFID CDKN, UK) - Team Leader / Evaluator
Project description: Project description: The Climate and Development Knowledge Network (CDKN) is a five-year initiative funded by the DFID to assist developing countries respond to the challenges posed by climate change. It does this by providing research and technical assistance, and channelling the best available knowledge on climate change and development to support policy processes at the country level. A key feature of the CDKN is that it is demand led; it is responding to gaps and needs identified on the ground as it rolls out country engagement strategies. Services are being provided through a network of collaborating organisations and individuals around the globe. Knowledge Management (KM) is one of four main programme components, alongside research, technical assistance and partnerships. Priority audiences for CDKN's KM work are developing country decision-makers, and those who influence them, including policy advisers, researchers, civil society and the media. ITAD were engaged in a framework contract to provide evaluation services to CDKN. This included an assessment of the quality and usefulness of CDKN products.
Activities: The ITAD team, led by Robbie, is assisting CDKN with M&E and impact assessment across a range of KM activities. Robbie led the design and implementation of an experimental approach to assess both the 'quality' and 'usefulness' of CDKN knowledge products. This involved engaging a representative sample of climate change experts and CDKN priority stakeholders to review CDKN products according a range of determinants of quality and usefulness. The approach drew on emerging approaches to assessing knowledge services based upon the instrumental, conceptual and democratic use of knowledge. In addition, a tracer study of online knowledge brokers is being conducted in 2012.
(Post-War Reconstruction and Development Unit (PRDU), University of York, UK) - M&E Expert / Trainer
Project description: Robbie has an on-going relationship with the Post-War Reconstruction and Development Unit (PRDU) at the University of York to annually teach a series of three seminars to Masters students taking the MA in Post-war Recovery Studies. The seminar series entitled Evaluating Conflict Prevention and Peace-Building builds on ITADs project experience to address some of the key logistical and technical challenges associated with conducting evaluations in fragile states. The seminars introduced key concepts such as the OECD-DAC Evaluation Criteria and Fragile States Principles through group exercises, combined with case study examples to illustrate how appropriate evaluation tools and methods have been used in the field to overcome issues such as attribution gaps, incoherent theories of change, and assessing intangibles such as behavioural change.
Activities: Now in his 4th year of teaching, Robbie provides a day of expert training on M&E to support conflict prevention and peace-building introducing key tools and methods through group exercise - Contribution Analysis and Outcome Mapping as well as addressing context specific challenges and constraints including generating reliable primary data and engaging different stakeholder groups.
(GDNet / DFID, UK) - M&E Consultant
Project description: ITAD is assisting GDNet to clearly map out and strengthen its strategic direction and objectives over the next 5 years - www.gdnet.org/. The strategy will explain how GDNet will work as a research institution in the policy arena, aiming to inform policy in developing countries with knowledge generated by researchers based in those countries. ITAD is assisting GDNet to develop a strong theory of change about how what it does would have an effect. This will then be used to remodel its activities through a redrafted logframe and a more outcome-focused M&E system.
Activities: GDNet work at the nexus between research and policy. ITAD is helping them to more rigourously monitor and evaluate their policy influence. Assisted GDNet to clearly map out and strengthen its logframe and establish a robust baseline. The logframe will explain how GDNet will work as a research institution in the policy arena, aiming to inform policy in developing countries with knowledge generated by researchers based in those countries. Assisting GDNet to design and test the internal rigour of its logframe through a process to define indicators, ascertain robust sources of data, and establish reliable baselines for each output. Establishing each baseline involves the design and implementation of a variety of data collection methods including panel-surveys, appreciative inquiry based on the Most Significant Change (MSC) technique, bibliometric sampling exercises, and disaggregated questionnaires of user perceptions.
(DFID / Panos, UK) - Evaluator
Project description: ITAD were selected to undertake an appreciative evaluation of the Panos Relay Programme. Funded under the DFID Research Uptake Team portfolio of knowledge service programmes, Panos Relay aims to strengthen and promote the approaches to building the capacity of media to report on research. In addition to the evaluation, ITAD were requested to: facilitate the development of Relay's Theory of Change (ToC); help Panos test and refine their approach to action research; and design, build and train the team in monitoring, evaluation and learning. The assignment involved country field visits to Zambia, Malawi, Uganda, Kenya, and India.
Activities: The services ITAD provided included: designing an approach to appreciative evaluation based around USAID's After Action Review; facilitating a workshop of Panos staff to discuss and agree a Relay theory of change; desk-based document analysis; a series of country office and field visits supported by interviews and focus groups with programme staff, and key stakeholders including journalists, researchers and policy makers; designing and conducting a series of M&E training workshops for Relay programme field office staff to build their capacity in M&E, work with them to adapt the Relay ToC to local contexts, and ensure they can operate the Panos Relay M&E system based on an Outcome Mapping approach.
(Multiple framework donors including EC, Sida, Danida, AFD, Norad, and Sida, Multiple - Ghana, Kenya, South Africa, Switzerland) - Evaluator
Project description: ITAD was selected by a group of framework donors including Sida, AFD, CIDA, and NORAD to undertake an external review of the International Union for Conservation of Nature (IUCN). The headline, multi-country review comprised assessments of: (i) the IUCN business model and organisational strategy, (ii) the niche, relevance and effectiveness of the delivery of IUCN's programme supporting biodiversity and conservation, and, (iii) the level of Member and partner engagement in the union.
Activities: As principle evaluator, coordinated and managed a small, multi-national, multi-skilled team with skills in organisational change, governance reform, environment and sustainable development, and policy influence. The review drew heavily on ITAD's experience in the evaluation of multi-national policy research organisations operating in the environment and climate change sector. The assessment of IUCN's business model employed a mixed-method approach based around the McKinsey 7-S Model organisational assessment framework. The review of IUCN's programme of work relating to environment and conservation applied a theory of change approach to IUCN's existing Results Based Management system to better assess IUCN's contribution to policy influence. Both objectives combined a mixed method approach involving face to face and telephone interviews, focus groups, web surveys, and document analysis with 11 country visits (Burkina Faso, Ghana, Kenya, South Africa, Thailand, India, Costa Rica, Guatamala, Mexico, United States, and IUCN's HQ in Geneva). The review informed recommendations on IUCN's future strategic direction and specifically, the framework donors role in them, feeding into the development of IUCN's 2013 16 Programme.
(European Commission, UK) - Evaluator
Project description: The consortium, led by AEA Europe with ITAD as a member, were commissioned by the European Commission (Directorate-General for Climate Action) to assess the existing Measurement, Reporting and Verification (MRV) frameworks on Climate Finance at the EU level.
The main objective of the study was to analyse the current MRV situation and the challenges for establishing improved reporting methodologies. The results of the research were expected to be highly relevant in the context of the discussions on future EU and international climate finance requirements.The findings also contributed to forming EU views and positions on MRV of finance in the ongoing UNFCCC negotiations, in particular the feasibility of developing a transparent, robust and harmonised framework for MRV of climate finance on the EU / international level.
Activities: ITAD was charged with engaging the views developing country experts on 2 main aspects of MRV:
1. The role and expectation of developing countries in the design of a new or improvement to existing MRV systems.
2. The role of developing countries in Verification of climate finance. Verification of climate finance has not received the same attention as measuring and reporting. Existing systems such as the UNFCCC and OECD DAC do not provide specific verification procedures or guidelines regarding data that exist or should be collected.
Robbie conducted extensive background research on developing countries views on MRV, enaged a significant sample of developing country climate finance experts, and produced a detailed synthesis report to reflect these views.
(Sida, Sweden, Tanzania, Thailand, UK) - Evaluator
Project description: The Stockholm Environment Institute (SEI) is one of the worlds leading international environment and development research organizations. SEI is largely funded by Sida with whom it works to address key international priorities such as: mitigating and adapting to climate change; and, protecting and transforming vulnerable communities who are the victims of rapid social and environmental change. Based on the company's experience conducting headline organizational evaluations and our track record assessing the impact of research on policy processes, ITAD was tasked with both reflecting on SIDA's past institutional cooperation with SEI and making recommendations on the future direction of collaboration between Sida and SEI.
Activities: Devised mixed-method evaluation approach and framework drawing on ITADs experience assessing uptake pathways on a range of DFID-funded research programmes. The approach was based on establishing a shared understanding of the Theory of Change (ToC) underlying Sida support to SEI and then assessing the extent to which there was evidence to support that ToC. The organizational evaluation assessed SEIs institutional capacity according to an internationally recognized organizing framework - the McKinsey 7-S Model. SEI institutional capacity was assessed in a participatory process of stakeholder engagement according to strategy, structure, systems, staff, skills, style, and shared values. Tools engaged during the evaluation included: key stakeholder SWOT analysis; semi-structured face-to-face and telephone interviews; a web survey of target stakeholders; economic and financial analyses; document review; and field visits.
(UK Ministry of Justice, UK and China) - Evaluator
Project description: ITAD was engaged by the UK Ministry of Justice (MoJ) to evaluate 3 MoJ-funded international programmes designed for young professionals identified as future leaders in their respective countries: 1) The John Smith Memorial Trust Fellowship Programme focussing on the South Caucuses; 2) The Training Scheme for Young Chinese Judges delivered by the Great Britain China Centre; and, 3) The Lord Chancellor's Training Scheme for Young Chinese Lawyers delivered by the China Law Council. The aim of the evaluation was to assess outcomes and impact to date in order for MoJ to make decisions about the future of its involvement and funding of the programmes. ITAD designed the evaluation approach and methodology which involved both structured and semi-structured face-to-face and telephone interviews, seperate online questionnaires for the alumni of each programme, and field visits to London and Beijing to engage key programme stakeholders. Impact was assessed through Contribution Analysis, developing and agreeing an ex ante Theory of Change and testing its logic through accumulating evidence to support and question the assumptions on which the theory was based.
Activities: Key activities included:
- Overall approach and methodology design
- Semi-structured face to face and telephone interviews with key stakeholders including a number of senior UK politicians, political journalists, business leaders, and legal professionals
- Beijing field visit to engage high ranking government officials in the Supreme People's Court of the People's Republic of China
- Online survey / questionnaire design and implementation
- Data analysis and application of contribution analysis methodology
- Report write up and presentation to MoJ counterparts in London
(DFID, UK and Yemen) - Overall Project Manager
Project description: SFD aims to contribute to poverty alleviation by improving access of low-income groups to basic social and economic services community-level infrastructure, small and micro-enterprise development, and grassroots training and capacity building.
Activities: Managed and coordinated both impact and institutional evaluations of the SFD. Specific activities involved the design of QUAL and QUANT research methodologies to produce sample data on households, communities, and programme activities in order to evaluate efficiency, effectiveness, impact, and sustainability. Also responsible for providing guidance and quality assurance to local survey teams in the field and analysing the data produced on both SFD projects and beneficiary households. Ultimately responsible for successful submission and sign off of all project deliverables with the DFID.
(DFID, Worldwide) - Framework Contract Manager
Project description: The UK Government is actively involved in peace-building, rehabilitation and development activities in many conflict and disaster prone states, notably Iraq and Afghanistan. These environments are fragile, rapidly changing and unpredictable. The key agencies DFID, MoD, FCO, and the Stabilisation Unit require responsive tailored services to meet rapidly changing objectives. The Reconstruction and Development Consortium (RDC) supports these agencies through the rapid provision of high quality social development skills and expertise in the context of stabilisation and peace building.
Activities: Coordinated and delivered social development services (policy research, project appraisal, impact evaluation, M&E systems design) to support peace-building, rehabilitation and development activities in many conflict and disaster prone states, notably Afghanistan and Yemen through the DFID-funded Social Development in Conflict-Affected Environments framework contract. The consortium's technical focus covered basic service delivery, enhanced aid effectiveness, social protection programming, and, economic, social and development policy and planning. HEAT trained by DFID for deployment in conflict-affect countries for this role.
(DFID, Bangladesh) - Consultant Monitoring and Evaluation & Project Management
Project description: The Chars Livelihoods Programme (CLP) is a $100m DFID-funded headline multi-sectoral development programme targeting extreme poor households in Bangladesh. CLP focuses on reducing extreme poverty and vulnerability and strengthening voice through a bottom-up planning process and grant dispersal scheme.
Activities: Responsible for multiple in-country and desk-based technical inputs covering improved beneficiary targeting, review of programme-level M&E systems, revised programme design, and enhanced knowledge management and communications. Between November and December 2007 managed an M&E assignment evaluating the quality and usability of the beneficiary monthly monitoring dataset. Assisted CLP M&E team to devise research methodology to clean and analyse the initial dataset and provided recommendations aimed at improving quantitative and qualitative data reliability and usability in the future.
(DFID / Stabilisation Unit, Afghanistan and UK) - Project Manager
Project description: Coordinated and managed a high profile piece of political economy policy research to serve as a baseline in determining UK Government strategy, priorities and programming decisions for involvement in Afghanistan over the next 5 years. The research combined a literature review, fieldwork, and desk-based studies.
Activities: Assembled and managed a team of approximately 25 of the worlds leading experts on Afghanistan to conduct a Political Economy Analysis, a Strategic Conflict Assessment, a Growth Diagnostic, and a Poverty, Gender and Social Exclusion Analysis. Responsible for all aspects of project oversight from policy research coordination to liaison with UK Government Departments (DFID, MoD, FCO), and final editing and approval of deliverables.
(World Bank, Afghanistan) - Consultant Coordination and Quality Assurance
Project description: Engaged as part of the contract to provide Management Support Services assisting the Afghan Ministry of Rural Rehabilitation and Development in implementing the headline World Bank-funded $750m rural rehabilitation and grassroots governance programme, the National Solidarity Programme (NSPII).
Activities: Supported the handover between the departing team, the client, and incoming team of consultants and was responsible for reviewing existing datasets, co-ordination and quality assurance of various programme reports, and the drafting of terms of reference for short term technical assistance assignments. Developed particular experience in large-scale multi-sectoral programme management, programme-level M&E systems, and dissemination of new knowledge and best practice.
- Capacity development: how should we reframe it for the digital age? (2014)
- Learning about Theories of Change for the Monitoring and Evaluation of Research Uptake (2013)
Institute of Development Studies Practice Paper
Barnett, C. and Gregorowski, R.
- Climate Change M&E for Excluded Populations (2012)
Robbie Gregorowski & Julian Barr