Course Introduction
Realist evaluation is a theory-driven approach to programme evaluation designed to explain how, why, for whom, and under what circumstances interventions generate particular results. Rather than focusing exclusively on whether programme targets were achieved, it investigates the underlying processes, human responses, institutional arrangements, and contextual conditions that influence outcomes. This course equips monitoring, evaluation, research, and development professionals with the conceptual understanding and practical skills required to apply realist evaluation principles to complex programmes, strengthen causal explanations, and produce evidence that supports adaptive management, accountability, and informed decision-making.
The foundation of realist evaluation is the recognition that programmes do not automatically produce results simply because activities have been implemented or resources have been provided. Interventions introduce resources, opportunities, information, incentives, or services that people interpret and respond to differently depending on their circumstances. These responses interact with social, organisational, economic, cultural, and political conditions to generate intended or unintended outcomes. Participants examine realist philosophy, generative causation, programme theory, and the distinction between intervention activities and the underlying mechanisms through which change occurs. They learn to investigate the relationships between programme resources, stakeholder reasoning, contextual influences, and observable results.
A central component of the training is Context-Mechanism-Outcome (CMO) analysis, which provides a structured way to formulate and investigate explanations of programme performance. Context refers to the circumstances and conditions influencing whether and how a mechanism operates; mechanism concerns the underlying processes and responses triggered by programme resources; and outcome refers to the resulting patterns of change. Participants learn to develop clear CMO configurations, distinguish plausible mechanisms from activities or outputs, and formulate hypotheses that can be examined using empirical evidence. Practical examples demonstrate how the same intervention may produce different outcomes across communities, institutions, population groups, and implementation settings.
The course provides a systematic approach to developing, testing, and refining initial programme theories. Participants learn to identify assumptions embedded in programme designs, translate theories of change into realist explanatory propositions, and determine what evidence would support, challenge, or refine each proposition. They explore how to select information-rich cases, identify relevant stakeholder groups, develop realist interview questions, and combine qualitative and quantitative evidence. Through structured exercises, participants practise comparing outcome patterns, investigating alternative explanations, examining contradictory findings, and refining CMO configurations to produce explanations that are grounded in the available evidence rather than unsupported assumptions.
Realist evaluation requires analytical flexibility, methodological transparency, and careful attention to research quality. The course addresses practical challenges such as incomplete programme records, limited stakeholder access, researcher bias, competing explanations, inconsistent implementation, and differences in participants' experiences. Participants examine how interviews, focus groups, document reviews, surveys, monitoring data, observations, and administrative records can be integrated to test programme theories. They also explore realist sampling, iterative data collection, retroductive reasoning, thematic analysis, and evidence triangulation. The training draws on RAMESES II quality and reporting standards to support transparent documentation of how evidence is used to confirm, refute, or refine proposed explanations.
Emerging applications of realist evaluation are incorporated throughout the programme, including complexity-aware evaluation, adaptive programming, systems thinking, digital evidence collection, and responsible use of artificial intelligence in qualitative data management. Participants consider how contextual changes, institutional relationships, feedback loops, and unequal power structures influence programme mechanisms and outcomes. They also examine ethical requirements, participant confidentiality, secure data management, algorithmic bias, and the limitations of automated analytical tools. By the end of the course, participants will be able to develop a realist evaluation plan, construct and test CMO configurations, interpret differences in programme outcomes, and communicate practical recommendations about what works, for whom, in which circumstances, and why.
Duration
5 days
Who Should Attend
-
Monitoring, evaluation, accountability and learning (MEAL) officers responsible for evaluating programme outcomes and explaining variations in performance.
-
Programme managers and project coordinators seeking to understand how interventions generate results under different implementation conditions.
-
Evaluation specialists and independent consultants conducting theory-based, outcome-focused, and complex programme evaluations.
-
Development researchers and social scientists interested in causal mechanisms, contextual analysis, and realist research methodologies.
-
NGO and civil society professionals evaluating community development, livelihoods, governance, and social change interventions.
-
Donor representatives and grant managers commissioning evaluations and assessing the credibility of programme theories.
-
Government monitoring and evaluation officers examining policy implementation, institutional reform, and public service delivery outcomes.
-
Programme design specialists developing theories of change, results frameworks, implementation strategies, and learning agendas.
-
Public health professionals evaluating health systems strengthening, behaviour change, service delivery, and community health programmes.
-
Education specialists investigating how teaching interventions, institutional conditions, and learner responses influence educational outcomes.
-
Humanitarian practitioners evaluating emergency response, resilience, recovery, and protection programmes in complex environments.
-
Gender equality, disability inclusion, and social inclusion specialists investigating differences in outcomes across population groups.
-
Research team leaders responsible for qualitative data collection, analytical frameworks, and evidence quality assurance.
-
Knowledge management and organisational learning professionals translating evaluation findings into programme adaptations.
-
Policy analysts examining how political, economic, cultural, and institutional conditions influence policy outcomes.
-
Data analysts and qualitative researchers undertaking thematic analysis, evidence triangulation, and theory refinement.
-
Academic researchers and postgraduate students conducting realist research or theory-driven programme evaluation.
-
Institutional development advisers evaluating capacity strengthening, organisational change, and governance interventions.
-
Monitoring and learning advisers supporting adaptive management and continuous programme improvement.
-
Professionals responsible for designing, commissioning, implementing, or reviewing realist evaluations and CMO-based analytical studies.
Course Objectives
-
Explain the philosophical foundations, principles, assumptions, and practical applications of realist evaluation, including its emphasis on generative causation and context-dependent programme outcomes.
-
Distinguish contextual conditions, generative mechanisms, intervention resources, stakeholder reasoning, and outcome patterns when developing explanations of programme performance.
-
Develop initial realist programme theories by identifying intervention assumptions, causal pathways, relevant actors, expected mechanisms, and the conditions under which change is anticipated.
-
Construct clear Context-Mechanism-Outcome configurations that articulate plausible relationships between programme circumstances, participant responses, and intended or unintended results.
-
Formulate realist evaluation questions and hypotheses that investigate what works, for whom, in which circumstances, and through which mechanisms.
-
Design appropriate realist evaluation methodologies, including case selection, stakeholder sampling, interview guides, evidence collection plans, and procedures for iterative theory testing.
-
Apply realist data collection and analytical techniques, including retroductive reasoning, thematic coding, pattern comparison, triangulation, and the systematic examination of alternative explanations.
-
Integrate qualitative and quantitative evidence to investigate differences in outcomes across contexts, participant groups, implementation arrangements, and institutional environments.
-
Apply ethical safeguards, methodological quality criteria, and transparent reporting practices to ensure that CMO configurations and revised programme theories are supported by credible evidence.
-
Produce actionable realist evaluation findings and recommendations that inform programme adaptation, resource allocation, policy improvement, institutional learning, and future intervention design.
Comprehensive Course Outline
Module 1: Foundations and Principles of Realist Evaluation
-
Explain the origins, philosophical foundations, and central assumptions of realist evaluation, including the importance of causal explanation and context-sensitive evidence.
-
Compare realist evaluation with conventional outcome evaluation, experimental approaches, contribution analysis, theory-based evaluation, and other explanatory methodologies.
-
Examine generative causation and explain how interventions provide resources or opportunities that trigger different responses among individuals and groups.
-
Analyse the relevance of realist evaluation to complex development programmes where implementation conditions, stakeholder behaviour, and external influences shape results.
Module 2: Programme Theory Development and Realist Evaluation Questions
-
Examine programme documents, theories of change, implementation strategies, and existing evidence to identify the assumptions underlying expected programme outcomes.
-
Translate broad programme objectives into realist evaluation questions that investigate how outcomes emerge, for whom interventions work, and under which circumstances.
-
Develop initial realist programme theories that specify expected mechanisms, contextual conditions, stakeholder responses, intermediate changes, and anticipated outcomes.
-
Identify priority assumptions and evidence gaps to guide evaluation scope, case selection, data collection, and subsequent theory refinement.
Module 3: Understanding Context, Mechanisms and Outcomes
-
Identify contextual conditions such as institutional capacity, social norms, resource availability, political incentives, cultural expectations, and implementation arrangements.
-
Distinguish generative mechanisms from intervention activities by examining how programme resources influence stakeholders' reasoning, choices, motivations, and behaviour.
-
Define outcome patterns that capture intended and unintended changes, including differences in reach, participation, implementation quality, equity, and sustainability.
-
Examine how the interaction between context and mechanisms can explain divergent results across communities, institutions, implementation sites, and participant groups.
Module 4: Constructing Context-Mechanism-Outcome Configurations
-
Develop CMO configurations that express explicit hypotheses about how particular contextual conditions influence mechanisms and generate specified outcome patterns.
-
Practise distinguishing context, mechanism, and outcome elements using realistic examples from health, education, livelihoods, governance, and community development.
-
Construct CMO tables and causal diagrams that connect programme resources, actor responses, contextual influences, and observed changes in a transparent analytical structure.
-
Identify weak or incomplete configurations, challenge unsupported causal assumptions, and refine explanatory statements to make them clear, plausible, and testable.
Module 5: Realist Evaluation Design, Sampling and Data Collection
-
Develop realist evaluation protocols that align research questions, programme theories, CMO hypotheses, data sources, analytical procedures, and reporting requirements.
-
Select information-rich cases and stakeholder groups that provide opportunities to investigate contextual variation and test competing programme explanations.
-
Design realist interview guides, focus group protocols, observation checklists, and document review tools that explore contexts, mechanisms, and outcomes systematically.
-
Integrate qualitative and quantitative evidence through interviews, surveys, monitoring data, administrative records, observations, and programme documentation.
Module 6: Realist Analysis, Retroductive Reasoning and Theory Refinement
-
Apply retroductive reasoning to move from observed outcome patterns toward plausible underlying mechanisms and the conditions that enable them to operate.
-
Organise and code qualitative data according to initial programme theories while remaining open to emerging themes, unexpected findings, and alternative explanations.
-
Compare predicted and observed outcomes to determine whether proposed CMO configurations are supported, challenged, incomplete, or require further investigation.
-
Refine realist programme theories iteratively by integrating new evidence, reviewing earlier assumptions, and documenting how explanatory conclusions have developed.
Module 7: Contextual Variation, Comparative Analysis and Complex Systems
-
Compare CMO configurations across sites, population groups, institutions, and implementation settings to explain differences in programme performance.
-
Examine how social norms, gender relations, power dynamics, institutional incentives, resource constraints, and political conditions shape stakeholder responses.
-
Investigate feedback loops, interdependencies, adaptive behaviour, external shocks, and unintended consequences within complex development interventions.
-
Use cross-case comparison and systems-oriented thinking to identify context-dependent lessons and assess the conditions under which findings may transfer elsewhere.
Module 8: Evidence Triangulation, Quality Assurance and Ethical Practice
-
Triangulate interview findings, administrative data, programme records, survey results, observations, and independent evidence to strengthen realist explanations.
-
Assess source credibility, methodological limitations, contradictory accounts, researcher positionality, confirmation bias, and the uncertainty associated with causal interpretations.
-
Apply informed consent, confidentiality, safeguarding, data minimisation, and secure data management procedures throughout realist evaluation activities.
-
Use RAMESES II quality and reporting standards to document theory development, sampling decisions, analytical processes, evidence integration, and CMO interpretation.
Module 9: Emerging Applications, Digital Methods and Responsible AI
-
Explore how digital data collection, remote interviews, administrative information systems, and online platforms can strengthen contextual analysis and evidence collection.
-
Assess the appropriate use of AI-assisted transcription, translation, document review, and qualitative coding while maintaining human oversight and analytical transparency.
-
Examine emerging applications of realist evaluation in adaptive management, implementation science, organisational learning, and complexity-aware development programming.
-
Address digital exclusion, algorithmic bias, privacy risks, automated interpretation errors, and the potential loss of contextual meaning in digitally supported analysis.
Module 10: Reporting, Recommendations and Realist Evaluation Utilisation
-
Structure realist evaluation reports around the evaluation questions, initial programme theory, CMO configurations, research methods, findings, and revised explanatory conclusions.
-
Present evidence-supported CMO statements, comparative findings, contextual explanations, and methodological limitations in clear and accessible reporting formats.
-
Translate realist findings into practical recommendations concerning programme targeting, implementation adjustments, resource allocation, institutional capacity, and future evaluation priorities.
-
Develop a realist evaluation action plan covering theory refinement, stakeholder engagement, learning dissemination, management response, and application of findings to programme improvement.
Training Approach
This course will be delivered by our skilled trainers who have vast knowledge and experience as expert professionals in the fields. The course is taught in English and through a mix of theory, practical activities, group discussion and case studies. Course manuals and additional training materials will be provided to the participants upon completion of the training.
Tailor-Made Course
This course can also be tailor-made to meet organization requirement. For further inquiries, please contact us on: Email: training@upskilldevelopment.com Tel: +254 721 331 808
Training Venue
The training will be held at our Upskill Training Centre. We also offer training for a group (at a discount of 10% to 50%) at requested location all over the world. The Onsite course fee covers the course tuition, training materials, two break refreshments, buffet lunch, airport transfers, Upskill gift package, and guided tour.
Visa application, travel expenses, dinners, accommodation, insurance, and other personal expenses are catered by the participant
Certification
Participants will be issued with Upskill certificate upon completion of this course.
Airport Pickup and Accommodation
Airport pickup and accommodation is arranged upon request. For booking contact our Training Coordinator through Email: training@upskilldevelopment.com, +254 721 331 808
Terms of Payment:
Unless otherwise agreed between the two parties’ payment of the course fee should be done 3 working days before commencement of the training so as to enable us to prepare better.








