Course Introduction
Evaluation sampling strategies and sample size determination are fundamental to producing reliable, credible and useful evidence about programmes, projects and interventions. The quality of evaluation findings depends significantly on how participants, households, institutions, communities or other units of analysis are selected and whether the chosen sample is appropriate for the evaluation objectives. This course equips participants with the knowledge and practical skills required to design defensible sampling plans, select suitable sampling methods and determine sample sizes that balance statistical requirements, methodological rigour, available resources and operational realities.
The course introduces the principles of sampling theory and the relationship between target populations, sampling frames, units of analysis, sample selection and the interpretation of findings. Participants examine the differences between probability and non-probability sampling and learn when each approach is appropriate for a particular evaluation question. The training covers simple random sampling, systematic sampling, stratified sampling, cluster sampling, multistage sampling, purposive sampling, quota sampling, convenience sampling and snowball sampling. Emphasis is placed on understanding the strengths, limitations and potential biases of each method, including the implications for representativeness, statistical inference and the transferability of qualitative findings.
A major component of the programme focuses on quantitative sample size determination. Participants learn how population size, expected indicator prevalence, confidence level, margin of error, statistical power, effect size and anticipated non-response influence sample size requirements. They explore calculations for estimating proportions, comparing groups, detecting changes over time and planning baseline, midterm and endline surveys. The course also examines finite population correction, design effects associated with clustered samples, subgroup reporting requirements and adjustments for incomplete responses. Practical exercises demonstrate how to select appropriate assumptions, document calculation decisions and avoid common mistakes that can result in underpowered studies or unnecessarily expensive data collection.
The training also addresses sampling strategies for qualitative evaluations and mixed-methods research. Participants learn how purposive sampling, maximum variation sampling, criterion-based selection, key informant selection and theoretical sampling can support rich and contextually meaningful evidence. The programme explores concepts such as information power, thematic saturation, diversity of perspectives and the inclusion of negative or contrasting cases. Participants examine why qualitative sample sizes should be justified by the research purpose, population diversity, complexity of the inquiry and quality of collected information rather than by applying statistical formulas designed for quantitative surveys. They also learn how qualitative and quantitative sampling plans can complement one another within a mixed-methods evaluation.
Practical implementation considerations are integrated throughout the course. Participants learn to construct sampling frames, establish eligibility criteria, select respondents systematically, manage replacement and non-response procedures, and document deviations from the approved sampling plan. The training addresses the challenges of incomplete beneficiary lists, mobile populations, geographically dispersed communities, hard-to-reach groups, unequal selection probabilities and limited fieldwork resources. Participants also examine how gender, age, disability, location and socioeconomic characteristics influence sampling decisions, and how appropriate stratification and oversampling can improve representation of smaller or underrepresented groups when supported by a suitable design and analysis plan.
By the end of the course, participants will be able to prepare a defensible sampling strategy and sample size justification for a programme evaluation, baseline survey, endline assessment, impact evaluation or other applied research assignment. Through practical calculations, case studies and sampling-plan development exercises, they will strengthen their ability to assess methodological feasibility, identify potential sources of bias, plan for non-response and explain the limitations of their designs. The course promotes responsible use of evidence by ensuring that sampling decisions are transparent, technically appropriate and aligned with the evaluation questions, analytical requirements, ethical considerations and intended use of findings.
Duration
5 days
Who Should Attend
-
Monitoring, Evaluation, Accountability and Learning (MEAL) officers responsible for designing evaluation samples and field surveys.
-
Monitoring and evaluation managers overseeing baseline, midterm, endline and completion assessments.
-
Evaluation specialists and consultants who prepare sampling strategies and methodological proposals.
-
Research officers responsible for quantitative and qualitative study design.
-
Data analysts and statisticians involved in sample size calculations and survey analysis.
-
Programme managers commissioning evaluations and reviewing sampling plans.
-
Survey coordinators and field research supervisors responsible for respondent selection and data collection.
-
Impact evaluation practitioners designing comparison groups and assessing programme effects.
-
Baseline and endline assessment teams conducting household, beneficiary or institutional surveys.
-
Public-sector monitoring and evaluation officers assessing government programmes and service delivery.
-
NGO and civil society organisation professionals responsible for programme evidence and accountability.
-
Development consultants conducting needs assessments, outcome evaluations and impact studies.
-
Humanitarian assessment specialists working with displaced, mobile or hard-to-reach populations.
-
Health, education, agriculture, livelihoods and social protection research professionals.
-
Gender equality and social inclusion specialists working to improve representation in evaluation studies.
-
Academic researchers and postgraduate professionals conducting applied research and evaluation.
-
Data collection supervisors responsible for sampling implementation, quality control and non-response management.
-
Donor-funded programme personnel reviewing evaluation designs, sample adequacy and evidence quality.
Course Objectives
-
Explain fundamental sampling concepts, including target population, sampling frame, unit of analysis, selection probability, sampling error and representativeness, and their implications for evaluation findings.
-
Distinguish probability and non-probability sampling approaches and select methods that appropriately address evaluation questions, population characteristics, data requirements and operational constraints.
-
Construct sampling frames, define eligibility criteria and develop transparent respondent-selection procedures that reduce selection bias and support reproducible field implementation.
-
Calculate quantitative sample sizes using appropriate assumptions for confidence levels, margins of error, expected proportions, statistical power, effect sizes and population characteristics.
-
Apply sample size adjustments for finite populations, cluster design effects, unequal selection probabilities, anticipated non-response and requirements for subgroup analysis.
-
Develop qualitative sampling strategies using purposive selection, maximum variation, criterion-based sampling and information adequacy principles appropriate to the evaluation context.
-
Design stratified, cluster and multistage sampling procedures for geographically dispersed populations while accounting for sampling efficiency, logistical costs and analytical requirements.
-
Integrate gender, age, disability, geographic location and other relevant characteristics into sampling plans to improve representation and enable meaningful disaggregated analysis.
-
Identify sampling bias, coverage errors, non-response, contamination and other threats to validity, and develop practical procedures to mitigate and transparently report their effects.
-
Prepare and justify a complete sampling plan that connects evaluation questions, sampling methods, sample size assumptions, fieldwork procedures, analysis requirements, ethical safeguards and available resources.
Comprehensive Course Outline
Module 1: Foundations of Evaluation Sampling
-
Define sampling terminology, including population, sample, sampling unit, sampling frame, parameter, statistic and sampling error, within applied evaluation contexts.
-
Explain how sampling decisions influence the credibility, precision, representativeness and generalisability of evaluation findings.
-
Distinguish a census from a sample-based study and assess the circumstances in which each approach is practical and appropriate.
-
Identify common sampling problems, including incomplete population lists, selection bias, undercoverage, non-response and inappropriate generalisation.
Module 2: Probability and Non-Probability Sampling Strategies
-
Apply simple random and systematic sampling procedures to select participants using transparent and reproducible selection rules.
-
Design stratified sampling plans that ensure appropriate coverage of important population groups and support planned subgroup analysis.
-
Examine cluster and multistage sampling approaches for geographically dispersed populations and understand their implications for sampling precision.
-
Compare purposive, convenience, quota, snowball and maximum variation sampling for qualitative, exploratory and other non-probability evaluation designs.
Module 3: Defining Populations and Constructing Sampling Frames
-
Define the target population, accessible population, sampling unit and eligibility criteria in accordance with evaluation objectives and questions.
-
Assess sampling-frame completeness, accuracy, duplication and coverage limitations before selecting the sample.
-
Establish practical procedures for updating beneficiary lists, selecting institutions or communities and managing hard-to-reach population groups.
-
Document inclusion, exclusion, replacement and respondent-selection procedures to promote consistency and transparency during field implementation.
Module 4: Statistical Foundations of Sample Size Determination
-
Explain confidence levels, margins of error, variability, expected proportions and the relationship between sample size and estimation precision.
-
Calculate initial sample sizes for estimating population proportions and means using assumptions appropriate to the indicator and evaluation design.
-
Apply finite population correction when the population is sufficiently small relative to the calculated sample and the sampling design permits it.
-
Interpret sample size outputs and assess whether the proposed sample can meet the evaluation's required precision and reporting objectives.
Module 5: Sample Size for Comparisons and Impact Evaluations
-
Determine sample size requirements for comparing intervention and comparison groups using appropriate assumptions about effect size and outcome variability.
-
Explain statistical power, significance levels, minimum detectable effects and their influence on the ability to identify meaningful programme changes.
-
Assess sample size requirements for baseline and endline comparisons, repeated measurements and evaluations involving multiple study groups.
-
Identify circumstances requiring specialist statistical design, including complex randomisation, clustered interventions, multiple outcomes and attrition-sensitive studies.
Module 6: Cluster Sampling, Design Effects and Non-Response Adjustments
-
Explain how within-cluster similarity, unequal selection probabilities and multistage selection affect sample precision and design efficiency.
-
Estimate design effects and adjust sample size requirements when using clustered or otherwise complex sampling procedures.
-
Calculate gross sample requirements by accounting for anticipated non-response, ineligibility and incomplete interviews without confusing these adjustments with increases in statistical power.
-
Develop non-response tracking, callback, field verification and approved replacement procedures that protect the integrity of the sampling design.
Module 7: Qualitative Sampling and Mixed-Methods Integration
-
Select qualitative participants through purposive, criterion-based, maximum variation and other strategies suited to the research questions.
-
Assess qualitative sample adequacy using information power, thematic saturation, population diversity and the depth of evidence required.
-
Integrate qualitative and quantitative samples within mixed-methods designs to explain observed patterns, explore experiences and strengthen interpretation.
-
Establish transparent criteria for selecting key informants, focus group participants, case studies and contrasting or negative cases.
Module 8: Inclusion, Ethics and Sampling Bias Management
-
Identify how gender, age, disability, socioeconomic status, geographic location and other characteristics affect representation in evaluation samples.
-
Use stratification and justified oversampling to improve the inclusion of smaller groups while planning appropriate weighting and analysis where needed.
-
Apply informed consent, confidentiality, safeguarding and ethical recruitment procedures when selecting respondents and collecting sensitive information.
-
Assess selection bias, coverage error, non-response bias and other threats to validity, and document mitigation measures and residual limitations.
Module 9: Sampling Implementation, Quality Control and Analysis Planning
-
Prepare field sampling instructions covering random selection, respondent identification, eligibility verification, contact attempts and documentation.
-
Establish quality-control procedures to verify selection records, detect substitutions, monitor non-response and investigate deviations from the approved plan.
-
Develop analysis plans that account for sampling weights, stratification, clustering, subgroup estimates and the design of the collected data.
-
Document sampling assumptions, implementation changes, limitations and implications for interpreting and reporting evaluation results.
Module 10: Practical Sample Size Calculation and Sampling Plan Development
-
Calculate sample sizes for realistic evaluation scenarios using appropriate assumptions, formulas, statistical tools and documented decision criteria.
-
Develop complete sampling plans specifying populations, frames, selection methods, sample sizes, allocation procedures and fieldwork responsibilities.
-
Conduct peer reviews to identify weaknesses in assumptions, calculation methods, sample coverage, inclusion measures and resource feasibility.
-
Present and defend a final sampling strategy, explaining its strengths, limitations, implementation requirements and alignment with evaluation objectives.
Training Approach
This course will be delivered by our skilled trainers who have vast knowledge and experience as expert professionals in the fields. The course is taught in English and through a mix of theory, practical activities, group discussion and case studies. Course manuals and additional training materials will be provided to the participants upon completion of the training.
Tailor-Made Course
This course can also be tailor-made to meet organization requirement. For further inquiries, please contact us on: Email: training@upskilldevelopment.com Tel: +254 721 331 808
Training Venue
The training will be held at our Upskill Training Centre. We also offer training for a group (at a discount of 10% to 50%) at requested location all over the world. The Onsite course fee covers the course tuition, training materials, two break refreshments, buffet lunch, airport transfers, Upskill gift package, and guided tour.
Visa application, travel expenses, dinners, accommodation, insurance, and other personal expenses are catered by the participant
Certification
Participants will be issued with Upskill certificate upon completion of this course.
Airport Pickup and Accommodation
Airport pickup and accommodation is arranged upon request. For booking contact our Training Coordinator through Email: training@upskilldevelopment.com, +254 721 331 808
Terms of Payment:
Unless otherwise agreed between the two parties’ payment of the course fee should be done 3 working days before commencement of the training so as to enable us to prepare better.








