Research, Monitoring and Evaluation
The Research, Monitoring and Evaluation (RME) activities of the Abt Associates led-PSP-One project are designed to (1) build the evidence base for innovative, cutting-edge private and commercial sector reproductive health and family planning (RH/FP) programming around the world and (2) support and facilitate monitoring and evaluation (M&E) activities of PSP-One as well as of the PSP IQC.
In close collaboration with activity managers and collaborating organizations, the RME team supports the mission and objectives of the PSP-One project by conceptualizing and implementing RME activities in the following areas.
PSP-One global studies consist of secondary analyses of existing data (such as Demographic and Health Surveys) to address longstanding questions about the private sector’s role in the provision of quality RH/FP services and products. Recent examples of PSP-One global studies include:
- Equity of access to RH/FP products and services. Using multiple years of Demographic and Health Survey data from five countries, this study examined whether an expansion in private sector contraceptive supply is associated with increased inequity in the modern contraceptive prevalence rate (MCPR) across wealth quintiles. Included countries were Bangladesh, Ghana, Indonesia, Kenya, and Morocco
- Differences in quality of care between the public and private sectors. This study assesses the quality of FP services in both the public and private sector, as well as the impact of quality of care on the duration of modern contraceptive use. PSP-One systematically documented differences in the quality of care offered by the public and private sectors in countries where Service Provision Assessments (SPA) have been conducted (Ghana, Egypt and Kenya).
- When donor support ends: The fate of social marketing brands and the markets they help create. This study consisted of an analysis of multiple rounds of data from nationally representative surveys implemented in Morocco, the Dominican Republic, Peru, and Turkey between 1986 and 2003, with the objective of documenting changes in the commercial sector’s share of oral contraceptives and condoms before and after the withdrawal of donor support. An article based on this report was published in the peer-reviewed journal Social Marketing Quarterly in July 2006.
PSP-One evaluation studies are conducted to assess the impact of project interventions around the world. The following are illustrative examples of recent PSP-One evaluation studies.
- Evaluation of the demand-side effects of a youth-friendly FP initiative in India. This study was designed to inform and evaluate the PSP-One youth-friendly initiative (YFI) that consists of training Indian chemists and indigenous systems of medicine practitioners (ISMPs) on how to provide youth-friendly FP services in the city of Lucknow. During the project period, PSP-One researchers will conduct baseline and follow-up household surveys among youth in Lucknow as well as in the comparison city of Kanpur to document changes in youth FP knowledge, attitudes, and practices. Baseline data was collected among 2,573 young people in both cities in 2007, and the follow-up survey is planned for 2009.
- Evaluation of effect of wellness training on FP use and unmet FP need among health maintenance organization clients. Based on provider and client surveys in health maintenance organization (HMO) clinics in the Federal Capital Territory, Kano, and Lagos, this study assesses changes in provider FP knowledge and documents change in unmet need for FP among clients before and after PSP-One health promotion trainings of HMO providers. The baseline survey conducted in 2007 included 1,986 clients and 260 providers. The follow-up survey is planned for 2009.
PSP-One operations research (OR) activities apply research techniques to improve the quality, effectiveness, and efficiency of RH/FP programs and services. Recent examples of PSP-One OR activities include:
- Acceptability and effectiveness of a quality improvement tool among Ugandan private midwives. Conducted among Ugandan private midwives, this quasi-experimental study is designed to evaluate whether a self assessment tool helps improve the quality of care provided by these providers. Three groups were compared: 1) Uganda Private Midwives Association (UPMA) midwives using the tool with supervision; 2) Non-UPMA midwives using the tool without supervision; and 3) Non-UPMA midwives not using the tool (control group).
- Factors that affect acceptance of DMPA injectable contraceptive in India. This survey of 1,200 married women of reproductive age recruited from DIMPA clinics in five Indian cities explores women’s reasons for accepting DMPA as a contraceptive method. Results from the study will help determine strategies to increase provision of quality DMPA services in the clinic network, and to assess how to expand such a network of providers.
In addition to the above described research categories, PSP-One also conducts innovative cross-cutting research that support the project’s mission of advancing best practices in private sector RH/FP provision
- Client-centered market segmentation of potential modern contraceptive users. Implemented in Philippines and Azerbaijan, this methodology consists of qualitative and quantitative research to identify the needs and preferences of different groups of potential modern FP users, analyzing a broad array of behavioral, attitudinal, demographic, geographic, socioeconomic, lifestyle, and psychographic characteristics. The aim of the client-centered approach is to identify which attitudes, values, and influencer's play important roles in determining modern contraceptive use, and then to translate these findings into tailored communications and marketing efforts to increase FP utilization.
The RME team is responsible for the development and implementation of performance monitoring plans of PSP-One activities as well as those of the PSP IQC. In collaboration with technical advisors and consistent with the aims and priorities of USAID, PSP-One monitoring and evaluation activities are designed to inform work plans, assess activity progress, and report to collaborators and USAID on project performance.
PSP-One Technical Area leader: Sara Sulzbach, Director, Research, Monitoring and Evaluation
