You are on page 1of 55

CBMS: A Tool for Monitoring and Evaluation

By
DR. CELIA M. REYES ANNE BERNADETTE E. MANDAP
Evaluation Theory, Approaches and Practices in the Philippines
November 7-8, 2011 Crowne Plaza Manila Galleria, Philippines

Presented at the 1st M & E Forum

Outline of Presentation
Key Areas of Concerns Background on CBMS Central Issues in Poverty Reduction Existing Sources of Data National Surveys Community Based Monitoring System CBMS Methodology and Process Status of CBMS Implementation in the Philippines Current Applications of CBMS

Key Areas of Concerns

Need to track the impacts of policies, programs and various shocks on the poor and the vulnerable Lack of necessary disaggregated data that can be used as inputs to policymaking and program implementation Need for a sustainable mechanism that would facilitate evidence-based decision making and impact-monitoring at each geopolitical level

Central Issues in Poverty Reduction


1.

The who, the where and the why of poverty: identification and targeting of the poor to enhance the effectiveness of anti-poverty initiatives and programs

2.

The what and when of anti-poverty programs: identification of interventions/ investments that have the highest impact on poverty

THE WHO, THE WHERE AND THE WHY OF POVERTY: Some Issues and Concerns
1.

Official statistics are reliable down to the regional and provincial levels only (i.e. the sampling design of many of these surveys provide estimates of the variables only at the provincial level.) The collection of data is few and far in between, and processing adds a few more years so that its usefulness for policy design diminishes. And yet, local government units, under the law, are the front-liners in the fight against poverty and are mandated to assume the primary responsibility for the provision of basic services and facilities and the improvement of the quality of life of their constituents.

2.

3.

Available Sources of Data


Family Income and Expenditures Survey (FIES)

Implementing Agency
NSO

Frequency of Collection
Every 3 years

Data Obtained

Family income and living expenditures and related information affecting income and expenditure levels and patterns in the Philippines including poverty incidence Socioeconomic profiles of families and other information relating to their living conditions but not poverty incidence Food situation and nutritional status of the population

Annual Poverty Indicator Survey (APIS)

NSO

Every year wherein FIES is not conducted

National Nutritional Survey (NNS)

FNRI

Every 5 years

Available Sources of Data


Census of Population and Housing (CPH)

Implementing Agency
NSO

Frequency of Collection
Every 10 years

Data Obtained

Size, composition and distribution of population in the Philippines Number of functionally literate population and their socioeconomic characteristics Demographic, maternal and child health issues in the Philippines

Functional Literacy, NSO Education and Mass Media Survey (FLEMMS) National Demographic and Health Survey (NDHS) NSO

Irregular

Every 5 years

Labor Force Survey NSO (LFS)

Every quarter of the year

Levels and trends of employment, unemployment and underemployment

Available Sources of Data

Implementing Agency

Frequency of Collection

Data Obtained

Community BasedMonitoring System (CBMS)

Local Government Units (LGUs) with technical support of DILG, NEDA, SRTC, and NGOs (CBMS Network, Social Watch, IDPG ad others)

3 years

Demographic statistics
Core set of poverty indicators (health and nutrition, education, income, employment shelter, water and sanitation, peace and order) MDGs indicators
Access to social protection programs/basic services LGU/community-specific indicators relating to migration, disability, womens well-being, natural calamities and disaster management among others Political/community participation

Decentralization creates new information demands that may be best satisfied with CBMS
Administrative Structure Information Availability

CBMS can fill the gap

National

Provincial

National surveys

Municipal/City

CBMS
Village/Barangay

CBMS
Objectives To provide policymakers and program implementers with a regular source of necessary disaggregated data for : Determining the nature and extent of poverty Formulating appropriate policies and programs Identifying eligible beneficiaries Impact Monitoring Policies and Programs Policy Shocks

THE CBMS Methodology


CBMS is designed as an organized process of data collection, processing, validation, and integration of data in the local development processes It generates a core set of indicators that are being measured to determine the welfare status of the population. These indicators capture the multidimensional aspects of poverty.

Key Features of CBMS

Involves a census of households and not a sample survey It is rooted in local government and promotes community participation It uses local personnel and community volunteers as monitors It has a core set of indicators (outcome and impact indicators) It establishes databanks at all geopolitical levels

CBMS Process
Advocacy / Organization
Step 1

(Training Module 1)

Data Collection and Field Editing

Step 2

(Training Module 2)

Data Encoding and Map Digitizing

Step 3

Dissemination/ Implementation and Monitoring

Step 8

(Training Module 3)

Processing and Mapping

Step 4

(Training Module 4)

Plan Formulation

Step 7

Knowledge (Database) Management

Step 6

Data validation and Community Consultation

Step 5

Methodology
Data Collection

CBMS
Household census done by trained local enumerators Instruments for Data Collection
12 page household profile questionnaire (available in English and Filipino) 6 page barangay profile questionnaire

Data Processing

Done by trained local data processors using a freeware customized for CBMS data encoding, processing, consolidation, and digitized poverty mapping.

Validation

Survey findings are presented and discussed in a community forum

Methodology
Establishment of Database

CBMS
Databases are established at the LGU level (province/municipal/city/bar angay level) A CBMS national repository is currently installed/maintained at NAPC, DILG-BLGD, and at the PEP Asia-CBMS Network Office at DLSU.

CBMS
Current Uses/Applications
Provides the necessary data for enriching the preparation of local development plans and budgets;
Facilitates monitoring of core local poverty indicators; A tool for localizing and monitoring the achievement of the MDGs; Provides basis for design and implementation of poverty reduction programs and interventions; Targeting of program beneficiaries; For hazard-risk and vulnerability mapping and assessment

CBMS
Applications for Targeting the Poor Diagnosis of Core Set Poverty Indicators across all barangays/municipalities/cities within a province

CBMS Composite Index Geographical Targeting Proxy Means Test

CBMS
Cost of Implementation Direct cost (P 70-P80/household) is shouldered by LGUs from their own development fund

Instruments for data collection, processing, poverty mapping, database building, and training materials and mentoring have already been developed and are provided to LGUs at no cost by the CBMS Network

Training and mentoring is also provided by a pool of accredited CBMS trainers from DILG, SRTC, and selected NGOs (e.g. Social Watch Philippines)

CBMS
Implementation/Coverage
First adopted by the Provincial Government of Palawan as a tool for planning in 1999.

As of September 30, 2011, CBMS is being adopted in 65 provinces (33 of which are province-wide) covering 767 municipalities, 50 cities and 20,503 barangays as a tool for local development planning, poverty diagnosis and monitoring the MDGs.

Coverage of CBMS implementation in the Philippines as of September 30, 2011


20,503 barangays in 767 municipalities and 50 cities In 65 provinces (33 of which are provincewide)
With Technical Assistance from: DILG-BLGD and CBMS Team with support from WB-ASEM DILG-BLGD and CBMS Team with support from UNFPA DILG-BLGD, DILG Regional offices and CBMS Team Eastern Visayas CBMS TWG and CBMS Team Bicol CBMS TWG and CBMS Team Bicol CBMS TWG and CBMS Team with support from Spanish Govt MIMAROPA CBMS TWG and CBMS Team NAPC and CBMS Team with support from UNDP Dawn Foundation and CBMS Team Social Watch Philippines and CBMS Team SRTC, SUCs and CBMS Team Kagabay and CBMS Team SRTC, NEDA IV-A and CBMS Team PRRM, SWP and CBMS Team CBMS Team

Policy Issuances on the Use of CBMS


Local policy issuances since 1999 to present on the adoption and use of CBMS as a tool for local development planning, poverty diagnosis, and MDGs monitoring

LMP Memorandum Circular 027-2006 enjoining all municipalities to adopt/sustain the adoption of CBMS as a tool for local poverty diagnosis and to institutionalize CBMS as part of the system of local governance

LPP GA-Resolution 2011-001 on adoption of CBMS and other locally developed poverty monitoring systems in identifying DSWD beneficiaries of Pantawid Program and Philhealth Indigent Sponsored Program

Policy Issuances on the Use of CBMS


National policy issuances in support of adoption and use of CBMS: Philhealth Board Resolution No. 982-2007

SDC Resolution No. 3-2006 NSCB Resolution No. 6-2005 DILG-Memorandum Circular 2004-152

NAPC-En Banc Resolution No. 7-2003

DATA THAT CAN BE GENERATED FROM CBMS

Data can be disaggregated across population sub-groups, and by geopolitical levels (by barangay/village, municipality/city, province) CBMS, conducted on a regular basis, can generate panel data that can aid tracking of conditions of households/ groups of population over time.

Identifying Eligible Beneficiaries Through CBMS

CBMS is a rich source of data at the local level and can facilitate targeting by providing information on who are the eligible beneficiaries for specific programs. Sector-specific indicators can be used to identify who should receive the intervention. Composite indicators can be also used to rank the poorest households in the village or municipality. Poverty status of beneficiaries can be monitored overtime through CBMS

Some CBMS Applications

Palawan Human Development Report


Palawan is the first province to come up with the publication of the Human Development Report in 2000 and 2006 which marks its achievement of being the first province to use household level data as basis for its development agenda

Poverty Maps
The Many Faces of Poverty, Volume 1
1. 2. 3. 4. 5. 6. 7. Agusan del Norte Biliran Camarines Norte Eastern Samar Marinduque Romblon Siquijor

Poverty Maps
The Many Faces of Poverty, Volume 2
1.Agusan del Sur 2.Marinduque 3.Oriental Mindoro

4.Palawan
5.Dinagat Islands 6.Sarangani 7.Southern Leyte

Poverty Maps
The Many Faces of Poverty, Volume 3
1.Batanes 2.Batangas 3.Northern Samar

4.Occidental Mindoro
5.Surigao del Sur 6.Tarlac 7.Zamboanga del Sur

Provincial MDG Reports Using CBMS Data

1. 2. 3. 4. 5. 6. 7. 8. 9.

Agusan del Norte Agusan del Sur Biliran Camarines Norte Eastern Samar Marinduque Romblon Siquijor Sarangani

CBMS 2005

INDICATORS
Total
1. Proportion of children 0 4 yrs old who died 2.Proportion of women who died due to pregnancy related causes 30, 119 4, 288 Magnitude 139 3

Proportion
0.5 0.1

3. Proportion of Children 0 5 yrs old who are malnourished


4. Proportion of households who are squatters 5. Proportion of households living in makeshift housing 6. Proportion of households without access to safe water supplies 7. Proportion of Households without access to sanitary toilet facilities 8. Proportion of children 6-12 years old who are not attending elementary school 9. Proportion of children 13-16 years old who are not attending secondary school 10. Proportion of Households with income less than the poverty threshold 11. Proportion of Households with income less than the food threshold 12. Proportion of Households who experienced food shortage 13. Proportion of persons in the labor force who are unemployed 14. Proportion of Households with members victimized by crime

30, 119
46, 484 46, 484 46, 484 46, 484 40, 656 21, 288 46, 484 46, 484 46, 484 67, 753 46, 484

2, 236
1, 068 1, 854 6, 703 12, 009 32, 480 14, 744 28, 699 21, 571 1, 882 8, 525 *325

7.4
2.3 4.0 14.4 25.8 80.0 69.3 61.7 46.4 4.1 12.6 0.2

Proportion of Households without access to sanitary toilet

Households without access to sanitary toilet


MUNICIPALITIES

Total Households
Magnitude Proportion

Boac Buenavista Gasan Mogpog Sta. Cruz Torrijos Marinduque = Highest = Lowest

9, 645 4, 075 6, 686 7, 273 12, 710 6, 095 46, 484

2, 094 1, 973 2, 091 2, 243 2, 167 1, 441 12, 009

21.7 48.4 31.3 30.8 17.0 23.6 25.8

Map of Buenavista showing HHs with no access to sanitary toilet CBMS Data 2005

Buenavista

CBMS Database

Use of CBMS data in Program Targeting

Provides inputs to Local Chief Executives with CBMS data used for planning and targeting purposes Example: List of malnourished children

Confidenti al info

Use of CBMS to Monitor Access to Programs


A. Access to Pantawid Pamilyang Pilipino Program
Income Quintile 1 2 3 4 5 TOTAL
Source: CBMS Survey 2009

Magnitude 60 59 52 59 48 278

% of HHs in the Income Quintile who were able to access


57.7 56.7 50.0 57.3 47.1 53.8

About 53.8 percent of the households in 2 sites (identified to be


beneficiaries of 4Ps) were able to access the program

A. Access to Pantawid Pamilyang Pilipino Program


Rate (%)
El Rio Leakage Rate 65.4

Use of CBMS to Monitor Access to Programs

Exclusion Rate Piglawigan Leakage Rate Exclusion Rate TOTAL Leakage Rate Exclusion Rate

40.8
26.4 33.1 44.6 35.6

High leakage and exclusion rates in both villages

Note: Identification of poor is based on their PMT scores using 0.7 as the cut-off Source: Authors calculations

Use of CBMS to Monitor Access to Programs


B. Access to Philhealth Program
Income Quintile Magnitude % of HHs in the Income Quintile who were able to access

1 2 3 4 5 Total

161 178 188 247 311 1,085

16.2 17.9 18.6 24.9 32.1 21.9

Source: CBMS Survey 2009

Only a little over one-fifth of households were able to access the Philhealth Program

Use of CBMS to Monitor Access to Programs


B. Access to Philhealth Program
Number of poor HHs without access Exclusion Rate

Based on Income
All Sites Rural Urban NCR Urban AONCR Based on PMT All Sites Rural Urban NCR Urban AONCR
Source: Authors calculations

1375 1012 42 321 733 600 16 117

81.8 88.2 73.7 67.6 82.2 86.8 80.0 64.6

Higher exclusion rate is recorded for rural areas


as compared to urban NCR and urban areas outside NCR

Use of CBMS to Monitor Access to Programs


C. Access to NFA Rice Program
Income Quintile 1 2 3 Magnitude 676 554 436 % of HHs in the Income Quintile who were able to access 68.1 55.8 43.1

4
5 Total
Source: CBMS Survey 2009

269
143 2,078

27.2
14.8 41.9

Not all HHs in the lowest income quintile were able to access the
program Even households at the highest income quintile accessed the program

Use of CBMS to Monitor Access to Programs


C. Access to NFA Rice Program
Leakage and Exclusion Rates

Source: Authors calculations

The highest leakage rate is recorded for urban NCR (87.8%) while the highest exclusion rate is reported for urban areas outside NCR (45.8%)

Proportion of households without access to safe water supply in Eastern Samar, by barangay

Proportion of households who are poor without access to Philhealth, by Municipality, Province of Eastern Samar, 2005-2006

Eastern Samar - 48.2

Proportion of households who are poor without access to Philhealth, by Barangay, Municipality of Balangiga, Eastern Samar, 2005

Eastern Samar - 48.2 Balangiga 39.2

Location of Households by Poverty Status and Access to Philhealth, Brgy. Poblacion 5, Balangiga, Eastern Samar, 2005
Brgy Pob 2 Brgy Pob 3 Purok 2 5.3 Purok 1 17.2

Barangay San Miguel

Purok 3 11.6 Purok 4 32.7 Brgy Pob 4 Leyte Gulf

ACCESS TO PHILHEALTH PROGRAM OF INCOMEPOOR HOUSEHOLDS ZONE 19, PASAY CITY


HHs with income below poverty threshold 1249 HHs with access to Philhealth with income below poverty threshold Magnitude 261 Proportion 20.9

Brgy

Zone 19

179
185 178 182 180

157
160 184 107 96

15
17 26 20 18

9.6
10.6 14.1 18.7 18.8 79% of households with income below the poverty threshold are not covered by the Philhealth Program.
Source: CBMS Survey 2005, City of Pasay

184
186 181

318
123 104

90
40 35

28.3
32.5 33.7

Proportion of Income-Poor Households with Access to Philhealth Program Zone 19 (Bgys. 178-186), Pasay City

CBMS Survey 2005

Households with children 12-15 years who are not in secondary school, Barangay 179, Pasay City

123 out of 326 children 12-15 years old are not attending secondary school

Poverty Incidence by Barangay and Susceptibility to Landslides in Biliran

MARIPIPI 71.5

KAWAYAN 81.3 ALMERIA 56.7 NAVAL 55.4 CAIBIRAN 70.5 BILIRAN 64.4 CABUCGAYAN 61.4 CULABA 76.2

Food Shortage by Barangay and Susceptibility to Flooding

CBMS-UNDP Development Grant Program


Project Sites

No. of Funded Projects: 25 Total Amount: Php4.7M

Camarines Norte Marinduque Biliran

Palawan
Eastern Samar

Agusan del Sur

CBMS-UNDP Development Grant Program


Awardees

CBMS-UNDP Development Grant Program: Awardees

Before Intervention: Household without access to safe Water, Brgy. Agas, Tabaco City 2008

After Intervention (PODER Project):Household without access to safe water, Brgy. Agas, Tabaco City 2009

Uses of CBMS for Monitoring and Evaluation

CBMS can aid program/project monitoring since it provides the necessary disaggregated data on access to programs CBMS, can generate panel data that can aid tracking of conditions of households/ groups of population (e.g. beneficiaries of programs) over time. CBMS provides baseline data that can be used for evaluation of appropriate interventions Since CBMS is being conducted on a regular basis by LGUs, it can facilitate monitoring of both short term and long term impacts of projects and programs.

For further inquiries:

PEP-Asia-CBMS Network Office

Angelo King Institute for Economic and Business Studies De La Salle University 10th Floor, Angelo King International Center Estrada corner Arellano Sts., Malate, Manila, Philippines Telefax: (632)5262067 Email: cbms@benilde.edu.ph cbms.network@gmail.com Website: www.pep-net.org

You might also like