Présentation de Gonzalo Hernandez, Secrétaire Général du CONEVAL, Mexico, à la Conférence Internationale d'Experts sur la mesure et les approches politiques pour améliorer l'équité pour les nouvelles générations dans la région MENA à Rabat, Maroc du 22 au 23 mai 2012.

1. DIRECCIÓN DE PLANEACIÓN Y NORMATIVIDAD
Institutionalizing the Use of Evidence for
Public Policy: A long path in Mexico
DE LA POLÍTICA DE EVALUACIÓN
Gonzalo Hernández Licona
2012

2. Evidence must be part of planning
 Identify and measure Why do we
social challenges
need evidence?
 Improve social
policy
 Analysis
 Make better
 Program design decisions
 Budget (management,
 Implementation design, budget…)
 Monitoring &
Evaluation  Accountability

3. Challenges for constructing an Evaluation
system:
 Institutional: It’s almost impossible to have a public
Evaluation system without a proper institutional
arrangement (no one really likes to be evaluated!): set
an evaluation mandate, create an evaluation unit,
feedback procedures for policy improvements, norms
about transparency. DEMAND
 Technical: Suitable methodologies, trained
evaluators, administrative records, information.
SUPPLY
Constructing an Evaluation system is more a political and
institutional task than a technical one….

4. Institutional milestones
Mexico
 1998 Democratic Congress, for the first time in 70 years!
 2000 Congress’ Decree: annual external evaluations
to all federal programs (mistrust: the executive may use
social programs for the electorate campaign)
 2004 Law of Transparency and Public Access to
Information
 2004-5 Social Development Law
 CONEVAL. National Council for the Evaluation of
Social Policy (mistrust: Congress did not believe on the
executive way of measuring poverty and doing objective
evaluations)

5. CONEVAL
 Mandate:
 Measurement of Poverty at the National, State and
Municipality level
 Evaluation of social programs and policies
 Governance
 It’s part of the Executive
 The Board has 8 seats. The majority of Board
members (6) are academic researchers elected by
all the States, representatives from Municipalities,
Congress and the Executive (44 votes)

6. Evidence must be part of a planning
system
 Identify and measure Why do we
social challenges
need evidence?
 Improve social
policy
 Analysis
 Make better
 Program design decisions
 Budget (management,
 Implementation design, budget…)
 Monitoring &
Evaluation  Accountability

7. Evaluation guidelines for all institutions, together with
the Ministry of Finance: The Demand for evidence was
clearer now
Planning Evaluation
Annual Evaluation
National
Plan
Development Plan
Consistency & Results
Evaluation
Logical Framework: Results Policy Evaluation
Programs
Impact
Evaluation
Recommendations’ follow-up
Annual Performance Report

8. RESULTS

9. Results
 Now we have poverty figures at a national, state and
municipality level
 Almost 520 programs have Logical Frameworks
 20% of all indicators are Results indicators
 140 programs are evaluated every year
 We can find on the internet:
 All the evaluations
 The program’s point of view about its evaluation
 Each program’s Work Plan
 The media and NGOs constantly use the evaluations
 Programs are under pressure now to show results

10. Evaluation:
Programs’ Performance Summary
RESULTS FROM THE SPECIFIC PERFORMANCE EVALUATION (EED) 2010-2011
(External evaluation coordinated by CONEVAL and elaborated with information from the Performance Evaluation System of the
Distributional 2010 Budget
Ministry of Finance and Public Credit)
Impact Compliance
Results Related to the Program´s
Objectives Improvements Improvements % of
Program Improvements on the Delivery on Indicators Achievement on
Impact of the Coverage Coverage
on the of Goods and and Goals Following the
Program Efficiency
Achievement of Services Analysis Recommendatio Progressivity Spent Budget/
its Objectives ns from External Level Modified Budget
Evaluations
Valuation
The program is
Programa de Empleo
NA Moderate Adecuate Adecuate Adecuate 379.59% 92.5% VERY 99.5%
Temporal (PET)
PROGRESSIVE
The program is
Programa IMSS-
NA Adecuate Adecuate Adecuate Moderate SD 90.0% VERY 100.0%
Oportunidades
PROGRESSIVE
The program is
Seguro Popular (SP) Adecuate NA Adecuate Adecuate Outstanding 88.54% 100.0% VERY 100.0%
PROGRESSIVE
Programa Comunidades Opportunity for Without
NA Adecuate Moderate Moderate SD 80.0% 100.0%
Saludables Improvement Information
Programa Caravanas de la Without
NA Moderate Adecuate Adecuate Moderate SD 100.0% 100.0%
Salud (PCS) Information
Reducción de Enfermedades Opportunity for Opportunity for Opportunity for Without
NA Outstanding SD NA 100.0%
Prevenibles por Vacunación Improvement Improvement Improvement Information
The program is
PROCAMPO para Vivir Mejor NA Adecuate Adecuate Adecuate Adecuate 99.43% 75.0% VERY 100.0%
REGRESSIVE
Fondo de Apoyo para la
Without
Micro, Pequeña y Mediana Adecuate NA Outstanding Outstanding Outstanding 150.30% 69.0% 100.0%
Information
Empresa (Fondo PYME)

11. Changes in policy and programs:
 The Ministry of Finance has used evaluations for the 2011 and 2012
Budget Process
 The Presidency redefined the public policies intended to tackle maternal
mortality, based on the diagnosis of the Logical Framework.
 Due to the results of the poverty estimations in 2008, the Federal
Government announced an increase in social programs spending to
support its Poverty Fighting Strategy.
 The program Primer Empleo (First Job) was cancelled. This was meant
to increase youth employment.
 The design of Progresa-Oportunidades was modified to increase child
school attendance and increase nutrition.
 The budget for the program Piso Firme (Solid Floor) was increased.
Children’s health improves with cement floors.

12. Each country should find its own path
to produce and use evidence
 Countries should find their own institutional arrangement:
Chile, Colombia, South Africa, Canada, Mexico, Morocco,
etc.
 Democracy helps to have evaluation systems
 Public pressure is important
 The balance of power between institutions is also an important element
 Credibility is at the center of the institutional arrangement
 Champions are always a key factor
 South-South exchanges of knowledge and innovation