Basics of the AATS: key concepts and required tools

Basics of the AATS
Key concepts and required tools
Anselme Vodounhessi, CAADP M&E Advisor, African Union Commission
African Agricultural Transformation Scorecard (AATS) as high level advocacy tools
for triggering improved country performances in achieving Malabo Declaration.
SIDE # EVENT 1

?
Target
Milestone
Indicator
Benchmark
Baseline
Baseline year
Target year
Not On Track
On Track
Zero-Score

1 •Rightness
2 •Transparency
3 •Fairness
4 •Accuracy
5 •Consistency
Scorecard Concepts
5 Key Considerations

Scorecard Concepts
5 Key Considerations
“Let’s double our revenue by the end of the year “
N’Diaye
R= 1,000 MZN
Dossou
R= 20,000 MZN
Ndiaye
R= 2,500 MZN
Dossou
R= 28,000 MZN
Name Revenue
N’Diaye 2,500
Dossou 28,000
Name Revenue
N’Diaye 2,500
Dossou 28,000
↑150%
↑ 40%
10/10
04/10
Score

Scorecard Concepts
How to Score ?

Subjects
No. Item Mark/20 Weight
1 Maths 19 6
2 Physics 19 6
3 Biology 13 5
4 Languages 12 1
5 Politics 12 2
6 History 13 3
7 Singing 6 1
8 Dance 15 1
15.6Average Mark:
Benchmark 12.0
Decision: Qualified
School Report or
Report Card
of Mr Tall
Scorecard Concepts
Score and Similarity …

Country Scores for achieving
Malabo Commitments…
3.6 3.3 3.9
Country 52 Country 53 Country 54 Country 55 2017 Benchmark
4.0 0.0 4.9 1.6 4.5
Country 49 Country 50 Country 51
4.1 0.0 1.9
Country 44 Country 45 Country 46 Country 47 Country 48
1.6 3.5 4.1 1.5 0.0
3.2 6.1 0.0
5.0 0.0 4.2 4.1 3.4
5.0 3.0 3.0
4.8 3.7 0.7 0.0 3.2
4.0 3.3 0.0
3.3 0.0 5.3 2.9 3.1
1.5 3.2 0.0
2.3 2.2 0.0 2.8 0.0
4.7 4.2 2.2 4.2
Country 5 Country 6 Country 7 Country 8
Country 3 Country 4
0.0 1.7 3.4 4.4
Country overall progress for implementing the Malabo Declaration for Agriculture transformation in Africa
Against the 2017 Benchmark of 3.9 out of 10 which is the minimum
score for a country to be on track for implementing the Malabo
Declaration, countries which score (out of 10) appears in ''green" are
ON TRACK , and countries which score appears in "red" are NOT ON
TRACK for the 2017 reporting to the Jaunary 2018 AU Assembly.
The score " 0.0 " is a result of report not availed by the country.
Country 1 Country 2

Scorecard Concepts
Benchmarking as methods…

Scorecard Concepts
Metric benchmarking

No matter how many millions of indicators you have ….
I can still aggregate !
I can still give a score ! A Benchmarking Engineer
Scorecard Concepts
Metric benchmarking
Weighting
System

 Scorecard is performance evaluation
tool… that is potential in triggering action
and stimulation... It is Good for high level
advocacy.
 Scorecard is not a Dashboard … as a
Dashboard can lead to misunderstanding of
the progress.
Scorecard Concepts
Scorecard and specificity…

 A Score is an expression of “Effort”
and not of the “Status” (of an indicator.)
Score = x Scale
Effort Made
Expected Effort
… for the same item, the score may vary depending on
the way the commitment is formulated.
Scorecard Concepts
Scorecard and specificity…

Illustration 1 on a SCORE:
The commitment matters…
Commitment 1 : Reduce the post harvest lost (PHL) by 50%, from 2015 to 2020
PHL0
= 60%
Commitment 2 : Reduce the post harvest lost (PHL) to 50%, from 2015 to 2020
2015 2016 2017 2018 2019 2020
PHLf
= 30%
Total Effort = - 30%
or -6% yearly
54% 48% 42% 36%↓10% ↓20% ↓30% ↓40% ↓50%
TargetMilestone
↓0%
Baseline
Indicator = Reduction Rate of the PHL
Baseline Year Target Year

Illustration 1 on a SCORE:
The commitment matters…
Commitment 1 : Reduce the post harvest lost (PHL) by 50%, from 2015 to 2020
PHL0
= 60%
Commitment 2 : Reduce the post harvest lost (PHL) to 50%, from 2015 to 2020
2015 2016 2017 2018 2019 2020
PHLf
= 30%
or -6% yearly
PHL0
= 60%
PHLf
= 50%
or -2% yearly
PHLfr
= 40%0.610
%30
%20
1 


Score 10#10
%10
%20
2 


Score

Illustration 2 on a SCORE :
Scores and comparison
Malabo Commitment on Nutrition: Bring down underweight to 5% , by 2025.
Target 5%
Uw2016 Progress Uw2015
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country A 22.0% On Track 30.0% -25% -2.5% 27.5% 3.2 1.0
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
Country C 12.0% On Track 15.0% -10.0% -1.00% 14.0% 3.0 1.0
Target 5%
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
Target 5%
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
Target 5%
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
Target 5%
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
Target 5%
Total
Effort
Yearly
Effort
Milestone
2016
Score
out of 10
Benchmark
out of 10
Country B 5.46%
Not On
Track
5.50% -0.50% -0.05% 5.45% 0.8 1.0
2016
Benchmark
out of 10
1.0
1.0
1.0

Metric and the Zero-Score
as a Fair and Consistent approach
Indicators Country A Country B Country C
Ind 1 10 10 -
Ind 2 9 9 -
Ind 3 3 - -
Ind 4 5 - -
Ind 5 8 - -
Overall 7 9.5 -
Ind 1 10 10 -
Ind 2 9 9 -
Ind 3 3 - -
Ind 4 5 - -
Ind 5 8 - -
Overall 7 9.5 -
Ind 1 10 10 -
Ind 2 9 9 -
Ind 3 3 - -
Ind 4 5 - -
Ind 5 8 - -
Overall 7 9.5 -

Ind 1 10 10 -
Ind 2 9 9 -
Ind 3 3 - -
Ind 4 5 - -
Ind 5 8 - -
Overall 7 9.5 -
Ind 1 10 10 0
Ind 2 9 9 0
Ind 3 3 0 0
Ind 4 5 0 0
Ind 5 8 0 0
Overall 7 3.8 0
Ind 1 10 10 0
Ind 2 9 9 0
Ind 3 3 0 0
Ind 4 5 0 0
Ind 5 8 0 0
Overall 7 3.8 0
Metric and the Zero-Score
as a Fair and Consistent approach

Scorecard Concepts
Some definitions
…

Required tools for TRANSPARENCY
Case of Malabo Declaration

… algorithms to a Score

7 Performances Themes
23 Performances Categories
43 Performances Indicators
> 166 Data Entry Points

https://au.int/web/en/documents/20170420/biennial-review-malabo-
implementaion-links
https://au.int/web/en/documents/20170420/coordination-
mechanism-and-continental-roadmap-br-eng
https://au.int/web/en/documents/20170420/2017-country-
performances-reporting-format-malabo-eng
https://au.int/web/en/documents/20170420/technical-guidelines-
reporting-malabo-rev2
https://au.int/web/en/documents/20170420/technical-notes
For further information on the Biennial Review & Benchmarking engineering, email to:
Anselmev@africa-union.org & N’Guessanp@africa-union.org

Obrigado! Thanks !
Bill
Asante
!
Merci ! Shukran !

• Benchmark: a standard or point of reference against which
scores are compared.
• 2017 Benchmark: Minimum score in 2017 for a country to
be able to achieve the Malabo Targets.
• On-Track: when the score of a country is equal or higher
than the Benchmark.
• Not On-Track: when the score of a country is less than the
Benchmark.
Scorecard Concepts
Some definitions

Scorecard Concepts
Some definitions
•A Target: It is a value to be reached at an ultimate year (target year) by an item expressed in a commitment. As
example for the commitment of “Triple (increase by 200%) intra-African trade in agricultural commodities
and services, by 2025 from 2015”, the target is 200%. In the commitment, the target year is 2025, and the
baseline year is 2015.
•An indicator: Is an parameter or an expression (combination of parameters) that measures directly (without any
further calculation) the value of the item that is measured. As in example of the commitment above, the
indicator is the "growth rate of intra-African trade" which is expressed with the value of the volume of trade of
the current year, and the value of the volume of trade of the baseline year (baseline value).
•A Milestone: It is the value to be reached by the indicator in a particular year t, for the country to be on track in
reaching the target, with the assumption that the progress in linear. It is just like a “target for that particular
year”. The milestone varies from year to year, and can be compared to the value taken by the indicator to
evaluate the country progress. As in example of the commitment above, the milestone of the 1st year (2016) is
20%.
•A Score: It is a value (based on an agreed scale: a scale of 10 in our case) that reflects immediately how much
a target (absolute score) or a milestone (relative score) has been achieved based on the observed value of the
indicator in the particular year. It is an expression of the country effort, performance or progress on the scale (of
10 in our case). As in example of the commitment above, a country having reached 150% in a certain year will
have a score of 7.5.
•A Benchmark: It is the score calculated using the value of the milestone as the observed value of the indicator.
Similarly to the milestone (compared with the value of the indicator), the benchmark is the minimum score that
a country should have to be on track in that particular year. The Benchmark varies from year to year, and
reaches the maximum score at the target year.

Years
Basl. value
Bsl
Baseline Year
YBsl
Target Year
YT
Target, Ʈ
Indicators
Yr
V1
V2
Milestone, 
Performance line
Slope of the Performance line, 
   
)()(
tan
BslTBslr YY
Bsl
YY
Bsl








On Track
Not on Track
Scorecard Concepts
Some definitions
 Bsl
YY
YY
Bsl
BslT
Bslr



 
)(
)(

Basl. value
Bsl
Baseline Year
YBsl
Target Year
YT
Target, Ʈ
Indicators
Yr
V1
V2
Milestone, 
Score1 = x Scale Benchmark= x Scale
Scorecard Concepts
Some definitions

Yr 2025
Ʈ
St
St
2015
St0
 
 
   
   






































ii
ii
i
StandSt
StandSt
St
iSt
StSt
5.35.30
5.35.30
5.30
0
10
0,10,10minmax
5.30
0




Stuntingvalue
Years
Scorecard Concepts
Some definitions

Yr 2025
Ʈ
2015
St0

St
   
 
















i
i
Sti
St
ii StSt
5.30
5.30
5.3
5.3005.32016
)20152025(
20152016




201520252015
00




  St
Yr
St
Stuntingvalue
Years
Scorecard Concepts
Some definitions

Basics of the AATS: key concepts and required tools

Recommandé

Recommandé

Contenu connexe

Tendances

Tendances (20)

Similaire à Basics of the AATS: key concepts and required tools

Similaire à Basics of the AATS: key concepts and required tools (20)

Plus de African Regional Strategic Analysis and Knowledge Support System (ReSAKSS)

Plus de African Regional Strategic Analysis and Knowledge Support System (ReSAKSS) (20)

Dernier

Dernier (20)

Basics of the AATS: key concepts and required tools