Global Policy Forum

Analysis Casts Doubt on Bank Scorecard:

Print
Bretton Woods Project
September 11, 2006

In June, the World Bank disclosed for the first time details of its Country Policy and Institutional Assessments (CPIA), but analysis conducted for the Bretton Woods Project suggests that this costly and influential exercise is just another way to force borrowers into adopting the model of economic development supported by the Bank.


The CPIA is made up of 16 indicators, covering four clusters: economic management, structural policies, policies for social inclusion and public sector management and institutions (see Update 43). Each criterion is given a score on a scale from one to six. The ratings, undertaken since 1997, are prepared annually in all countries by Bank country teams and then subjected to a process of internal review. In 2000, the Bank began disclosing the ratings, but only in an aggregated format - countries were ranked and placed into one of five groups from best to worst, referred to as 'quintiles'. In 2004, after calls from both the board and an external review panel, Bank management agreed to make the detailed scores for the 2005 ranking available for low-income countries. The ranking is particularly important for low-income countries as it plays a central role in the Bank's allocation of grants and low-interest loans.

Analysis for the Bretton Woods Project compared the detailed 2005 CPIA scores and trends in previous aggregate scores with relevant indicators produced by other agencies. This comparison revealed a number of discrepancies. A note of caution is warranted in interpreting these discrepancies - efforts to match time periods were restricted by data availability.

Comparison between the overall CPIA scores and growth in Gross Domestic Product (GDP) in the same year showed that many CPIA low performers are growing faster than countries that score well on the CPIA. Together with the world's fastest growing economy oil-producing Angola, other economies like the Democratic Republic of Congo, Ethiopia, Sudan, Mozambique, Sierra Leone, Niger, Cambodia, Uzbekistan and Laos, all have GDP growth rates higher than Tanzania, Bhutan, Cape Verde, Senegal, Sri Lanka, Ghana, Uganda, Indonesia and other countries which score better in the CPIA.

The tenuous relationship between the 'quality' of policies and institutions as rated by the CPIA and growth is further highlighted by looking at the longer-term trend using previous years' aggregate CPIA data. Samoa and Honduras - which have been ranked in the overall CPIA first quintile since 2002 - showed an average growth in the period 2001-2005 that is much lower than the average GDP growth rates among other countries belonging to the first quintile. The same discrepancies between quintiles' average growth rates and growth rates of specific countries within the quintile (for the 2001-2005 period) are shown by Bolivia, Grenada, Benin, and Kenya in the second quintile; Madagascar, Moldova, Mozambique, Ethiopia, Tajikistan, Niger in the third quintile; Mauritania, Nigeria, Sierra Leone, Cambodia and Laos in the fourth quintile; and by Chad, Democratic Republic of Congo, Sudan and Angola in the fifth quintile.

Comparison of the overall 2005 CPIA scores with the UNDP's Human Poverty Index (HPI), reveals several striking discrepancies. CPIA low-performer Sudan is ranked in a much higher position on the HPI than Senegal, Burkina Faso and Tanzania. In contrast, Burkina Faso, Mali, Lesotho and Mozambique - all of which scored high on the overall CPIA index - scored poorly on the HPI. Benin, Haiti, Eritrea, Nigeria and Togo also showed big discrepancies in the scores obtained in the two indicators.

Discrepancies were also revealed between the CPIA's 'transparency, accountability and corruption' index and the Corruption Perception Index 2005 (CPI) produced by NGO Transparency International (TI). Georgia, for example, scored very well in both the overall CPIA score and the specific transparency and accountability index. However, in the TI-produced CPI, Georgia was ranked amongst the bottom countries, after Mongolia, Nepal, Sierra Leone, Eritrea and Gambia (all of which scored much worse than Georgia on the CPIA corruption index). Georgia's notable improvement seems more related to what was reported in the World Bank's Doing Business 2006 report, which trumpeted Georgia's recent introduction of major reforms to its labour laws, removing restrictions on working hours and dismissal procedures, and thereby lowering firing costs to some of the lowest levels in the world.

While these preliminary comparisons are certainly not enough to dismiss CPIA scores, they cast doubt on both the methodology of the assessments and the confidence with which they should be used as a basis for vital aid allocation decisions. Publishing the full ranking was a welcome step towards more transparency but it is still not sufficient. Until more detailed information on how each score is obtained are released, suspicions will remain that the CPIA score is based more on the implementation of preferred policies than on an impartial assessment of countries' economic and political policies and institutions.


More Information on Social and Economic Policy
More Information on the World Bank
More Information on the Three Sisters and Other Institutions

FAIR USE NOTICE: This page contains copyrighted material the use of which has not been specifically authorized by the copyright owner. Global Policy Forum distributes this material without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. We believe this constitutes a fair use of any such copyrighted material as provided for in 17 U.S.C íŸ 107. If you wish to use copyrighted material from this site for purposes of your own that go beyond fair use, you must obtain permission from the copyright owner.


 

FAIR USE NOTICE: This page contains copyrighted material the use of which has not been specifically authorized by the copyright owner. Global Policy Forum distributes this material without profit to those who have expressed a prior interest in receiving the included information for research and educational purposes. We believe this constitutes a fair use of any such copyrighted material as provided for in 17 U.S.C § 107. If you wish to use copyrighted material from this site for purposes of your own that go beyond fair use, you must obtain permission from the copyright owner.