A reply to ‘Don't Believe the Haiti/DR Graph’, by the ‘total morons’ of the Maddison Project
Craig Palsson discusses a graph, based on the dataset made by Maddison and the Maddison Project (MPD), which shows the dramatic divergence between Dominican Republic and Haiti since the early 1950s. His main point is that ‘the graph is wrong’ because it shows that in the early 1950s Haiti was more or less at par with the Dominican Republic, or perhaps even slightly richer, which in his view is impossible, given what he knows about the two economies at the time. He concludes to ‘never trust the Maddison data’.
The Maddison Project does two things: first it collects, reviews, and standardizes time series of real GDP and population of almost all countries in the world - some of which go back in time to the Middle Ages. Second, the project it aims to make these series comparable over time and space, using purchasing power parities (PPPs) benchmarks from the World Bank / ICP (most recent available years are 2005, 2011 and 2017).
When comparing the series for Haiti and the Dominican Republic included in the Maddison Project database to the data Graig Palsson shows from Series históricas del crecimiento de América Latina (CEPAL, 1978), it is clear that there is a large degree of consensus about the trends of GDP per capita in the Dominican Republic and Haiti as the growth rates from both databases are very similar (see graph: https://www.rug.nl/ggdc/blog/maddison-project-re-don-t-believe-the-haiti-dr-graph).
As a result, both databases show that whatever the income gap in 1950, it has increased substantially since then. This does not come as a surprise since Maddison made use of the CEPAL data for these two countries. So far, so good, and no reason to distrust our data.
Where both databases differ is in the choice of the PPP benchmark used to convert the income series into a single currency in order to make the comparison between the countries over time. Maddison preferred his own 1990 benchmark, which shows a DR/H ratio of 2.45/1 in 1990; this may have been an underestimate, as Craig suggests (as it leads to in his view unplausible MPD results for the 1950s). The CEPAL uses a 1970 benchmark, which gives a ratio of 4.3. The DR/H ratio according to the 2011 ICP study was 7 (which is consistent with the 2.45 for 1990) and for 2017 it is 10 (but this benchmark was not yet available to us when putting together the 2020 update; both countries did not participate in the 2005 ICP round).
Selecting which benchmark to use is a complex issue as all benchmarks have their pros and cons and contain certain margins of error. We have analyzed this in detail in our 2020 paper, where we decided to use the 1990 benchmark for the extension of series back in time, resulting in estimates which, if Craig is correct, are unsatisfactory for the DR-H comparison for the 1950s. The underlying problem is the inconsistency of time series estimates of GDP growth and benchmark studies estimating relative levels of GDP per capita for a specific year. Due to changes in relative prices and budget shares as well as due to measurement errors, successive benchmarks and the time series that link them, never fit exactly. More interesting is to analyze the underlying patterns: some countries do not grow rapidly, but still become extremely rich (at the next ICP benchmark) – some oil producing countries which experienced rapid prices increases are cases in point – whereas other countries do grow a lot but do not achieve a comparable rise in GDP per capita (at the next ICP benchmark), probably because of unfavorable changes in relative prices.
Such biases may also help to explain why ‘the graph is wrong’, because the growth paths of the two countries were so different. The strategy to cope with this problem is to create independent benchmark estimates for historical periods, to test the accuracy of the GDP pc gaps that is projected back in time. In our 2020 paper we have collected the available independent benchmarks and where necessary, adapted the GDP estimates accordingly. This is also what we would like to suggest to Craig: the building blocks for an independent estimate of the relative level of GDP per capita in the 1950s are available, so let’s improve the quality of the Maddison dataset by adding such a benchmark DR/H to it. The strategy Maddison masterminded over the years, and that the project and these two morons have further developed, aims at adding new estimates – better time series, new benchmark studies – to gradually improve the quality and extend the scope of this kind of work. So that, at a distant point in the future, even goodly PhD advisors will say ‘Do trust the Maddison data’.
P.S. It would have been more constructive if Craig would have asked for our comments before putting this blog online. At one point he simply misunderstands what we have done and accuses us of adjusting the estimates for Haiti ‘to look better’ (and even concludes: ‘Holy Crap! H and DR look the same in the 1950s because the data collectors assumed they were the same’). This borders on questioning our scientific integrity – or even goes beyond it. That is not how academics – or indeed humans - should interact; academic exchanges – assuming that this is what we try to do – have other rules of the game than those of Twitter or Facebook.
We of course did not do such a thing (that is, change numbers to make them look better). We compared different methods to extrapolate time series back in time and studied the consequences of the various alternatives (no harm done, we think). One of the criteria for assessing the quality of the resulting estimates was to see how many backward ‘predictions’ resulted in levels of GDP per capita which were below subsistence (as it is the assumption that most societies in most times manage to feed and cloth their populations). So, we did not alter the estimates. Instead we selected a method for backward projection that resulted in the most plausible results given the underlying data.
Jutta Bolt and Jan Luiten van Zanden (did we mention that we both have a PhD?)
Maddison Project Database, version 2020. Bolt, Jutta and Jan Luiten van Zanden (2020), Maddison style estimates of the evolution of the world economy. A new 2020 update, Maddison-Project Working Paper WP-15
Bolt, J. and J.L. van Zanden (2021). The long view on economic growth: New estimates of GDP, in M. Mira, A. Rijpma and J.L. van Zanden. How Was Life Volume II, New Perspectives on Well-being and Global Inequality since 1820, second edition Paris: OECD (pp. 29-52).
Inklaar, R., R. Marapin, P. J. Woltjer and M.P. Timmer (2021). Inconsistencies in comparing relative prices overtime: patterns and facts, GGDC research memorandum 189.
It's not so much that the data are "wrong" so much as they are for the 2011 ICP rather than the 2017 one. The 2017 one shows a much larger gap between the Dominican Republic and Haiti (tenfold as of 2017). The growth statistics are the same, which is arguably what should matter more here. The Maddison people (who, it should be said, are more often than not total morons) discarded some Braithwaite (1968) PPPs for being unreliable -but that shouldn't matter here.
If you haven't already, you should forward this to the Our World In Data team - the direct source for the graph - who are earnest and making a good faith effort to get these things right.
To me, the story suggested by the viral graph is that DR and Haiti used to be about equally poor, and now DR is way, way richer. That story still seems pretty close to true.
Let's assume GDP/cap was about 1.5x higher in DR than Haiti in 1947, as the unadjusted data seem to indicate. In 2018, according to the viral data, GDP/cap is over 9 times higher in DR than Haiti, and growing quickly. So to me, the 'big picture' story hasn't changed much.
Certainly it's important to get the timing of the divergence right, and if the viral graph is misleading on that score, then it's useful and important to point that out. But your rhetoric near the beginning of this piece feels overblown to me - 'don't trust the graph', 'the graph is wrong', etc.
Now, if people were looking at the viral graph and saying 'wow, Haiti was richer than DR in 1950!', then they were assuming some pretty tiny error bars on the very first data point in a data series that was presumably truncated because at some point in the past it becomes too unreliable to even be worth reporting (and on a graph taken from a webpage that emphasizes in numerous places that some of the early datapoints should not be considered very precise...) To me, those people were just making a mistake from the beginning. Your piece certainly has something to teach them, I just don't think it's 'this graph is wrong'. I think it's something more like 'careful, these data have error bars on the order of 50% through the 50s and 60s'.
Oh, and that said, I still enjoyed your piece. :) And if the 'brutal takedown' framing helps get more people to read about economic history, then maybe I'm okay with it?
The real point is that, in the Dominican Republic, as as soon as the US occupation ended, Trujillo in the 1930's stole all he could , then realized he had to create more to have more, and implemented policies to develop the economy--and his successors were the most investor-friendly in all of Latin America. (see, for example, Moya Pons (1990), "Import-Substitution Industrialization Policies in the Dominican Republic, 1925-61", in the Hispanic-American Historical Review).
Haiti carried on as best it could after the occupation until Papa Doc in 1957, who cared more about power than money (yes, OK, he gave concessions to a favored few businessmen who supported the regime). While the Haitian economy started to grow under Baby Doc, who took shares in almost all Haitian companies, that progress was essentially wiped out by the Clinton embargo in 1994--and the rest was mostly disorder after that.
Certainly, accumulating historical data is important and under-rewarded. But from a political-economy point of view, the interesting question is "it was between 1890 and 1910 that Haiti fell behind". As a first step, what happened then that made such a difference?
Very interested in hearing your take on the debt-poverty hypothesis, and this was a useful post to read, thank you. Would also be interested in hearing your thoughts on why the Dominican Republic also did well in the 20th century compared to Jamaica - was Haiti atypical or the DR?
Thanks for doing some good honest historian work. People tend to undervalue it. The problem is that too many people choose just the pieces of history that fit their present arguments, so there's nothing quite like dredging through original sources and figuring out what was actually happening.
oh and if my point wasn't obvious, the world bank data clearly shows DR GDP/capita almost 3x ahead of Haiti in 1960 so divergence was obviously way before 1960.
Please use color in addition to the dashes in your graph. Maybe then it’ll go viral
A reply to ‘Don't Believe the Haiti/DR Graph’, by the ‘total morons’ of the Maddison Project
Craig Palsson discusses a graph, based on the dataset made by Maddison and the Maddison Project (MPD), which shows the dramatic divergence between Dominican Republic and Haiti since the early 1950s. His main point is that ‘the graph is wrong’ because it shows that in the early 1950s Haiti was more or less at par with the Dominican Republic, or perhaps even slightly richer, which in his view is impossible, given what he knows about the two economies at the time. He concludes to ‘never trust the Maddison data’.
The Maddison Project does two things: first it collects, reviews, and standardizes time series of real GDP and population of almost all countries in the world - some of which go back in time to the Middle Ages. Second, the project it aims to make these series comparable over time and space, using purchasing power parities (PPPs) benchmarks from the World Bank / ICP (most recent available years are 2005, 2011 and 2017).
When comparing the series for Haiti and the Dominican Republic included in the Maddison Project database to the data Graig Palsson shows from Series históricas del crecimiento de América Latina (CEPAL, 1978), it is clear that there is a large degree of consensus about the trends of GDP per capita in the Dominican Republic and Haiti as the growth rates from both databases are very similar (see graph: https://www.rug.nl/ggdc/blog/maddison-project-re-don-t-believe-the-haiti-dr-graph).
As a result, both databases show that whatever the income gap in 1950, it has increased substantially since then. This does not come as a surprise since Maddison made use of the CEPAL data for these two countries. So far, so good, and no reason to distrust our data.
Where both databases differ is in the choice of the PPP benchmark used to convert the income series into a single currency in order to make the comparison between the countries over time. Maddison preferred his own 1990 benchmark, which shows a DR/H ratio of 2.45/1 in 1990; this may have been an underestimate, as Craig suggests (as it leads to in his view unplausible MPD results for the 1950s). The CEPAL uses a 1970 benchmark, which gives a ratio of 4.3. The DR/H ratio according to the 2011 ICP study was 7 (which is consistent with the 2.45 for 1990) and for 2017 it is 10 (but this benchmark was not yet available to us when putting together the 2020 update; both countries did not participate in the 2005 ICP round).
Selecting which benchmark to use is a complex issue as all benchmarks have their pros and cons and contain certain margins of error. We have analyzed this in detail in our 2020 paper, where we decided to use the 1990 benchmark for the extension of series back in time, resulting in estimates which, if Craig is correct, are unsatisfactory for the DR-H comparison for the 1950s. The underlying problem is the inconsistency of time series estimates of GDP growth and benchmark studies estimating relative levels of GDP per capita for a specific year. Due to changes in relative prices and budget shares as well as due to measurement errors, successive benchmarks and the time series that link them, never fit exactly. More interesting is to analyze the underlying patterns: some countries do not grow rapidly, but still become extremely rich (at the next ICP benchmark) – some oil producing countries which experienced rapid prices increases are cases in point – whereas other countries do grow a lot but do not achieve a comparable rise in GDP per capita (at the next ICP benchmark), probably because of unfavorable changes in relative prices.
Such biases may also help to explain why ‘the graph is wrong’, because the growth paths of the two countries were so different. The strategy to cope with this problem is to create independent benchmark estimates for historical periods, to test the accuracy of the GDP pc gaps that is projected back in time. In our 2020 paper we have collected the available independent benchmarks and where necessary, adapted the GDP estimates accordingly. This is also what we would like to suggest to Craig: the building blocks for an independent estimate of the relative level of GDP per capita in the 1950s are available, so let’s improve the quality of the Maddison dataset by adding such a benchmark DR/H to it. The strategy Maddison masterminded over the years, and that the project and these two morons have further developed, aims at adding new estimates – better time series, new benchmark studies – to gradually improve the quality and extend the scope of this kind of work. So that, at a distant point in the future, even goodly PhD advisors will say ‘Do trust the Maddison data’.
P.S. It would have been more constructive if Craig would have asked for our comments before putting this blog online. At one point he simply misunderstands what we have done and accuses us of adjusting the estimates for Haiti ‘to look better’ (and even concludes: ‘Holy Crap! H and DR look the same in the 1950s because the data collectors assumed they were the same’). This borders on questioning our scientific integrity – or even goes beyond it. That is not how academics – or indeed humans - should interact; academic exchanges – assuming that this is what we try to do – have other rules of the game than those of Twitter or Facebook.
We of course did not do such a thing (that is, change numbers to make them look better). We compared different methods to extrapolate time series back in time and studied the consequences of the various alternatives (no harm done, we think). One of the criteria for assessing the quality of the resulting estimates was to see how many backward ‘predictions’ resulted in levels of GDP per capita which were below subsistence (as it is the assumption that most societies in most times manage to feed and cloth their populations). So, we did not alter the estimates. Instead we selected a method for backward projection that resulted in the most plausible results given the underlying data.
Jutta Bolt and Jan Luiten van Zanden (did we mention that we both have a PhD?)
Maddison Project Database, version 2020. Bolt, Jutta and Jan Luiten van Zanden (2020), Maddison style estimates of the evolution of the world economy. A new 2020 update, Maddison-Project Working Paper WP-15
Bolt, J. and J.L. van Zanden (2021). The long view on economic growth: New estimates of GDP, in M. Mira, A. Rijpma and J.L. van Zanden. How Was Life Volume II, New Perspectives on Well-being and Global Inequality since 1820, second edition Paris: OECD (pp. 29-52).
Inklaar, R., R. Marapin, P. J. Woltjer and M.P. Timmer (2021). Inconsistencies in comparing relative prices overtime: patterns and facts, GGDC research memorandum 189.
It's not so much that the data are "wrong" so much as they are for the 2011 ICP rather than the 2017 one. The 2017 one shows a much larger gap between the Dominican Republic and Haiti (tenfold as of 2017). The growth statistics are the same, which is arguably what should matter more here. The Maddison people (who, it should be said, are more often than not total morons) discarded some Braithwaite (1968) PPPs for being unreliable -but that shouldn't matter here.
If you haven't already, you should forward this to the Our World In Data team - the direct source for the graph - who are earnest and making a good faith effort to get these things right.
To me, the story suggested by the viral graph is that DR and Haiti used to be about equally poor, and now DR is way, way richer. That story still seems pretty close to true.
Let's assume GDP/cap was about 1.5x higher in DR than Haiti in 1947, as the unadjusted data seem to indicate. In 2018, according to the viral data, GDP/cap is over 9 times higher in DR than Haiti, and growing quickly. So to me, the 'big picture' story hasn't changed much.
Certainly it's important to get the timing of the divergence right, and if the viral graph is misleading on that score, then it's useful and important to point that out. But your rhetoric near the beginning of this piece feels overblown to me - 'don't trust the graph', 'the graph is wrong', etc.
Now, if people were looking at the viral graph and saying 'wow, Haiti was richer than DR in 1950!', then they were assuming some pretty tiny error bars on the very first data point in a data series that was presumably truncated because at some point in the past it becomes too unreliable to even be worth reporting (and on a graph taken from a webpage that emphasizes in numerous places that some of the early datapoints should not be considered very precise...) To me, those people were just making a mistake from the beginning. Your piece certainly has something to teach them, I just don't think it's 'this graph is wrong'. I think it's something more like 'careful, these data have error bars on the order of 50% through the 50s and 60s'.
Oh, and that said, I still enjoyed your piece. :) And if the 'brutal takedown' framing helps get more people to read about economic history, then maybe I'm okay with it?
Likewise, my Econ advisor in grad school told me “Maddison data? Don’t use it. He just made it up”. Really, it should be purged from the field.
There’s also this classic:
https://www.h-net.org/reviews/showrev.php?id=30336
I got the same advice from my advisor!
The real point is that, in the Dominican Republic, as as soon as the US occupation ended, Trujillo in the 1930's stole all he could , then realized he had to create more to have more, and implemented policies to develop the economy--and his successors were the most investor-friendly in all of Latin America. (see, for example, Moya Pons (1990), "Import-Substitution Industrialization Policies in the Dominican Republic, 1925-61", in the Hispanic-American Historical Review).
Haiti carried on as best it could after the occupation until Papa Doc in 1957, who cared more about power than money (yes, OK, he gave concessions to a favored few businessmen who supported the regime). While the Haitian economy started to grow under Baby Doc, who took shares in almost all Haitian companies, that progress was essentially wiped out by the Clinton embargo in 1994--and the rest was mostly disorder after that.
Doesn't Madison 2020 (OWID source) use a different methdology to Madison 2018 (the one you're criticizing)?
https://www.rug.nl/ggdc/historicaldevelopment/maddison/publications/wp15.pdf
https://www.rug.nl/ggdc/html_publications/memorandum/gd174.pdf
https://www.rug.nl/ggdc/historicaldevelopment/maddison/releases/maddison-project-database-2020?lang=en
So same story, after all this wahala.
Certainly, accumulating historical data is important and under-rewarded. But from a political-economy point of view, the interesting question is "it was between 1890 and 1910 that Haiti fell behind". As a first step, what happened then that made such a difference?
Very interested in hearing your take on the debt-poverty hypothesis, and this was a useful post to read, thank you. Would also be interested in hearing your thoughts on why the Dominican Republic also did well in the 20th century compared to Jamaica - was Haiti atypical or the DR?
Thanks for doing some good honest historian work. People tend to undervalue it. The problem is that too many people choose just the pieces of history that fit their present arguments, so there's nothing quite like dredging through original sources and figuring out what was actually happening.
I was confused by the data as well, and this is what worldbank.org says: https://data.worldbank.org/indicator/NY.GDP.PCAP.CD?end=1970&locations=DO-HT&start=1960
Because I don't have a PhD in economics I don't know how to find the source for these numbers though.
Also, does your thesis being on Haiti have anything to do with your vodou economics handle?
That's by current exchange rates, not by PPP.
oh and if my point wasn't obvious, the world bank data clearly shows DR GDP/capita almost 3x ahead of Haiti in 1960 so divergence was obviously way before 1960.