Discussion about this post

User's avatar
The Ghost of Tariq Aziz's avatar

This post is kind of ignoring the reason that there was a turn to RCTs in the first place. It is notoriously difficult to get clean identification from cross-country studies, because you really can't control for most unobservables. As a result, you just end up with a bunch of correlations, often taken from the same limited data pool, which produce spurious results. The paper that you cite that is "methodologically sophisticaed" is case and point. It is not methodologically sophisticated; it is basically just correlations with some structural breaks mixed in (as an aside, I don't understand how a journalist with limited stats knowledge can even be making a claim like this). And that isn't because of some issue with the authors; it's because clean identification just isn't possible given the current tools that we have.

I'm all for answering big questions; I wish economics could do this. But can it? Economic macro models are pretty much devoid of predictive power and are so overfit that its unclear to me what their utility is at all. You can get a DSGE model to say just about anything. Macro in general seems to go through a cycle of crises where the entire field is questioned. The Lucas critique led to the current reign of DSGE models, and we can all see how well they did during the financial crisis. The whole field of macro is only limping along because there isn't anything clear to replace it.

The methodological question is not some sort of side show. It is the most important thing in the whole debate. What exactly is the point of answering big questions if all you produce is gibberish.

H Grumpy's avatar

I agree with you on the current state of affairs, but not on causation. So, yes:

Economic growth is the most powerful way to reduce poverty and improve health and education. (I don’t think you’ll find any randomista who disputes this.)

U.S. and European global development policy had absorbed a good deal of the language and some of the objectives of the social-justice ideology prominent among leftist elites. (“Woke neocolonialism,” if you enjoy annoying social justice activists.)

Macroeconomic growth theory is a much smaller part of academic development economics than it was 40 years ago. And micro-development work (including RCTs) is much larger. Most development economists now regard RCTs as a standard part of the toolkit and their results as an important part of the evidence base.

Foreign aid is unpopular, and this is a very bad thing.

But is it really plausible that RCTs / JPAL directly or indirectly caused the diminished status of growth theory within development economics, the shift in aid toward social service provision, or the rise of woke ideology among development funders? Here’s a different story.

Within academia, the macro-growth paradigm lost ground because it wasn’t leading to growth. Cross-country regressions produced more noise than signal. The Washington Consensus had some poor results and quite a few hecklers. Policies conducive to long-term growth often didn’t coincide with the near-term interests of the folks who ran low-income countries. And economies were always more complicated and the world more prone to shocks than the models. Growth remained crucial but, despite growth theorists’ best efforts, elusive. Pretty sure Pritchett was one of the people pointing all this out. For the same (and some additional) reasons, aid funding shifted to some degree away from big development projects toward social service and welfare programs.

But RCTs didn’t show up until after this had already happened. Some academic economists, rather than continue to pursue the elusive mysteries of growth, thought, “Hey, hundreds of billions of dollars are spent annually on public/social goods in poor countries. Exactly how this is spent could matter a lot to the lives of the poor.” And some of these economists decided to use a methodology that gives a really convincing counterfactual. (Banerjee was a well-respected macro-growth guy — I think he still dabbles in it — before his life as a micro-development randomista. And Pritchett’s initial objection wasn’t to the study of direct anti-poverty interventions, but rather to the method.)

It’s also contestable that RCTs have no relevance for growth questions. JPAL and related organizations have long-standing research programs on firms, business finance, job creation, labor markets, productivity, management, and entrepreneurship. The objective, in part, is to give the growth folks better models of how economic actors actually behave, so that policies meant to influence those actors are more likely to work.

Nor did macro / growth economics disappear. The WB, IMF, and dozens of academic centers and think tanks are still well stocked with economists ready and willing to provide advice on fiscal and monetary policy, taxes, trade, interest rates, business regulation, etc., to poor countries when called on. It’s far from clear that the balance of the various subfields within academic development economics is far off from the real-world demand. One of Pritchett’s earlier criticisms, after all, was that nobody wanted or would use RCT evidence. The newer criticism sounds much closer to “too many people have been listening to them.”

On aid, again, I agree that parts of it came to carry a distinctly progressive gloss. Usually this was just a verbal overlay on otherwise sensible projects. Other times it involved tone-deaf export of left-wing domestic policy objectives to foreign contexts, sometimes with disastrous consequences. The story of how LGBT Rights, Democratic fundraising and coalition signaling, and foreign-aid priorities became entangled is fascinating. But it is a separate, political story with zero connections to randomized evaluations.

It also isn’t obvious that growth-focused aid is better insulated from ideological contamination than social sector aid. There is an entire demi-monde of anti-neoliberal and feminist policy shops dedicated to critiquing macroeconomic policy and big infrastructure projects, much more so than social sector programs. The aid agencies always listen politely and put their concerns in the program documentation. In any case, the only aid program I can think of where the old bipartisan consensus has held and rejected Trump’s cuts is the very-much-social-sector-not-economic-growth PEPFAR (minus the trans and DEI stuff). It also doesn’t seem that progressivism plays much of a role in aid’s unpopularity. Even non-ideological aid never had a politically sizable domestic constituency. And the populist argument against aid is simply: “Help Americans First.”

To the extent there is any connection at all between the RCT world and social-justice activist world, it is that evidence people often act as a brake on some of SJ’s evidence-free assertions.

Again, the intellectual and political changes you point out are real, but have much better explanations elsewhere.

No posts

Ready for more?