Tyler Cowen recently posed a challenge to stump an AI named “o1” in the realm of economics. While the original author could not locate o1, they used ChatGPT 4o mini to attempt the challenge. The author expressed their observations regarding AIs, likening them to highly intelligent students capable of memorizing vast amounts of information but lacking the ability to grasp the essence of a problem.
In a specific example provided, the AI struggled to reason beyond a simple price change, demonstrating a lack of awareness in problem-solving. The author acknowledged that while AIs excel in knowledge retention, they fall short in understanding complex issues, such as predicting inflation dynamics in macroeconomics.
When asked to write an essay on the challenges faced by current macroeconomists in predicting inflation, the AI’s response was critiqued for containing empty clichés and irrelevant comments. The AI attributed the unpredictability of inflation to factors such as financial innovations, regulatory changes, unconventional central bank interventions, and global supply chain complexities.
However, the author dismantled these arguments, explaining that technological advancements, labor market shifts, and global supply chains do not necessarily make inflation harder to forecast. Additionally, the AI failed to address key factors such as the impact of interest on reserves and the zero lower bound problem on the relationship between money supply and inflation.
Despite the AI’s shortcomings in understanding monetary economics, the author recognized the impressive quantity of information AIs can access and their potential in other domains. The author highlighted the concept of Gell-Mann Amnesia, where individuals overlook inaccuracies in news articles within their expertise but continue to trust the overall publication.
In conclusion, while AIs like o1 possess vast knowledge, they still have room for improvement in truly understanding complex economic phenomena. The author emphasized the importance of critical thinking and deep comprehension in the field of economics, areas where AIs currently fall short. The integration of AI technology in various domains shows promise but also underscores the irreplaceable value of human expertise and insight.
