Ten Reasons Why AI May Be Overrated

A list of reasons why generative AI may be overhyped.

View this email online AI Hype by Greg Rosalsky Is artificial intelligence overrated? Ever since ChatGPT heralded the explosion of “generative AI” in late 2022, the technology has seen incredible hype in the industry and media. And countless investors have poured billions and billions of dollars into it and related companies.  But there’s a growing chorus of naysayers expressing doubts about how game-changing generative AI will actually be for the economy.  The discord over AI recently inspired a two-part series on our daily podcast the Indicator from Planet Money. Co-host Darian Woods and I decided to debate the question: Is AI overrated or underrated?  Because there is quite a bit of uncertainty over how much AI will ultimately affect the economy — and because neither of us really wanted to regret making dumb prognostications — we chose to obscure our personal opinions on the matter. We flipped an AI-generated coin to determine which side of this debate each of us would take. I got “AI is overrated.”  I spoke to MIT economist Daron Acemoglu, who has emerged as one of AI's leading skeptics. I asked Acemoglu whether he thought generative AI would usher in revolutionary changes to the economy within the next decade.  “No. No. Definitely not,” Acemoglu said. “I mean, unless you count a lot of companies overinvesting in generative AI and then regretting it, a revolutionary change.” Ouch. That implies we’ve seen a massive financial bubble inflate before our very eyes (note this interview was conducted before the recent stock market plunge, which may or may not have something do with expectations about AI).     KIRILL KUDRYAVTSEV/Getty images So why might AI be overrated? To make my polemical case, I ended up assembling a pretty long list of reasons. We couldn’t fit it all in a short episode. So we decided to provide a fuller list of reasons why AI may be overrated here (complete with strongly worded arguments). Here you go:  Reason 1: The Artificial Intelligence we have now isn’t actually that intelligent.  When you first use something like ChatGPT, it might seem like magic. Like, “Wow, a real thinking machine able to answer questions about anything.”  But, when you look behind the curtains, it’s more like a magic trick. These chatbots are a fancy way of aggregating the Internet and then spitting out a mishmash of what they find. Put simply, they’re copycats, or, at least, fundamentally dependent on mimicking past human work and not capable of generating great new ideas.  And perhaps the worst part is that much of the stuff AI is copying is copyrighted. AI companies took people’s work and fed it into their machines, often without authorization. You could argue it’s like systematic plagiarism.  Which is why there are at least 15 high-profile lawsuits against AI companies asserting copyright infringement. In one case, The New York Times v. OpenAI, the evidence suggests that, in some instances, ChatGPT literally spit out passages of news articles verbatim without attribution.  Fearing that this really is a violation of copyright law, AI companies have begun paying media companies for their content. At the same time, many other companies have been taking actions to prevent AI companies from harvesting their data. This could pose a big problem for these AI models, which rely on human-generated data to cosplay as thinking machines. The reality is generative AI is nowhere near the holy grail of AI researchers, so-called artificial general intelligence (AGI). What we have now, well, it’s way more lame. As the technologist Dirk Hohndel has said, these models are just “autocorrect on steroids.” They are statistical models for prediction based on patterns found in data. Sure, that can have some cool and impressive applications. But “artificial pattern spotter” — or, the more traditional, “machine learning” moniker — seems like a better description than “artificial intelligence.” These systems don’t have judgment or reasoning. They have a hard time doing basic things like math. They don’t know right from wrong. They don’t know true from false.  Which brings us to… Reason 2: AI lies. The AI industry and media have come to call AI-generated falsehoods and errors “hallucinations.” But, like “artificial intelligence,” that actually might be a misnomer. Because that makes it sound like it, you know, it works well almost always. And then every once in a while it likes to drink some ayahuasca or eat some mushrooms, and says some trippy, made-up stuff.  But AI hallucinations seem to be more common than that (and, to be fair, a growing number of folks have begun calling them “confabulations.”) One study suggests that AI chatbots hallucinate — or confabulate — somewhere between 3 and 27 percent of the time. Whoa, looks like AI should lay off the ayahuasca. AI hallucinations have been creating embarrassments for companies. For example, Google recently had to revamp its “AI overviews” feature after it started making ridiculous errors, like telling users they should put glue in pizza sauce and it was healthy to eat rocks. Why did it recommend people eat rocks? Probably because it had an article from the satirical site The Onion in its training data. Because these systems are not actually intelligent, that tripped it up.  Hallucinations make these systems unreliable. The industry is taking this seriously and working to reduce errors. There may be some progress on that front. But — because these models don’t actually know true from false and just mindlessly spit out words based on patterns in data— many AI researchers and technologists out there believe we will not be able to fix the problem of hallucinations anytime soon, if not ever, with these models.  Reason 3: Because AI is not very intelligent and hallucinations make it unreliable, it’s proving incapable of doing most — if not all — human jobs.  I recently reported a story that asked, “If AI is so good, why are there still so many jobs for translators?” Language translation has been at the sort of vanguard of AI research and development for close to a decade or more. And some have predicted that translator jobs would be among the first to be automated away.  But, despite advances in AI, the data suggests that jobs for human translators and interpreters are actually growing. Sure, translators are increasingly using AI as a tool at their jobs. But my reporting revealed that AI is just not smart enough, not socially aware enough, and not reliable enough to actually replace humans most of the time.  And this seems to be true for a whole host of other jobs.  For example, drive-thru attendants. For close to three years, McDonald’s piloted a program to use AI at some of its drive-thrus. It became a bit of an embarrassment. There were a bunch of viral videos showing AI making bizarre errors. Like, trying to add $222 dollars worth of chicken nuggets to someone's order. And adding bacon to someone’s ice cream.  I like how The New York Times journalist Julia Anguin put it. Generative AI, she says, “could end up like the Roomba, the mediocre vacuum robot that does a passable job when you are home alone but not if you are expecting guests. Companies that can get by with Roomba-quality work will, of course, still try to replace workers. But in workplaces where quality matters… A.I. may not make significant inroads.” Reason 4: AI’s capabilities have been exaggerated.  You may remember news stories from last year proclaiming that AI did really well on the uniform bar exam for lawyers. OpenAI, the company behind ChatGPT, claimed that GPT-4 scored in the 90th percentile. But MIT researcher Eric Martinez dug deeper. He found that it scored only in the 48th percentile. Is that actually impressive when these systems, with their ample training data, have the equivalent of a Google search at their fingertips? Heck, maybe even I could score that well if I had access to previous bar exams and other ways to cheat.  Google, meanwhile, claimed that its AI was able to unearth more than two million chemical compounds previously unknown to science. But researchers at UC Santa Barbara found that this was mostly bogus. Maybe the study is wrong, or, more likely, maybe the AI industry is overhyping their products’ capabilities.  Even more alarming, AI was really touted as being incredible at writing computer code. Like jobs for translators, jobs for computer coders were supposedly in jeopardy because AI was so good at coding. But researchers have found that much of the code that AI generates is not very good. Sure, AI is making coders more productive. But the quality seems to be going down. One study from researchers at Stanford University found that coders who used AI assistants "wrote significantly less secure code.” Researchers at Bilkent University found that more than 30% of AI-generated code was incorrect and another 23% of it was partially incorrect.  A recent poll of developers found that roughly half of them had concerns about the quality and security of AI-generated code.  Reason 5: Despite all the media and investor mania about AI over the last few years, AI use remains surprisingly limited.  In a recent study, the US Census Bureau found that only around 5% of businesses had used AI in the previous couple weeks. Which relates to…. Reason 6: We have yet to find AI’s killer app.  The relatively small percentage of companies that are actually using AI don’t seem to be using it in a way that is going to have profound benefits for our economy. Some are experimenting with it. But, of those that have actually incorporated it into their day-to-day business, it’s mostly in things like personalized marketing and automated customer service. Not very exciting.  In fact, I don’t know about you, but I’d rather talk to a human customer service agent than a chatbot. Acemoglu has called this sort of automation “so-so automation,” where companies replace humans with machines not because they’re better or more productive but because it saves them money. Like self-checkout kiosks at grocery stores, AI chatbots in customer service often just shift more work to customers. It can be frustrating. So, yeah, we’re not seeing a killer app for AI yet. Actually, it’s feasible that the most impactful real-world applications of AI will be scams, misinformation, and threatening democracy. Overrated! Reason 7: Productivity growth remains super disappointing. And generative AI may not help it get much better anytime soon. If AI was really revolutionizing the economy, we’d likely see a surge in productivity growth and an increase in unemployment. But the surge in productivity growth is nowhere to be seen. And unemployment is at near-record lows. Even for the white-collar jobs that AI is most likely to affect, we’re not seeing evidence of AI killing them.  While generative AI may be incapable of replacing humans in most or virtually all jobs, it clearly can help humans in some professions as an information tool. And, you might say, its productivity benefits could take time to filter throughout the economy.  But there are good reasons to believe that generative AI will not revolutionize our economy anytime soon.  In a recent paper, Acemoglu estimated generative AI’s potential effects on the economy over the next decade. “The paper was written out of a belief that some of the effects of AI are being exaggerated,” Acemoglu says.  First off, Acemoglu says, there are just humongous chunks of the economy that generative AI will barely touch. Construction, food and accommodations, factories, and so on. Generative AI, in Acemoglu’s view, will be unable to do most tasks outside of an office within the next decade (note that generative AI is distinct from the technology behind self-driving cars, so-called “reinforcement learning.” Acemoglu says he has little doubt that self-driving cars are coming, but he’s unsure about the timeline. His focus in this paper is new AI advances that have captured our collective imagination over the last couple years).  Then Acemoglu narrows in on office work and finds that there are just a whole bunch of tasks that current AI models are incapable of doing. They’re just too dumb and unreliable. At best, they’re proving to be just a tool that office workers can use to — maybe — become slightly better at their jobs. Acemoglu finds that AI will impact less than 5 percent of all human tasks in the economy. Less than 5 percent! And, here, there will only be some mild cost savings. In the end, Acemoglu predicts that generative AI won’t boost productivity or economic growth much within the next decade. He estimates that, at best, it could increase GDP by around 1.5 percent over ten years. That’s “nothing to be sneered at,” Acemoglu says. “But it’s not revolutionary in any shape or form.” Reason 8: AI may not actually be improving as fast as many people claim it is. In fact, AI may be running out of juice.  Whenever we talk about AI, the conversation always seems to turn to the future.  Like, sure, it’s not that good YET. But in a few years, we’re all gonna be out of work and bowing down to our robot overlords or whatever. But where is the evidence that actually points to that? Is this just our collective conditioning by science fiction movies?  There’s been a lot of talk about AI improving really fast. Some claim it’s getting exponentially better. Others even claim these models — highfalutin autocomplete — are the road to AGI, or artificial superintelligence. But there are serious questions about all of this. In fact, evidence suggests that the rate of progress in AI may be slowing down.  First off, progress in making these models better has depended, in large part, on throwing lots and lots of data at them. One big problem: they’ve already basically consumed the entire Internet.  And, as already stated, that included consuming a bunch of copyrighted works. What happens if the courts say, “No way, you can’t just use copyrighted data without authorization”? Meanwhile, companies, annoyed by AI’s penchant for expropriating their data, have started restricting use of their data. One group of researchers recently called it an “emerging crisis in consent.”  Still more, there are questions about the quality of data in these systems. Maybe sites like The Onion and 4chan, while helping these systems mimic online humans, may actually not help them have real, beneficial applications in the economy. But even if AI companies get over these humps, there’s the reality that there’s only so much data out there. Researchers are scrambling to figure out ways to get more data. They’re talking about things like creating “synthetic data,” and so on. But progress on this front is a big question mark.  Second, there’s a scarcity of the special microchips needed to power AI. That’s another huge cost and headache for AI companies. Sam Altman, the CEO of OpenAI, has been trying to convince investors to fork over trillions of dollars — trillions! — to revamp the global semiconductor industry and make other investments to make ChatGPT better. Is it actually worth it? Will investors actually get their money back? I dunno.  Third, the data centers that power AI require an ungodly amount of electricity. This is a huge cost for these companies. Are they going to be able to recoup the money it takes to build and power all of these data centers? Will consumers be willing to pay the high cost of running AI? It’s a fundamental problem with their business model. But it’s also a fundamental problem for America’s electricity grid and the environment. Reason 9: AI could be really bad for the environment. It already consumes enough energy to power a small country. Researchers at Goldman Sachs find that, “The proliferation of generative AI technology — and the data centers needed to feed it — is set to drive an increase in US power demand not seen in a generation.” “One of the silliest things around a couple of years ago was this idea that AI would help solve the climate change problem,” Acemoglu says. “I never understood exactly how.  But you know, it's clear it's gonna do something to climate change, but it's not on the positive side.”  Reason 10: AI is overrated because humans are underrated.  When I asked Acemoglu for his top reasons why AI was overrated, he told me something that warmed my heart — a feeling that dumb so-called “artificial intelligence” could never experience.  Acemoglu told me he believed AI is overrated because humans are underrated. “So a lot of people in the industry don't recognize how versatile, talented, multifaceted human skills and capabilities are,” Acemoglu says. “And once you do that, you tend to overrate machines ahead of humans and underrate the humans.” Go, Team Human! *** Major caveat to all of the above: I’ve made the strongest case against generative AI I could make because that was my assignment (thanks to an AI-generated coin flip). There are countless investors and technologists and economists out there who are bullish on this technology (for some of those arguments, listen to my colleague Darian Woods’ episode on why AI is underrated or read some of my previous newsletters highlighting potential upsides and benefits of AI technology).  Going forward, I will go back to being less derisive and more open-minded to the pros and cons of this technology — at least until our AI robot overlords take over the Planet Money newsletter and destroy my livelihood. Not subscribed? Subscribe to this newsletter. Want to send this to others? Share the web-version of this newsletter on social media. Want more Planet Money? Listen to our podcasts. Newsletter continues after sponsor message Get Bonus Content Subscribe to Planet Money+ for bonus episodes with behind the scenes takes, extended interviews, and extra facts we couldn’t fit into the main show. Plus, it’s ad free. You’ll get The Indicator and Planet Money Summer School too - all while supporting our nerdy, ambitious journalism. Learn more at Plus.npr.org/PlanetMoney.  On Our Podcasts What to do when you're in a class action — Maybe you got a boring slip of paper in the mail. Maybe you got a spammy-looking email promising you money. Surprise! You're in a class action. If you've done any commerce in the last decade, there's a good chance that someone somewhere was suing on your behalf and you have real money coming your way... if you know what to do. Listen here Summer School 4: Banker vs president and the birth of the dollar — Episodes each Wednesday through labor day. Find all the episodes from this season here. And past seasons here. And follow along on TikTok here for video Summer School. Listen here Why the Olympics cost so much — The modern Olympic Games are notorious for saddling host cities with burdensome cost overruns into the billions. Organizers for the Paris 2024 Olympics were aware of this and planned to put on one of the most cost-effective Olympics in recent memory. They still went over budget. The Indicator has the story. Listen here Also on The Indicator: Getting more men into so-called pink-collar jobs; Are both rents AND interest rates too dang high?; Test your knowledge of NVIDIA, ChatGPT and...Peppa Pig?; and How insurance is affecting the cost of childcare Listen to your local NPR station. Visit NPR.org to hear live radio from Central Florida Public Media (edit station). Subscribe to Planet Money+. Your support helps make our show possible and unlocks access to our sponsor-free episodes. What do you think of today's email? We'd love to hear your thoughts, questions and feedback: planetmoney@npr.org Enjoying this newsletter? Forward to a friend! They can sign up here. Looking for more great content? Check out all of our newsletter offerings — including Daily News, Politics, Health and more! You received this message because you're subscribed to Planet Money emails. This email was sent by National Public Radio, Inc., 1111 North Capitol Street NE, Washington, DC 20002 Unsubscribe  |  Privacy Policy