Skip to content
Search

Latest Stories

Follow Us:
Top Stories

We may face another 'too big to fail' scenario as AI labs go unchecked

NVIDIA headquarters

Our stock market pivots on the performance of a handful of AI-focused companies like Nvidia.

hapabapa/Getty Images

Frazier is an assistant professor at the Crump College of Law at St. Thomas University and a Tarbell fellow.

In the span of two or so years, OpenAI, Nvidia and a handful of other companies essential to the development of artificial intelligence have become economic behemoths. Their valuations and stock prices have soared. Their products have become essential to Fortune 500 companies. Their business plans are the focus of the national security industry. Their collapse would be, well, unacceptable. They are too big to fail.

The good news is we’ve been in similar situations before. The bad news is we’ve yet to really learn our lesson.


In the mid-1970s, a bank known for its conservative growth strategy decided to more aggressively pursue profits. The strategy worked. In just a few years the bank became the largest commercial and industrial lender in the nation. The impressive growth caught the attention of others — competitors looked on with envy, shareholders with appreciation and analysts with bullish optimism. As the balance sheet grew, however, so did the broader economic importance of the bank. It became too big to fail.

Regulators missed the signs of systemic risk. A kick of the bank’s tires gave no reason to panic. But a look under the hood — specifically, at the bank’s loan-to-assets ratio and average return on loans — would have revealed a simple truth: The bank had been far too risky. The tactics that fueled its go-go years rendered the bank over exposed to sectors suffering tough economic times. Rumors soon spread that the bank was in a financially sketchy spot. It was the Titanic, without the band, to paraphrase an employee.

When the inevitable run on the bank started, regulators had no choice but to spend billions to keep the bank afloat — staving it from sinking and bringing the rest of the economy with it. Of course, a similar situation played out during the Great Recession — risky behavior by a few bad companies imposed bailout payments on the rest of us.

AI labs are similarly taking gambles that have good odds of making many of us losers. As major labs rush to release their latest models, they are not stopping to ask if we have the social safety nets ready if things backfire. Nor are they meaningfully contributing to building those necessary safeguards.

Instead, we find ourselves in a highly volatile situation. Our stock market seemingly pivots on earnings of just a few companies — the world came to a near standstill last month as everyone awaited Nvidia’s financial outlook. Our leading businesses and essential government services are quick to adopt the latest AI models despite real uncertainty as to whether they will operate as intended. If any of these labs took a financial tumble or any of the models were significantly flawed, the public would likely again be asked to find a way to save the risk takers.

This outcome may be likely but it’s not inevitable. The Dodd-Frank Act passed in response to the Great Recession and intended to prevent another Too Big to Fail situation in the financial sector has been roundly criticized for its inadequacy. We should learn from its faults in thinking through how to make sure AI goliaths don’t crush all of us Davids.

Some sample steps include mandating and enforcing more rigorous testing of AI models before deployment. It would also behoove us to prevent excessive reliance on any one model by the government — this could be accomplished by requiring public service providers to maintain analog processes in the event of emergencies. Finally, we can reduce the economic sway of a few labs by fostering more competition in the space.

Too Big to Fail scenarios have happened on too many occasions. There’s no excuse for allowing AI labs to become so large and so essential that we collectively end up paying for their mistakes.


Read More

The Case for Intergenerational AI Advocacy
The letters ai are displayed on a blurred background.
Photo by Zach M on Unsplash

The Case for Intergenerational AI Advocacy

If Allison Baker and Maria Garcia apply for the same job against Matthew Owens or Joe Alvarez, and Matthew or Joe gets the job despite everything else being the same, that would seem to be a typical case of gender discrimination by the employer.

However, the names and scenarios I described were not drawn from a human example, but from AI. ChatGPT generated female candidates who were, on average, 1.6 years younger than their male counterparts and considered them less qualified than male applicants. Given AI’s pervasiveness in hiring decisions, these biases pose a significant concern.

Keep ReadingShow less
Rebuilding America’s Federal Data System for Trust and Accuracy

How the U.S. can rebuild and improve its federal data system by combining Census, citizen, AI, and nontraditional data for stronger public policy.

sankai/Getty Images

Rebuilding America’s Federal Data System for Trust and Accuracy

The business aphorism, “You can’t manage what you don’t measure,” applies to countries as well as corporations. The U.S. has relied since its founding on accurate Census, economic, and health and scientific data to set national policy. As an earlier Fulcrum article described, the Trump administration has put many data sources at risk, and advocates are working to save them. But they’re also asking: As we protect and rebuild the national data ecosystem, how do we make it better than it has been in the past?

I recently moderated a webinar on Meeting the Challenge of Measurement, co-sponsored by NAPA, CODE, and the Bridge Alliance, with four leaders in the field: Chris Jackson of the research firm SSRS, Beth Jarosz of the Association of Public Data Users, Francesca Perucci of Open Data Watch, and Dr. Stefaan Verhulst of the GovLab. I also interviewed former U.S. Comptroller Gene Ludwig, author of The Mismeasurement of America. Their insights, plus my organization’s recent work with USAFacts, provide three principles for moving forward.

Keep ReadingShow less
Businessman typing on laptop computer keyboard at desk in office.

As nonprofits increasingly use AI to determine access to food, housing, and healthcare assistance, concerns over transparency, accountability, and algorithmic bias are growing. Explore how artificial intelligence is reshaping America's social safety net and why policymakers are being urged to act.

tadamichi/Getty Images

Why Nonprofits Are Becoming America's Unofficial AI Welfare State

America's safety net has new administrators. They are not government agencies. They are nonprofits and are making decisions using algorithms.

Nationally, civil society organizations are using AI to determine who receives food assistance, emergency shelter, and medical referrals. In an era of federal and state budget cuts and struggles with the latest administrative databases that support necessary operations, nonprofits have gradually stepped into these roles. An unofficial AI welfare state is emerging, operating beyond the boundaries of official ones.

Keep ReadingShow less
Person using tablet for health reasons.

AI isn't just for doctors. Consumer AI could improve patient outcomes, reduce medical errors, and reshape U.S. healthcare through smarter public policy.

RossHelen/Getty Images

Federal Action Could Unlock AI’s Power for Millions of Patients

When it comes to medicine, Washington, D.C., is not anti-AI. In a string of recent legislative announcements, the White House has made AI innovation a national priority. The U.S. Department of Health and Human Services (HHS) is exploring strategies to accelerate AI in clinical care. And the FDA has already authorized more than 1,500 AI-enabled medical devices.

But these efforts, similar to the approach taken by the private sector, have focused solely on advancing AI for clinicians, hospitals, and health systems.

Keep ReadingShow less