Skip to content
Search

Latest Stories

Top Stories

Medical malpractice in the age of AI: Who will bear the blame?

Doctor holding a tablet projecting holographic data
pcess609/Getty Images

Pearl, the author of “ChatGPT, MD,” teaches at both the Stanford University School of Medicine and the Stanford Graduate School of Business. He is a former CEO of The Permanente Medical Group.

More than two-thirds of U.S. physicians havechanged their minds about generative artificial intelligence and now view the technology as beneficial to health care. But as AI grows more powerful and prevalent in medicine, apprehensions remain high among medical professionals.

For the last 18 months, I’ve examined the potential uses and misuses of generative AI in medicine — research that culminated my new book,ChatGPT, MD.” Over that time, I’ve seen the fears of clinicians evolve — from worries over AI’s reliability and, consequently, patient safety to a new set of fears: Who will be held liable when something goes wrong?


Technology experts have grown increasingly optimistic that next generations of AI technology will prove reliable and safe for patients, especially underexpert human oversight. As evidence, recall that Google’s first medical AI model, Med-PaLM, achieved a mere “passing score” (>60 percent) on the U.S. medical licensing exam in late 2022. Five months later, its successor, Med-PaLM 2, scored at an “expert” doctor level (85 percent).

Since then,numerous studies have shown that generative AI increasingly outperforms medical professionals in various tasks. These include diagnosis, treatment decisions, data analysis andeven empathy.

Sign up for The Fulcrum newsletter

Despite these advancements, errors in medicine can and will occur, regardless of whether the expertise comes from human clinicians or advanced AI technologies.

Legal experts anticipate that as AI tools become more integrated into health care, determining liability will come down to whether errors result from AI decisions, human oversight or a combination of both.

For instance, if doctors use a generative AI tool in their offices for diagnosing or treating a patient and something goes wrong, the physician would likely be held liable, especially if it’s deemed that clinical judgment should have overridden the AI’s recommendations.

But the scenarios get more complex when generative AI is used without direct physician oversight. As an example, who is liable when patients rely on generative AI’s medical advice without consulting a doctor? Or what if a clinician encourages a patient to use an at-home AI tool for help with interpreting wearable device data, and the AI’s advice leads to a serious health issue?

In a working paper, legal scholars from the University of Michigan, Penn State and Harvard explored these challenges, noting: “Demonstrating the cause of an injury is already often hard in the medical context, where outcomes are frequently probabilistic rather than deterministic. Adding in AI models that are often non intuitive and sometimes inscrutable will likely make causation even more challenging to demonstrate.”

To get a better handle on the risks posed to clinicians when using AI, I spoke with Michelle Mello, professor of law and health policy at Stanford University and lead author of “Understanding Liability Risk from Using Health Care Artificial Intelligence Tools.”

Her analysis, based on hundreds of tort cases, suggests that current legal precedents around software liability could be adapted to include AI. However, she points out that direct case law on any type of AI model remains “very sparse.” And when it comes to liability implications of using generative AI, specifically, there’s no public record of such cases being litigated.

So, for medical professionals worried about the risks of implementing AI, Mello offers reassurances mixed with warnings.

“At the end of the day, it has almost always been the case that the physician is on the hook when things go wrong in patient care,” she noted, but added: “As long as physicians are using this to inform a decision with other information and not acting like a robot, deciding purely based on the output, I suspect they’ll have a fairly strong defense against most of the claims that might relate to their use of GPTs.”

To minimize the risk, Mello said AI should be implemented as a supportive tool to enhance (not replace) clinical decisions. She also urges health care professionals to negotiate terms of service with major AI developers like Nvidia, OpenAI and Google, whose current disclaimers deny any liability for medical harm.

While concerns about the use of generative AI in health care are understandable, it’s critical to weigh these fears against the existing flaws in medical practice.

Each year, misdiagnoses lead to 371,000 American deaths while another 424,000 patients suffer permanent disabilities. Meanwhile, more than 250,000 deaths occur due to avoidable medical errors in the United States. Half a million people die annually from poorly managed chronic diseases, leading to preventable heart attacks, strokes, cancers, kidney failures and amputations.

Our nation’s health care professionals don’t have the time available in their daily practice to address the totality of patient needs. The demand for medical care is higher than ever at a time when health insurers — with their restrictive policies and bureaucratic requirements — make it harder than ever to provide excellent care.

It is imperative for policymakers, legal experts and health care professionals to collaborate on a framework that promotes the safe and effective use of AI. As part of their work, they’ll need to address concerns over liability. But they must recognize that the risks of not using generative AI to improve care will far outweigh the dangers posed by the technology itself. Only then can our nation reduce the enormous human toll resulting from our current medical failures.

Read More

An AI Spark Worth Spreading

People working with AI technology.

Getty Images, Maskot

An AI Spark Worth Spreading

In the rapidly evolving landscape of artificial intelligence, policymakers face a delicate balancing act: fostering innovation while addressing legitimate concerns about AI's potential impacts. Representative Michael Keaton’s proposed HB 1833, also known as the Spark Act, represents a refreshing approach to this challenge—one that Washington legislators would be right to pass and other states would be wise to consider.

As the AI Innovation and Law Fellow at the University of Texas at Austin School of Law, I find the Spark Act particularly promising. By establishing a grant program through the Department of Commerce to promote innovative uses of AI, Washington's legislators have a chance to act on a fundamental truth: technological diffusion is essential to a dynamic economy, widespread access to opportunity, and the inspiration of future innovation.

Keep ReadingShow less
Trump’s Gambit: Trade Tariff Relief For a TikTok Sale

TikTok icon on a phone.

Getty Images, 5./15 WEST

Trump’s Gambit: Trade Tariff Relief For a TikTok Sale

You know things aren’t going well in the negotiations for the U.S. operations of TikTok when President Trump has to bribe the Chinese government with billions in tariff relief.

But that’s exactly what was reported out of the White House. President Trump is willing to give the Chinese Communist Party (CCP) billions in tariff relief if they pressured TikTok to sell its U.S. operations before the April 5th deadline.

Keep ReadingShow less
Who gets to ask questions at the White House?

WASHINGTON, DC, USA –– White House Press Secretary Karoline Leavitt answers questions from journalists on Jan. 28, 2025.

(Joshua Sukoff/Medill News Service)

Who gets to ask questions at the White House?

WASHINGTON — As the Trump administration increasingly welcomes vloggers and social media influencers into press briefings and the Oval Office, established outlets like the Associated Press find themselves excluded from the century-old press pool, sparking controversy about what "transparency" truly means.

Watch the video report here:

Keep ReadingShow less
Lost Sams and Missing Fei-Feis: Why America Needs AI Guides Now

Students studying robotics.

Getty Images, eyesfoto

Lost Sams and Missing Fei-Feis: Why America Needs AI Guides Now

In 2018, Economist Raj Chetty and his colleagues revealed a sobering truth: talent is everywhere, but opportunity is not. Their research on "Lost Einsteins" demonstrated that countless young Americans with the potential to be great inventors never get the chance to develop their skills simply because they lack exposure to innovation and mentorship. The data was clear: if a child grows up in an area with a high concentration of inventors, they are far more likely to become one themselves. But for too many, particularly those in rural and lower-income communities, the door to innovation remains closed. Failure to find those “Lost Einsteins” has deprived us all of a better future. Chetty forecasted that "if women, minorities, and children from low-income families were to invent at the same rate as white men from high-income (top 20%) families, the rate of innovation in America would quadruple." That’s a more prosperous, dynamic America.

The introduction of artificial intelligence (AI) carries the promise of realizing that brighter future if we learn from our prior mistakes. A lack of broad exposure among our youth to AI and the individuals shaping its development threatens to leave behind an entire generation of would-be entrepreneurs, scholars, and thought leaders. We risk creating "Lost Sams"—referring to OpenAI's Sam Altman as a stand-in for AI innovators—and "Missing Fei-Feis"—a nod to Stanford AI researcher Fei-Fei Li. Without urgent action, we will reinforce the existing gaps in AI leadership, limiting who gets to shape the future of this transformative technology.

Keep ReadingShow less