Skip to content
Search

Latest Stories

Follow Us:
Top Stories

AI could help remove bias from medical research and data

Opinion

Researcher looks at mammography test

Artificial intelligence can help root out racial bias in health care, but only if the programmers can create the software so it doesn't make the same mistakes people make, like misreading mammograms results, writes Pearl.

Anne-Christine Poujoulat/AFP via Getty Images
Pearl is a clinical professor of plastic surgery at the Stanford University School of Medicine and is on the faculty of the Stanford Graduate School of Business. He is a former CEO of The Permanente Medical Group.

This is the second entry in a two-part op-ed series on institutional racism in American medicine.

A little over a year before the coronavirus pandemic reached our shores, the racism problem in U.S. health care was making big headlines.

But it wasn't doctors or nurses being accused of bias. Rather, a study published in Science concluded that a predictive health care algorithm had, itself, discriminated against Black patients.

The story originated with Optum, a subsidiary of insurance giant UnitedHealth Group, which had designed an application to identify high-risk patients with untreated chronic diseases. The company's ultimate goal was to help re-distribute medical resources to those who'd benefit most from added care. And to figure out who was most in need, Optum's algorithm assessed the cost of each patient's past treatments.

Unaccounted for in the algorithm's design was this essential fact: The average Black patient receives $1,800 less per year in total medical care than a white person with the same set of health problems. And, sure enough, when the researchers went back and re-ranked patients by their illnesses (rather than the cost of their care), the percentage of Black patients who should have been enrolled in specialized care programs jumped from 18 percent to 47 percent.

Journalists and commentators pinned the blame for racial bias on Optum's algorithm. In reality, technology wasn't the problem. At issue were the doctors who failed to provide sufficient medical care to the Black patients in the first place. Meaning, the data was faulty because humans failed to provide equitable care.

Artificial intelligence and algorithmic approaches can only be as accurate, reliable and helpful as the data they're given. If the human inputs are unreliable, the data will be, as well.

Let's use the identification of breast cancer as an example. As much as one-third of the time, two radiologists looking at the same mammogram will disagree on the diagnosis. Therefore, if AI software were programmed to act like humans, the technology would be wrong one-third of the time.

Instead, AI can store and compare tens of thousands of mammogram images — comparing examples of women with cancer and without — to detect hundreds of subtle differences that humans often overlook. It can remember all those tiny differences when reviewing new mammograms, which is why AI is already estimated to be 10 percent more accurate than the average radiologist.

What AI can't recognize is whether it's being fed biased or incorrect information. Adjusting for bias in research and data aggregation requires that humans acknowledge their faulty assumptions and decisions, and then modify the inputs accordingly.

Correcting these types of errors should be standard practice by now. After all, any research project that seeks funding and publication is required to include an analysis of potential bias, based on the study's participants. As an example, investigators who want to compare people's health in two cities would be required to modify the study's design if they failed to account for major differences in age, education or other factors that might inappropriately tilt the results.

Given how often data is flawed, the possibility of racial bias should be explicitly factored into every AI project. With universities and funding agencies increasingly focused on racial issues in medicine, this expectation has the potential to become routine in the future. Once it is, AI will force researchers to confront bias in health care. As a result, the conclusions and recommendations they provide will be more accurate and equitable.

Thirteen months into the pandemic, Covid-19 continues to kill Black individuals at a rate three times higher than white people. For years, health plans and hospital leaders have talked about the need to address health disparities like these. And yet, despite good intentions, the solutions they put forth always look a lot like the failed efforts of the past.

Addressing systemic racism in medicine requires that we analyze far more data (all at once) than we do today. AI is the perfect application for this task. What we need is a national commitment to use these types of technologies to answer medicine's most urgent questions.

There is no antidote to the problem of racism in medicine. But combining AI with a national commitment to root out bias in health care would be a good start, putting our medical system on a path toward antiracism.


Read More

Hands resting on another.

An op-ed challenging claims of American moral decline and arguing that everyday citizens still uphold shared values of justice and compassion.

Getty Images, PeopleImages

Americans Haven’t Lost Their Moral Compass — Their Leaders Have

When thinking about the American people, columnist David Brooks is a glass-half-full kind of guy, but I, on the contrary, see the glass overflowing with goodness.

In his farewell column to The New York Times readers, Brooks wrote, “The most grievous cultural wound has been the loss of a shared moral order. We told multiple generations to come up with their own individual values. This privatization of morality burdened people with a task they could not possibly do, leaving them morally inarticulate and unformed. It created a naked public square where there was no broad agreement about what was true, beautiful and good. Without shared standards of right and wrong, it’s impossible to settle disputes; it’s impossible to maintain social cohesion and trust. Every healthy society rests on some shared conception of the sacred — sacred heroes, sacred texts, sacred ideals — and when that goes away, anxiety, atomization and a slow descent toward barbarism are the natural results.”

Keep ReadingShow less
Collective Punishment Has No Place in A Constitutional Democracy

U.S. Secretary of the Department of Homeland Security Kristi Noem during a meeting of the Cabinet in the Cabinet Room of the White House on January 29, 2026 in Washington, DC.

(Photo by Win McNamee/Getty Images)

Collective Punishment Has No Place in A Constitutional Democracy

On January 8, 2026, one day after the tragic killing of Renee Good in Minneapolis, Minnesota, Kristi Noem, Secretary of the Department of Homeland Security, held a press conference in New York highlighting what she portrayed as the dangerous conditions under which ICE agents are currently working. Referring to the incident in Minneapolis, she said Good died while engaged in “an act of domestic terrorism.”

She compared what Good allegedly tried to do to an ICE agent to what happened last July when an off-duty Customs and Border Protection Officer was shot on the street in Fort Washington Park, New York. Mincing no words, Norm called the alleged perpetrators “scumbags” who “were affiliated with the transnational criminal organization, the notorious Trinitarios gang.”

Keep ReadingShow less
Why does the Trump family always get a pass?

Eric Trump, the newly appointed ALT5 board director of World Liberty Financial, walks outside of the NASDAQ in Times Square as they mark the $1.5- billion partnership between World Liberty Financial and ALT5 Sigma with the ringing of the NASDAQ opening bell, on Aug. 13, 2025, in New York City.

(Tribune Content Agency)

Why does the Trump family always get a pass?

Deputy Attorney General Todd Blanche joined ABC’s “This Week” on Sunday to defend or explain a lot of controversies for the Trump administration: the Epstein files release, the events in Minneapolis, etc. He was also asked about possible conflicts of interest between President Trump’s family business and his job. Specifically, Blanche was asked about a very sketchy deal Trump’s son Eric signed with the UAE’s national security adviser, Sheikh Tahnoon.

Shortly before Trump was inaugurated in early 2025, Tahnoon invested $500 million in the Trump-owned World Liberty, a then newly launched cryptocurrency outfit. A few months later, UAE was granted permission to purchase sensitive American AI chips. According to the Wall Street Journal, which broke the story, “the deal marks something unprecedented in American politics: a foreign government official taking a major ownership stake in an incoming U.S. president’s company.”

Keep ReadingShow less
Trump taxes

A critical analysis of Trump’s use of power, personality-driven leadership, and the role citizens must play to defend democracy and constitutional balance.

Getty Images

Trump, The Poster Child of a Megalomaniac

There is no question that Trump is a megalomaniac. Look at the definition: "An obsession with grandiose or extravagant things or actions." Whether it's relatively harmless actions like redecorating the White House with gold everywhere or attaching his name to every building and project he's involved in, or his more problematic king-like assertion of control over the world—Trump is a card-carrying megalomaniac.

First, the relatively harmless things. One recent piece of evidence of this is the renaming of the "Invest in America" accounts that the government will be setting up when children are born to "Trump" accounts. Whether this was done at Trump's urging or whether his Republican sycophants did it because they knew it would please him makes no difference; it is emblematic of one aspect of his psyche.

Keep ReadingShow less