Skip to content
Search

Latest Stories

Top Stories

AI is Fabricating Misinformation: A Call for AI Literacy in the Classroom

AI is Fabricating Misinformation: A Call for AI Literacy in the Classroom

Students using computers in a classroom.

Getty Images / Tom Werner

Want to learn something new? My suggestion: Don’t ask ChatGPT. While tech leaders promote generative AI tools as your new, go-to source for information, my experience as a university librarian suggests otherwise. Generative AI tools often produce “hallucinations,” in the form of fabricated misinformation that convincingly mimics actual, factual truth.

The concept of AI “hallucinations” came to my attention not long after the launch of ChatGPT. Librarians at universities and colleges throughout the country began to share a puzzling trend: students were spending time fruitlessly searching for books and articles that simply didn’t exist. It was only after questioning that students revealed their source as ChatGPT. In the tech world, these fabrications are called “hallucinations,” a term borrowed from psychiatry to describe sensory systems that become temporarily distorted. In this context, the term implies generative AI has human cognition, but it emphatically does not. The fabrications are outputs of non-human algorithms that can misinform – and too often, do.


In April of 2023, a news headline read: ChatGPT is making up fake Guardian articles. The story began by describing a surprising incident. A reader had inquired about an article that couldn’t be found. The reporter couldn’t remember having written such an article, but it “certainly sounded like something they would have written.” Colleagues attempted to track it down, only to discover that no such article had been published. As librarians had learned just weeks prior, ChatGPT had fabricated an article citation, but this time the title was so believable that even the reporter couldn’t remember if they’d written it.

Since the release of ChatGPT two years ago, OpenAI’s valuation has soared to $157 billion, which might suggest that hallucinations are no longer a problem. However, you’d be wrong. Hallucinations are not a ‘problem’ but an integral “ feature ” of how ChatGPT, and other generative AI tools, work. According to Kristian Hammon, Professor and Director of the Center for Advancing Safety of Machine Intelligence, “hallucinations are not bugs; they’re a fundamental part” of how generative AI works. In an essay describing the hallucination problem, he concludes, “Our focus shouldn’t be on eliminating hallucinations but on providing language models with the most accurate and up-to-date information possible…staying as close to the truth as the data allows.”

Companies like OpenAI have been slow to educate the public about this issue. For example, OpenAI released its first ChatGPT guide for students only in November 2024, almost 24 months after ChatGPT launched. Rather than explaining hallucinations, the guide states simply, “Since language models can generate inaccurate information, always double-check your facts.” Educating the public about fabricated misinformation and how to discern AI fact from fiction has not been a priority for OpenAI.

Even experts have difficulty deciphering AI’s fabrications. A Stanford University professor recently apologized for using citations generated by ChatGPT in a November 1 court filing supporting a Minnesota law banning political deepfakes. The citation links went to nonexistent journal articles and incorrect authors. The professor’s use of these citations has called his expertise into question and opened the door to excluding his declaration from the court’s consideration. Interestingly, he was paid $600 an hour to write the filing, and he researches “lying and technology.”

Jean-Christophe Bélisle-Pipon, a health sciences professor at Simon Fraser University in British Columbia, warns that AI hallucinations can have “life-threatening consequences” in medicine. He points out, “The standard disclaimers provided by models like ChatGPT, which warn that ‘ChatGPT can make mistakes. Check important info,’ are insufficient safeguards in clinical settings.” He suggests training medical professionals to understand that AI content is not always reliable, even though it may sound convincing.

To be sure, AI doesn’t always hallucinate and humans also make mistakes. When I explain the issue of AI hallucinations and the need for public education to students and friends, a common response is, “But, humans make mistakes, too.” That’s true–but we’re well-aware of human fallibility. That same awareness doesn’t extend to content created by AI tools like ChatGPT. Instead, humans have a well-documented tendency to believe automated tools, a phenomenon known as automation bias. The misinformation coming from AI tools is especially dangerous because it is less likely to be questioned. As Emily Bender, a professor of computational linguistics, summarized, “a system that is right 95% of the time is arguably more dangerous than one that is right 50% of the time. People will be more likely to trust the output, and likely less able to fact check the 5%”.

Anyone using ChatGPT or other AI tools needs to understand that fabricated misinformation, “hallucinations”, are a problem. Beyond a simple technical glitch, hallucinations pose real dangers, from academic missteps to life-threatening medical errors. Fabricated misinformation is just one of the many challenges of living in an AI-infused world.

We have an ethical responsibility to teach students not only how to use AI but also how to critically evaluate AI inputs, processes, and outputs. Educational institutions have the opportunity and the obligation to create courses and initiatives that prepare students to confront the ethical challenges posed by AI, that is why we are currently developing a Center for AI Literacy and Ethics at Oregon State University. It is imperative that educational institutions, not corporations, lead the charge in educating our students about the ethical dimensions and critical use of AI.

Laurie Bridges is an instruction librarian and professor at Oregon State University. She recently taught “Generative AI and Society,” an OSU Honors College colloquium focused on AI literacy and ethics. Laurie Bridges is a Public Voices Fellow of the Op-Ed Project.

Read More

Carolyn Lukensmeyer Turns 80: A Life of Commitment to “Of, By, and for the People”

Carolyn Lukensmeyer.

The National Institute for Civil Discourse and New Voice Strategies

Carolyn Lukensmeyer Turns 80: A Life of Commitment to “Of, By, and for the People”

I’ve known Dr. Carolyn Lukensmeyer for over a decade, first meeting her about a decade ago. Dr. Lukensmeyer is a nationally renowned expert in deliberative democracy, a former executive director emerita of the National Institute for Civil Discourse, and a member of the American Academy of Arts & Sciences’ Commission on the Practice of Democratic Citizenship.

On the weekend of her 80th birthday, former colleagues, clients, and friends offered a look at Dr. Lukensmeyer’s extraordinary commitment to “of, by, and for the peoples,” from her earlier days in Iowa and Ohio to the present day.

Keep ReadingShow less
Public Health: Ban First, Study Later? The Growing Assault on Fluoridated Water

Someone getting tap water.

Getty Images, urbazon

Public Health: Ban First, Study Later? The Growing Assault on Fluoridated Water

On May 15, Florida became the second state in the nation to ban fluoride from public drinking water. The bill, signed by Governor Ron DeSantis, is set to go into effect on July 1. Utah’s Governor Spencer Cox enacted a similar ban that went into effect this May. Five other states—Kentucky, Louisiana, Massachusetts, Nebraska, and South Carolina—have introduced bills that aim to ban fluoride in public drinking water.

Fluoride is a mineral that, in small quantities, has proven to be effective against tooth decay, caused by bacteria that form in the mouth when we eat or drink. The American Academy of Pediatrics states on its website that studies have shown water fluoridation, an intentional treatment process of public drinking water, reduces tooth decay by about 25% in children and adults alike.

Keep ReadingShow less
POLL: Americans Wary About The President Taking Unconventional Actions
APM Research Lab

POLL: Americans Wary About The President Taking Unconventional Actions

Americans show a strong preference for their elected executives — governors as well as the president — to achieve their political goals through conventional, sometimes slow, procedures, according to the McCourtney Institute for Democracy’s latest Mood of the Nation Poll.

Results showed marked partisan differences. For example, 26% of all survey respondents rated a presidential action of firing all recently hired federal employees as “very appropriate,” including only four percent of Democrats and just over half of Republicans.

Keep ReadingShow less
The U.S. Is Rushing To Make AI Deals With Gulf Countries, But Who Will Help Keep Children Safe?

A child's hand holding an adult's hand.

Getty Images, LaylaBird

The U.S. Is Rushing To Make AI Deals With Gulf Countries, But Who Will Help Keep Children Safe?

As the United States deepens its investments in artificial intelligence (AI) partnerships abroad, it is moving fast — signing deals, building labs, and exporting tools. Recently, President Donald Trump announced sweeping AI collaborations with Gulf countries like Saudi Arabia and the United Arab Emirates. These agreements, worth billions, are being hailed as historic moments for digital diplomacy and technological leadership.

But amid the headlines and handshakes, I keep asking the same question: where is child protection in all of this?

Keep ReadingShow less