What is AI-generated misinformation?

Originally published on January 27, 2025

Overview

AI chatbots and image generation models possess the remarkable ability to create digital content at a pace far surpassing human capabilities. However, AI models can also generate fabricated or deceptive materials. In this lesson, students are asked to consider: How can AI models be used to generate false information? How can AI-generated fakes be detected?

AI & Social Studies

60 minutes

Created by Jon Ball, CRAFT Student Designer 2022-2023

Adapted by Chris Mah

Digital Materials

Objectives

After this experience, students will be able to

Distinguish between AI “misinformation” and AI “disinformation”
Assess the credibility of AI-generated content

Questions explored

How can AI be used to generate mis- and disinformation?
How can we spot and verify AI-generated content?

Key Terms

Generative Artificial Intelligence (GAI, Gen AI)

AI that creates new content like text, images, music, and voice by itself, showing creativity.

AI or NOT AI?

This activity is designed to engage students in critical thinking about what constitutes artificial intelligence (AI). By sorting and categorizing everyday technologies, students will draw on their pre-existing knowledge to co-create a shared understanding of AI and its distinguishing features.

Created by Jessica Ann

How do I fact-check AI search results?

Studies consistently show that students are using AI chatbots and search engines like ChatGPT and Perplexity. But we know that AI makes mistakes. So, how do we teach students not to get fooled? In this lesson, we’ll introduce students to the skill of lateral reading (Wineburg & McGrew, 2017) as one approach to fact-checking the information they get from AI.

Created by Chris Mah

How can we mitigate bias in AI design?

This lesson introduces students to the concept of bias in AI training data and its societal implications. Using a real-world example of Google’s Gemini AI, students will explore how overrepresentation and underrepresentation in datasets affect various groups.

Created by Chelsea Dixon

Adapted by Chris Mah