Biased AI in Systems of Education
Designing for Equitable AI in the Classroom
Want to explore how AI really works in classrooms—including the biases it brings? The Equity in AI project gives you hands-on tools, ready-to-use activities, and research insights to help students see what’s happening behind the algorithms.
Keep reading to learn about the research and what you’ll find.
When AI is told a student loves classical music versus rap music, it grades the exact same essay differently. Same words. Same structure. Different scores.
Identical essays receive systematically different scores based solely on a student’s stated music preference – a pattern that holds across multiple AI models.
So What Are We Doing About It?
This isn’t a glitch—it’s AI amplifying biases already baked into education. Our research-based project gives you practical ways to explore these patterns with students, understand what’s happening, and talk about it openly. Because the best way to deal with AI bias is to make it visible, discuss it, and learn from it together.
The BAISED Project
Biased AI in Systems of Education brings together researchers, educators, and designers to create hands-on learning experiences that help students and teachers critically examine AI technologies. Through interactive tools and classroom-ready activities, we make invisible biases visible and provide concrete ways to address them.
Experience AI Bias in Real-Time
See how AI can show bias when grading student work
AI Bias Explorer
Student A
“in detention yesterday”
Student B
“in honors assembly”
Same work. 9-point difference.
Test Multiple Scenarios
Socioeconomic indicators, language background, and more
Real-Time Results
Watch AI grade differently by context
Explore and Experiment
Create your own bias scenarios
Ready to uncover AI bias?
Try the AI Bias Explorer →Classroom AI Activities
Ready-to-use activities that help students explore AI bias
Is An AI Picture Worth 1000 Words?
Students see how AI moves between text and images, and what assumptions it makes along the way
AI Story Swap: Who Gets to be the Main Character?
Explore whose narratives AI centers and whose get pushed to the margins
Everyday Chemistry and AI
Discover how AI interprets chemical concepts differently based on cultural context and prior assumptions
Each activity includes facilitation guides and connects to broader conversations about equity and technology.
Browse All Activities →Blog
Ongoing conversations about AI, education, and equity
Thoughts, reflections, and ongoing conversations about AI in education. What we’re learning from classrooms, emerging research, and the bigger questions about equity and technology. A space to think out loud together.
Ready to Get Started?
Explore interactive tools, grab classroom activities, and join the conversation about making AI work better for everyone.
Explore EquityInAI.net
