Microsoft agrees to binding AI privacy rules for US schools
A deal with America's second-largest teachers union bars addictive "companion" AI and data misuse in classrooms — but Google, the biggest player, hasn't signed on.
What happened: Microsoft has signed a legally binding agreement with the American Federation of Teachers, the second-largest US teachers union, setting privacy and safety rules for its AI tools in schools. Starting November 1, the standards apply to every US school district under a Microsoft contract. Independent auditors will check compliance, and Microsoft says it won't use student or teacher data to train its AI, sell it, or use it for advertising or product development, aside from a narrow safety exception.
Why it matters: AI chatbots are already embedded in daily schoolwork for millions of students, often without families knowing where conversations end up. The deal lands amid backlash: New York City and Los Angeles, the two biggest US school systems, paused broad student AI use this year to audit their tools. An Austrian study found 60% of surveyed 11-to-17-year-olds had already asked chatbots for help with stress, conflict or heartbreak, and Europe is weighing age limits on classroom AI too.
How the rules work: The agreement bans AI "companion" features built to foster emotional attachment or keep kids engaged longer than a task requires. Microsoft also commits to not using sensitive categories like gender, race, age or zip code to profile students, even with names stripped out. Families must get plain-language explanations of what data tools collect and why. Crucially, compliance is checked by outside auditors rather than taken on Microsoft's word alone.
Who's still on the sidelines: OpenAI and Anthropic say they're negotiating similar pacts with the same union and publicly welcomed Microsoft's move. But Google, whose Classroom product reaches over 150 million teachers and students worldwide, hasn't committed to anything comparable — despite criticism after it switched on its Gemini chatbot for many K-12 accounts in August. Experts note the standard only becomes meaningful industry-wide if rivals and the thousands of smaller ed-tech vendors adopt it too.