A framework for safe participation with AI for the next generation
Microsoft introduced a framework to ensure safe, age-appropriate AI participation for young people, emphasizing privacy, protection, and opportunity without trade-offs.
Microsoft unveiled its Safe Participation Framework to guide the design of AI tools that prioritize safety, privacy, and age-appropriate experiences for children and teenagers. The framework responds to feedback from the AI Youth Futures Council, which highlighted the need for protections that do not limit access to educational and creative opportunities. Microsoft argues that safeguards must be embedded from the outset, with risks assessed and mitigated through ongoing research and stakeholder input. The company acknowledges that its approach will evolve as technology and societal expectations change.
Microsoft’s safety-by-design approach involves identifying risks, evaluating product features, and implementing proportionate safeguards tailored to different technologies. The framework builds on over a decade of investments in online safety technologies, including PhotoDNA and protections for AI experiences. Recent updates to Windows Family Safety and Bing’s generative AI features reflect these efforts, with expanded safeguards against harmful content and child sexual abuse material. Microsoft emphasizes that trust requires continuous learning and adaptation to emerging threats.
The framework introduces the Windows Age API and expanded age assurance tools to provide developers with privacy-preserving age signals for age-appropriate experiences. These tools aim to create a consistent foundation for safer digital interactions across platforms while minimizing data collection. Microsoft notes that young people’s feedback has consistently stressed the importance of transparency in how their information is handled. The company’s digital literacy initiatives, such as the *Behind the Chat* toolkit, reflect a broader ecosystem approach to supporting young users and their families.
Microsoft plans to deepen partnerships with researchers, AI Safety Institutes, governments, and civil society to advance safer AI experiences. The company will expand digital literacy resources globally, including in Europe, Asia, and the Americas, starting this fall. Microsoft acknowledges that no single organization can address these challenges alone and calls for collaborative efforts to build a future where young people can safely participate in digital opportunities.