HomeMicrosoft unveils tool for developers to create AI behavior tests from text descriptions
AI researchers and labs have made significant progress in evaluating AI models for safety, compliance, sycophancy, and alignment. However, companies and developers now face a specific challenge: ensuring their AI systems behave exactly as intended for their particular product or service.
To simplify that testing process, Microsoft unveiled ASSERT on Tuesday—an acronym for Adaptive Spec-driven Scoring for Evaluation and Regression Testing.
According to Microsoft, the open-source framework makes it easy to evaluate application-specific AI behavior. It uses AI to convert high-level, natural-language descriptions of goals, policies, or intended behaviors into comprehensive, scored tests that can be examined.
ASSERT accepts plain-language descriptions of an AI model's expected behavior and policies, then transforms them into a structured set of acceptable and unacceptable behaviors. It generates problem scenarios and test cases, runs them against the target system, and scores the results. The framework also records the AI system's paths, including intermediate actions and tool calls, allowing developers to inspect where failures occur.
Developers can also provide system context, tools, and constraints to further customize what the evaluations cover.
For instance, a developer could specify that a document research AI agent should not email people outside the company, must restrict confidential information to C-level executives, and should provide concise summaries while considering prior context. ASSERT then uses those rules to generate test cases that continuously check whether the system follows them.
Image Credits:Microsoft
According to Microsoft, the framework fills a gap that broader, more general evaluations cannot address when AI models are intended to behave in ways shaped by an application or product's context, policies, and tools.
“One of the things we’ve learned is that evaluations are absolutely critical to making good decisions,” said Sarah Bird, chief product officer of Responsible AI at Microsoft. “Because if you don’t understand the behavior of the AI system, it’s really hard to know if it’s meeting your organization’s bar […] What we found is that if you really want a trustworthy system, you should evaluate many more dimensions that are application-specific.”
Bird said ASSERT can be used to evaluate systems during development, after deployment, and for continuous monitoring.
The release comes amid a gradual yet broader shift in the AI industry. As models become more capable, researchers are focusing on repeatable testing and regression checks. Stanford's HELM, MLCommons' AILuminate, and evaluation groups like METR are rolling out benchmarks to measure how models behave under different conditions.
Related article
Microsoft retires failed AI tools and consolidates Copilot apps
Two years ago, Microsoft characterized AI as a “generational shift” in technology that it aimed to lead. Today, the company is consolidating its Copilot-branded consumer and business applications, while discontinuing several underperforming AI featur
Microsoft reportedly trains sales staff to undercut rivals OpenAI and Anthropic
Microsoft is reportedly gearing up its sales force to intensify competition against key rivals in the artificial intelligence sector.According to a Bloomberg report, executives held an internal strategy session on Tuesday, instructing sales teams to
Could This Mark the Beginning of a Crisis for Token Economies?
Microsoft recently introduced significant price adjustments to GitHub Copilot, changes so substantial that a Reddit user referred to the situation as the Tokenpocalypse within their company.In the most recent episode of TechCrunch’s Equity podcast, K
Related Special Topic Recommendations
Text-to-speech
Best AI Text to Speech Tools for Online Courses
2026 Latest Best Top-rated AI Text to Speech Tools for Online Courses are curated by XIX.AI based on rigorous real-world tests and weekly updated rankings. These powerful tools help creators deliver crystal-clear audio content effortlessly, boosting writing efficiency and streamlining course production. Check out the free vs paid comparison to find your perfect fit. Explore now to unlock your AI edge in online education.
10 tools
xix.ai
writing
AI Blog Title Tools for Higher Click Through Rates
2026 Latest Best Top-Rated AI Blog Title Tools for Higher Click Through Rates! XIX.AI has carefully curated a powerful, game-changing collection of top tools that go through rigorous real-world tests. You’ll find a free vs paid comparison, weekly updated rankings, and detailed insights to help you boost your blog’s traffic efficiently. Must-try options are highlighted to help you unlock your AI edge. Explore now!
10 tools
xix.ai
automation
Best AI Task Routing Tools for Support Workflows
2026 Latest Best Top-rated AI Task Routing Tools for Support Workflows! XIX.AI has curated a highly powerful game-changing collection of must-try solutions, all undergoing rigorous real-world tests and updated weekly. These tools streamline workflows, boost productivity, and help teams deliver faster, more efficient support. Explore now to discover your perfect tool and unlock your AI edge!
17 tools
xix.ai
Academic Research
AI Citation and Paper Summary Tools
2026 Latest Best Top-Rated AI Citation and Paper Summary Tools Curated by XIX.AI. Get powerful game-changing solutions for quick content creation, improved writing efficiency, and boosting productivity. We offer a free vs paid comparison along with real-world tests and weekly updated rankings to help you find the must-try tool that fits your needs perfectly. Explore now to Unlock your AI edge.
10 tools
xix.ai
Productivity
Best AI Productivity Tools for Daily Work
2026 Latest Best Top-Rated AI Productivity Tools for Daily Work! XIX.AI has curated a powerful, game-changing selection based on rigorous weekly updated rankings and real-world tests. You’ll find must-try options that boost writing efficiency, streamline content creation, and help you overcome daily work challenges. Get a free vs paid comparison to find the perfect fit for your needs. Explore now to unlock your AI edge!
9 tools
xix.ai
Academic Research
AI Systematic Review Tools for Research Screening
2026 Latest Best Top-Rated AI Systematic Review Tools for Research Screening are here on XIX.AI! This curated collection includes powerful, game-changing solutions that go through rigorous real-world tests to deliver accurate results. We also offer a free vs paid comparison along with weekly updated rankings to help you find the must-try option that boosts your research efficiency significantly. Explore now to unlock your AI edge in academic work!
11 tools
xix.ai
Comments (0)
0/500
AI researchers and labs have made significant progress in evaluating AI models for safety, compliance, sycophancy, and alignment. However, companies and developers now face a specific challenge: ensuring their AI systems behave exactly as intended for their particular product or service.
To simplify that testing process, Microsoft unveiled ASSERT on Tuesday—an acronym for Adaptive Spec-driven Scoring for Evaluation and Regression Testing.
According to Microsoft, the open-source framework makes it easy to evaluate application-specific AI behavior. It uses AI to convert high-level, natural-language descriptions of goals, policies, or intended behaviors into comprehensive, scored tests that can be examined.
ASSERT accepts plain-language descriptions of an AI model's expected behavior and policies, then transforms them into a structured set of acceptable and unacceptable behaviors. It generates problem scenarios and test cases, runs them against the target system, and scores the results. The framework also records the AI system's paths, including intermediate actions and tool calls, allowing developers to inspect where failures occur.
Developers can also provide system context, tools, and constraints to further customize what the evaluations cover.
For instance, a developer could specify that a document research AI agent should not email people outside the company, must restrict confidential information to C-level executives, and should provide concise summaries while considering prior context. ASSERT then uses those rules to generate test cases that continuously check whether the system follows them.
Image Credits:Microsoft
According to Microsoft, the framework fills a gap that broader, more general evaluations cannot address when AI models are intended to behave in ways shaped by an application or product's context, policies, and tools.
“One of the things we’ve learned is that evaluations are absolutely critical to making good decisions,” said Sarah Bird, chief product officer of Responsible AI at Microsoft. “Because if you don’t understand the behavior of the AI system, it’s really hard to know if it’s meeting your organization’s bar […] What we found is that if you really want a trustworthy system, you should evaluate many more dimensions that are application-specific.”
Bird said ASSERT can be used to evaluate systems during development, after deployment, and for continuous monitoring.
The release comes amid a gradual yet broader shift in the AI industry. As models become more capable, researchers are focusing on repeatable testing and regression checks. Stanford's HELM, MLCommons' AILuminate, and evaluation groups like METR are rolling out benchmarks to measure how models behave under different conditions.
Microsoft retires failed AI tools and consolidates Copilot apps
Two years ago, Microsoft characterized AI as a “generational shift” in technology that it aimed to lead. Today, the company is consolidating its Copilot-branded consumer and business applications, while discontinuing several underperforming AI featur
Microsoft reportedly trains sales staff to undercut rivals OpenAI and Anthropic
Microsoft is reportedly gearing up its sales force to intensify competition against key rivals in the artificial intelligence sector.According to a Bloomberg report, executives held an internal strategy session on Tuesday, instructing sales teams to
Could This Mark the Beginning of a Crisis for Token Economies?
Microsoft recently introduced significant price adjustments to GitHub Copilot, changes so substantial that a Reddit user referred to the situation as the Tokenpocalypse within their company.In the most recent episode of TechCrunch’s Equity podcast, K
2026 Latest Best Top-rated AI Text to Speech Tools for Online Courses are curated by XIX.AI based on rigorous real-world tests and weekly updated rankings. These powerful tools help creators deliver crystal-clear audio content effortlessly, boosting writing efficiency and streamlining course production. Check out the free vs paid comparison to find your perfect fit. Explore now to unlock your AI edge in online education.
10 tools
xix.ai
2026 Latest Best Top-Rated AI Blog Title Tools for Higher Click Through Rates! XIX.AI has carefully curated a powerful, game-changing collection of top tools that go through rigorous real-world tests. You’ll find a free vs paid comparison, weekly updated rankings, and detailed insights to help you boost your blog’s traffic efficiently. Must-try options are highlighted to help you unlock your AI edge. Explore now!
10 tools
xix.ai
2026 Latest Best Top-rated AI Task Routing Tools for Support Workflows! XIX.AI has curated a highly powerful game-changing collection of must-try solutions, all undergoing rigorous real-world tests and updated weekly. These tools streamline workflows, boost productivity, and help teams deliver faster, more efficient support. Explore now to discover your perfect tool and unlock your AI edge!
17 tools
xix.ai
2026 Latest Best Top-Rated AI Citation and Paper Summary Tools Curated by XIX.AI. Get powerful game-changing solutions for quick content creation, improved writing efficiency, and boosting productivity. We offer a free vs paid comparison along with real-world tests and weekly updated rankings to help you find the must-try tool that fits your needs perfectly. Explore now to Unlock your AI edge.
10 tools
xix.ai
2026 Latest Best Top-Rated AI Productivity Tools for Daily Work! XIX.AI has curated a powerful, game-changing selection based on rigorous weekly updated rankings and real-world tests. You’ll find must-try options that boost writing efficiency, streamline content creation, and help you overcome daily work challenges. Get a free vs paid comparison to find the perfect fit for your needs. Explore now to unlock your AI edge!
9 tools
xix.ai
2026 Latest Best Top-Rated AI Systematic Review Tools for Research Screening are here on XIX.AI! This curated collection includes powerful, game-changing solutions that go through rigorous real-world tests to deliver accurate results. We also offer a free vs paid comparison along with weekly updated rankings to help you find the must-try option that boosts your research efficiency significantly. Explore now to unlock your AI edge in academic work!
11 tools
xix.ai
