💡 Our Technical Review in summary
Starting April 17, 2026, Dynamics 365 Customer Service will introduce the ability to define “critical questions” within evaluation criteria. This feature is designed to strengthen quality assurance by allowing organizations to designate specific questions as mandatory. If a question marked as critical is failed, the entire evaluation is automatically failed, ensuring that essential business, legal, or safety requirements are strictly upheld.
Impact
- Automated Compliance Enforcement: Evaluations will now automatically fail if key requirements (such as mandatory disclosures or regulatory compliance steps) are missed, regardless of how well the agent performed in other areas.
- Quality Evaluation Agent Integration: The feature is fully integrated with the existing Quality Evaluation Agent framework, supporting criteria versioning to track changes over time.
- Risk Mitigation: Supervisors can use simulations to test the impact of “critical” designations on evaluation outcomes before publishing them, ensuring the criteria are fair and accurate.
- Auditability: The system maintains consistent and auditable quality outcomes, making it easier for organizations to prove compliance during external or internal audits.
Action Required
- Review Existing Criteria: IT Administrators and Quality Managers should review current evaluation templates to identify which questions should be elevated to “critical” status.
- Supervisor Training: Inform supervisors and quality evaluators about the upcoming change and how the “automatic failure” logic will affect overall performance metrics.
- Utilize Simulations: Once available, use the simulation tools within the Quality Evaluation Agent to validate new criteria configurations before the General Availability date of April 17, 2026.
- No Immediate Technical Changes: This is currently an awareness notification; no back-end configuration is required until the feature is released to your environment.
Microsoft Official Update
Service: N/A
Category: stayInformed
Severity: normal
We are announcing the ability to define critical questions in evaluation criteria in Dynamics 365 Customer Service. This feature will reach general availability on April 17, 2026.
How does this affect me?
Critical questions allow users to mark questions within an evaluation criterion as critical and define the specific responses that result in failure. When the evaluation criteria are applied during an evaluation run and if any critical question fails, the entire evaluation is automatically marked as failed, regardless of other scores. This ensures that business-essential requirements such as compliance, safety, or mandatory disclosures are always enforced as part of quality standards.
Critical questions integrate with the Quality Evaluation Agent framework including criteria versioning and simulations allowing supervisors to validate changes before publishing while maintaining consistent, auditable quality outcomes.
What action do I need to take?
This message is for awareness, and no action is required.
