At enterprise scale, resilience takes on new dimensions. AI and agentic frameworks are rapidly automating software development and operations. As that shift accelerates, the role of resilience becomes even more foundational. It has to work systematically across the software development lifecycle, architecture, dependencies, data flows, and operations. No complex software environment is immune to disruption, making the ability to contain impact, recover quickly, and learn continuously – more critical than ever.
For engineers operating large distributed systems, resilience increasingly means designing for failure across the entire system, not only recovering well and fast after an incident. As we advance our AI software development lifecycle (AISDLC), here are seven areas where we’re further embedding resilience end to end.
1. Resilience by design
Resilience has long been part of how we engineer Dynatrace, including established patterns such as backoff and jitter, circuit breakers, and failure-mode checks. As development accelerates through AI and agentic approaches, we are making these practices more systematic across the various parts of our platform and our processes. JUNO, Dynatrace’s internal AISDLC knowledge resource, provides engineering guidance and checks intended to help teams apply resilience patterns before deployment. In parallel, we are advancing cross-region return-to-operations capabilities, based on active-active deployment model.
2. Validation: QA process & chaos testing
End-to-end, failover, load, and resilience testing are already part of how we validate the Dynatrace platform. We are strengthening how these practices are built into the development and release process, with resilience validated across development, staging, performance, and production-representative environments before changes reach production. This includes chaos engineering and fault-injection exercises for failure modes such as simultaneous disconnects, refresh storms, and circular recovery dependencies, as well as production-scale validation before changes to shared, platform-critical infrastructure. Planned Sev1 and Sev2 disruption simulations are intended to test platform behavior and response processes under complex failure scenarios.
3. Controlled change: tenant-level feature control
We are expanding the use of feature flags and finer-grained controls to further separate deployment from release and progressively enable capabilities at customer or tenant level. For higher-risk changes to shared, platform-critical infrastructure, we complement our existing process with a stronger failure-mode validation before production rollout.
4. Fault isolation: eliminate single points of failure
Continuing to strengthen isolation and redundancy across shared authentication and authorization services, we are further separating critical functions using upgraded process protocols for circuit breakers, request-volume controls, safer retries, and regional isolation. These measures are designed to contain failures within smaller boundaries, reduce cascading effects, and support graceful degradation when dependencies are impaired. Edge controls are already live, with further core changes targeted for December 2026 and regional isolation planned for the first half of 2027.
5. Recovery: operational discipline & incident process
We continue to improve recovery behavior and incident response details through tuned restart and reconnection patterns, additional authorization capacity, clearer operational runbooks, and regular response exercises. Together, these improvements help services recover more predictably while strengthening coordination and decision-making during complex incidents. These updates fuel an enhanced SRE model that is actively being implemented starting December 2026 to further test recovery processes and incident response in practice.
6. Data protection: 5 9s data resiliency
Further reductions of dependencies between telemetry ingest and other platform services have been systematically implemented across the platform, including login and token service dependencies. Safepoints in the ingest pipeline are designed to protect the processing of data that has already reached the Dynatrace platform and limit the impact of failures in dependent services. Further ingest decoupling is targeted for the first half of 2027.
7. Independent visibility
We have made further improvements to Dynatrace’s ability to monitor platform health independently of the production platform, helping maintain visibility when parts of the platform are impaired. We are also redesigning alerting to consolidate related symptoms into clearer signals and exploring additional customer-facing views of platform health beyond the current status page. Subject to change, the self-monitoring and alerting storm improvements are targeted for the first half of 2027. A potential customer health view is currently being scoped, not yet committed for release.
Dynatrace is a trademark of the Dynatrace, Inc. group of companies. All other trademarks are the property of their respective owners.
This blog may contain forward-looking statements about our product plans, upcoming features, and anticipated improvements. These statements are for informational purposes only and are not promises or guarantees. The development, release, and timing of any features or functionality described remain at the sole discretion of Dynatrace LLC and may be modified, delayed, or canceled without notice. We encourage readers to make decisions based on the product’s current capabilities and features.
Looking for answers?
Start a new discussion or ask for help in our Q&A forum.
Go to forum