Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
Arize AXArize AX
Arize AX

Arize AX

Analyze traces, latency, and evals of LLM apps through Arize OpenInference data.

Technology
Free trialDocumentation
Observe: Trace LLM and agent calls end to end to spot slow or failing steps.Evaluate: Score LLM outputs with evals to track quality over time.Learn: Use eval results and feedback to improve prompts and agent behavior.Alyx: Ask Alyx, the Arize AI assistant, to help debug traces and set up evals.
  • Product information

Overview

Arize AX, from Arize, a Dynatrace company, is the AI engineering platform for improving AI agents and applications. It gives AI engineers one workflow to capture what their agents actually do, find where they fail, measure quality, and prove every change before it ships.

Arize AX captures traces of real agent behavior, including inputs, outputs, tool calls, and costs. Signal automatically groups recurring failures into ranked issues with trace evidence and a proposed fix. Evaluators score quality continuously against criteria you define, and experiments turn every prompt, model, or retrieval change into a controlled comparison.

Alyx, the AI engineering agent built into Arize AX, works across every step. Ask it in plain language which tool calls are failing, which requests your agent can't handle, or how to build an evaluator.

This is intended for teams who:

  • Build AI agents or LLM applications and need to understand why they fail in production.
  • Want to move from ad hoc prompt tweaks to measurable, repeatable improvement.

Use cases

Find where your agents fail

  • Capture every agent run as a trace, including inputs, outputs, tool calls, and costs.
  • Enable Signal to group recurring failures into ranked issues, each with trace evidence and a proposed fix.
  • Ask Alyx in plain language to find failing runs, and add dashboards and alerts for ongoing visibility.

Score quality against your own criteria

  • Evaluate agent performance with LLM-as-a-judge, agent-as-a-judge, or code evaluators.
  • Turn a Signal issue into an evaluator that continuously scores new traces for that failure.
  • Annotate outputs and calibrate automated scores against human judgment.

Prove every change before you ship

  • Curate datasets of test cases that capture how your agent should behave.
  • Run prompt, model, or retrieval changes as experiments and compare versions side by side.
  • Run datasets against your deployed agent with remote agent experiments to measure real impact.

Use AI across the workflow

  • Work with Alyx in the product to build evaluators and investigate traces.
  • Instrument and operate Arize AX from Bluebox,Claude, Cursor, or Codex with the Arize AX CLI, skills, and MCP servers.

Get started

Instrument with OpenInference. Arize AX tracing is built on OpenInference, the open, OpenTelemetry-based standard for AI tracing created by Arize, with pre-built auto-instrumentation for 30+ providers and frameworks.

Get started for free in one command

Run npx evals from your terminal. It launches your coding agent, signs you up for a free Arize AX account, and instruments your app. Python users can run uvx arize-ax-cli instrument instead.

Or set up step by step

  1. Sign up for a free Arize AX account.
  2. Instrument your agent with auto-instrumentation to capture your first trace.
  3. Enable Signal on your project and review your first issue.
  4. Create evaluators and run experiments to prove a fix.

Using Claude, Cursor, or Codex? See coding agent setup.

Dynatrace
DocumentationMore Information
By Dynatrace
Dynatrace support center
Copy to clipboard
Dynatrace Hub
Get data into DynatraceBuild your own app
Dynatrace Intelligence - The Agentic PlatformThe Dynatrace Agentic AI ecosystem
All (947)Log Management and AnalyticsKubernetesAI and LLM ObservabilityInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityBusiness ObservabilityDigital Experience
Filter
Type
Built and maintained by
Partner FinderBecome a partnerDynatrace Developer

Discover recent additions to Dynatrace

Arize AX logo

Arize AX

Analyze traces, latency, and evals of LLM apps through Arize OpenInference data.

AI Observability logo

AI Observability

End-to-end observability for your Agentic AI and LLM workloads.

Dynatrace Assist logo

Dynatrace Assist

Dynatrace Assist: Ask, analyze, and act with Dynatrace Intelligence.

SRE Agent logo

SRE Agent

Analyze and triage incidents.

Smartscape logo

Smartscape

Interactively explore and analyze topology and relationships in digital systems.

Clouds logo

Clouds

Gain full visibility and proactive monitoring across your cloud infrastructure.

Analyze your data

Understand your data better with deep insights and clear visualizations.

Notebooks logo

Notebooks

Create powerful, data-driven documents for custom analytics and collaboration.

Dashboards logo

Dashboards

Transform complex data into clear visualizations with custom dashboards.

Investigations logo

Investigations

Fast and precise incident response on Grail data with DQL queries.

Smartscape logo

Smartscape

Interactively explore and analyze topology and relationships in digital systems.

Logs logo

Logs

Explore all your logs without writing a single query.

Problems logo

Problems

Detect, explain and triage problems automatically using Dynatrace Intelligence.

Automate your processes

Turn data and answers into actions, securely, and at scale.

Workflows logo

Workflows

Automate tasks in your IT landscape and move towards autonomous operations.

Jira logo

Jira

Open, update, and close Jira tickets automatically from Dynatrace Workflows.

Slack logo

Slack

Automate Slack messaging for security incidents, attacks, remediation, and more.

Secure your cloud application

See vulnerabilities and attacks in your environment.

Security Posture Management logo

Security Posture Management

Detect, prioritize, and remediate security and compliance findings with SPM.

Threats & Exploits logo

Threats & Exploits

Understand, triage, and investigate detection findings and alerts.

More resources

Cursor (Live-Debugger) logo

Cursor (Live-Debugger)

Get Real time Code-Level data directly to your Cursor IDE.

Documents logo

Documents

Manage Dashboards, Notebooks and other documents in your Dynatrace environment.

GitHub Copilot Coding Agent logo

GitHub Copilot Coding Agent

Automate vulnerability remediation and boost developer productivity.

GitHub Copilot Custom Agent logo

GitHub Copilot Custom Agent

Automate your development workflows with specialized agent definitions.

Dynatrace Live Debugger on JetBrains logo

Dynatrace Live Debugger on JetBrains

Get real-time code-level data directly to your Jetbrains IDE.

Metrics logo

Metrics

Browse, search, and manage all your metrics in one central catalog.

Dynatrace Live Debugger on Windsurf logo

Dynatrace Live Debugger on Windsurf

Get real-time code-level data directly to your Windsurf IDE.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

Leverage our newest innovations of Dynatrace Saas

Kick-start your app creation

Kick-start your app creation

Whether you’re a beginner or a pro, Dynatrace Developer has the tools and support you need to create incredible apps with minimal effort.
Go to Dynatrace Developer
Upgrading from Dynatrace Managed to SaaS

Upgrading from Dynatrace Managed to SaaS

Drive innovation, speed, and agility in your organization by seamlessly and securely upgrading.
Learn More
Log Management and Analytics

Log Management and Analytics

Innovate faster and more efficiently with unified log management and log analytics for actionable insights and automation.
Learn more