Skip to technology filters Skip to main content
Dynatrace Hub

Extend the platform,
empower your team.

Popular searches:
Home hero bg
OpenInferenceOpenInference
OpenInference

OpenInference

Instrument your AI agents, services and apps with OpenInference.

Technology
Free trialDocumentation
Get visibility into Agent Topology and dependency for your OpenInference instrumented AI servicesOpenInference reference instrumentation architecturePrompts stream showing all Agent and LLM interactions with model version, token count, and full prompt/response content.Trace-level debug view showing agentic span hierarchy, tool calls, prompt and response content, and agent topology for a single AI agent run.Debug your AI prompts captured by OpenInferenceOpenPipeline dynamic routing rules directing Langfuse, OpenLIT, and OpenInference spans to dedicated attribute-normalization pipelines.
  • Product information

Overview

OpenInference is an open observability standard for AI applications, developed by Arize AI and built on top of OpenTelemetry. It provides auto-instrumentation for 33+ frameworks: including LangChain, LlamaIndex, CrewAI, AutoGen, OpenAI, Anthropic, and more. Capturing LLM calls, agent runs, tool invocations, retrieval steps, and quality evaluations as distributed traces, with no changes required to your application code.

OpenInference uses its own semantic conventions (llm.model_name, llm.token_count.*, openinference.span.kind, and others). Dynatrace normalizes these to the gen_ai.* OTel standard, via an OTel Collector transform processor or Dynatrace OpenPipeline: so your data populates the AI Observability app out of the box.

By connecting OpenInference to Dynatrace, you get full-stack visibility into your AI workloads: model performance, token consumption, cost, tool behavior, retrieval quality, and evaluation scores, all in one place.

Use cases

Monitor AI service health and performance

  • Detect bottlenecks by tracking real-time metrics including request counts, durations, and error rates across LLM providers and models.
  • Manage costs with automated token-level cost calculations broken down by model and provider.
  • Set error budgets for performance and cost controls, and validate consumption and response time per model.

End-to-end tracing and debugging of agentic AI

  • Achieve full visibility of prompt flows, tool calls, retrieval steps, and model handoffs — from initial request to final response — for faster root cause analysis.
  • Capture detailed debug data, including full prompt and completion content, to troubleshoot issues in complex multi-agent pipelines.
  • Pinpoint exact failure points in tool calls, prompts, tokens, or system integrations with granular span-level tracing following the GenAI semantic conventions.

Evaluate AI quality in production

  • Run LLM-as-judge and custom evaluation with dt-evals as first-class spans alongside your inference traces, with scores, labels, and explanations attached to the evaluated response.
  • Track quality metrics — relevance, groundedness, toxicity, and custom evaluators — over time alongside latency and cost.
  • Correlate evaluation regressions with model version changes, prompt updates, or provider switches.

Multi-framework coverage with a single pipeline

  • Instrument 33+ AI frameworks with a single OTLP export pipeline, no per-framework Dynatrace integration required.
  • Normalize all OpenInference conventions to gen_ai.* attributes once, via OTel Collector or OpenPipeline, and get consistent dashboards regardless of which framework your team uses.
  • Extend coverage to retrieval (RAG), reranking, and guardrail spans beyond standard LLM calls.

Get started

Setting up observability for your OpenInference-instrumented application requires one normalization step to map OpenInference attributes to the gen_ai.* format that Dynatrace AI Observability understands. This is done either with a Dynatrace OTel Collector (no Dynatrace configuration needed, one Docker command) or with Dynatrace OpenPipeline (server-side, no Collector to manage).

To get started, see our OpenInference instrumentation example on GitHub and the OpenInference + Dynatrace getting started guide.

Additionally, you can read more about how to install the AI Observability app.

Dynatrace
Documentation
By Dynatrace
Dynatrace support center
Copy to clipboard

Related to OpenInference

AI Observability logo

AI Observability

End-to-end observability for your Agentic AI and LLM workloads.

Dynatrace Hub
Get data into DynatraceBuild your own app
Dynatrace Intelligence - Agentic Operations SystemThe Dynatrace Agentic AI ecosystem
All (915)Log Management and AnalyticsKubernetesAI and LLM ObservabilityInfrastructure ObservabilitySoftware DeliveryApplication ObservabilityApplication SecurityBusiness ObservabilityDigital Experience
Filter
Type
Built and maintained by
Deployment model
SaaS
  • SaaS
  • Managed
Partner FinderBecome a partnerDynatrace Developer

Discover recent additions to Dynatrace

Dynatrace Assist logo

Dynatrace Assist

Dynatrace Assist: Ask, analyze, and act with Dynatrace Intelligence.

Smartscape logo

Smartscape

Interactively explore and analyze topology and relationships in digital systems.

Compliance Assistant logo

Compliance Assistant

Track, manage, and automate compliance across your IT and business landscape.

Experience Vitals logo

Experience Vitals

Optimize UX with core vitals, frontend error tracking, and end-to-end visibility.

Error Inspector logo

Error Inspector

Discover, triage, and manage errors across all your frontends.

Users & Sessions logo

Users & Sessions

Discover how users and cohorts with common characteristics experience your app.

Analyze your data

Understand your data better with deep insights and clear visualizations.

Notebooks logo

Notebooks

Create powerful, data-driven documents for custom analytics and collaboration.

Dashboards logo

Dashboards

Transform complex data into clear visualizations with custom dashboards.

Investigations logo

Investigations

Fast and precise incident response on Grail data with DQL queries.

Smartscape logo

Smartscape

Interactively explore and analyze topology and relationships in digital systems.

Logs logo

Logs

Explore all your logs without writing a single query.

Problems logo

Problems

Detect, explain and triage problems automatically using Dynatrace Intelligence.

Automate your processes

Turn data and answers into actions, securely, and at scale.

Workflows logo

Workflows

Automate tasks in your IT landscape and move towards autonomous operations.

Jira logo

Jira

Open, update, and close Jira tickets automatically from Dynatrace Workflows.

Slack logo

Slack

Automate Slack messaging for security incidents, attacks, remediation, and more.

Secure your cloud application

See vulnerabilities and attacks in your environment.

Security Posture Management logo

Security Posture Management

Detect, prioritize, and remediate security and compliance findings with SPM.

Threats & Exploits logo

Threats & Exploits

Understand, triage, and investigate detection findings and alerts.

More resources

Observability for Developers on Cursor logo

Observability for Developers on Cursor

Get Real time Code-Level data directly to your Cursor IDE.

Documents logo

Documents

Manage Dashboards, Notebooks and other documents in your Dynatrace environment.

GitHub Copilot Coding Agent logo

GitHub Copilot Coding Agent

Automate vulnerability remediation and boost developer productivity.

GitHub Copilot Custom Agent logo

GitHub Copilot Custom Agent

Automate your development workflows with specialized agent definitions.

Observability for Developer on JetBrains logo

Observability for Developer on JetBrains

Get real-time code-level data directly to your Jetbrains IDE.

Metrics logo

Metrics

Browse, search, and manage all your metrics in one central catalog.

Pagerduty for Dynatrace Workflows logo

Pagerduty for Dynatrace Workflows

Streamline incident management with automated Pageruty workflows.

Cursor IDE logo

Cursor IDE

Boost developer productivity and get real-time, code-level insights into Cursor.

Observability for Developers on Windsurf logo

Observability for Developers on Windsurf

Get real-time code-level data directly to your Windsurf IDE.

Are you looking for something different?

We have hundreds of apps, extensions, and other technologies to customize your environment

Leverage our newest innovations of Dynatrace Saas

Kick-start your app creation

Kick-start your app creation

Whether you’re a beginner or a pro, Dynatrace Developer has the tools and support you need to create incredible apps with minimal effort.
Go to Dynatrace Developer
Upgrading from Dynatrace Managed to SaaS

Upgrading from Dynatrace Managed to SaaS

Drive innovation, speed, and agility in your organization by seamlessly and securely upgrading.
Learn More
Log Management and Analytics

Log Management and Analytics

Innovate faster and more efficiently with unified log management and log analytics for actionable insights and automation.
Learn more