Red Hat OpenShift AI

Red Hat OpenShift AI is a flexible, scalable artificial intelligence (AI) and machine learning (ML) platform that enables enterprises to create and deliver AI-enabled applications at scale across hybrid cloud environments.

Built using open source technologies, OpenShift AI provides trusted, operationally consistent capabilities for teams to experiment, serve models, and deliver innovative apps.

Dynatrace provides a real-time solution for tracking and revealing the full context of used technologies, service interaction topology, and observability metrics (traces, logs, and business events). This is done automatically and applies to any output.

Combine the strength of Dynatrace end-to-end observability for your generative AI applications built with Red Hat OpenShift AI. Dynatrace allows you to track and monitor the consumption, cost, and performance of your AI services and models at scale.

Monitor service health and performance

• Detect bottlenecks by tracking real-time metrics, including request counts, durations, and error rates.
• Manage service costs with automated cost calculations for each request.
• Stay on track with SLOs

Monitor service quality and cost

• Setup error budgets for performance and cost controls
• Validate consumption and response time by models
• Prevent quality degradation by validating models and usage patterns in real-time.

Setting up full stack observability for your GenAI applications is possible with Traceloop's OpenLLMetry, with OpenTelemetry under the hood, which can seamlessly provide comprehensive end-to-end insights into your production environments.

To set up OpenLLMetry with Dynatrace, see Dynatrace Documentation.