RHOAI Metrics Dashboard for Single Serving Models

Enable RHOAI User Workload Metrics for Single Serving Models

Prerequisites

• OpenShift 4.10 or later
• OpenShift AI 2.10+ installed
• OpenShift AI KServe installed and configured
• NVIDIA GPU Operator installed and configured

Installation

• Configure Monitoring for the Single Model Serving Platform
• Configure GPU Monitoring Dashboard
• Install the RHOAI Metrics Grafana and Dashboards for Single Serving Models

Usage

Grab the Grafana route and open it in a browser:

NS="user-grafana"
GRAFANA_URL=$(oc get route -n $NS grafana-route -o jsonpath='{.spec.host}')
echo $GRAFANA_URL

vLLM Dashboard

Within the Grafana Dashboard, go to Dashboards and select the vLLM dashboard:

OpenVino Dashboard

Within the Grafana Dashboard, go to Dashboards and select the OVMS dashboard: