Process & tooling / L2 detail
Monitoring and observability
Process & tooling4 Level 3 activities
Linked Level 3 activities
Level 3
Operational monitoring (uptime, latency, cost)
Monitor agent workload patterns and downstream tool/system health, not only model APIs and supporting services
Open Level 3 detail
Level 3
Behaviour monitoring (actions, tool use)
Track tool calls, retries, overrides, boundary hits, and failure modes, not just prompts/outputs
Open Level 3 detail
Level 3
Risk signal monitoring (incidents, drift alerts)
Operate a KRI-driven alerting regime for agent fleets, beyond basic monitoring, with defined thresholds and response playbooks
Open Level 3 detail
Level 3
Outcome monitoring and role-based reporting
Combine outcome measurement with role-based reporting - goal completion, quality, business KPIs, and committee-ready views, not just user satisfaction
Open Level 3 detail