Technology / L2 detail
Foundation models
Linked Level 3 activities
Level 3
Foundation model vendor selection
Evaluate vendors on agentic capabilities (tool-use reliability, function calling, safety controls, provenance/audit features) in addition to output quality
Open Level 3 detail
Level 3
Fine-tuning and customisation strategy
Shift from tailoring tone/accuracy to shaping action policies, tool-selection behaviour, and domain-specific guardrails
Open Level 3 detail
Level 3
Model governance and versioning
Expand governance from model versions to agent bundles (model + prompts + tools + connectors + permissions + policies + memory/config) with controlled releases and rollbacks
Open Level 3 detail
Level 3
Model performance monitoring
Monitor not only quality but goal success, action correctness, tool error rates, boundary violations, and escalation/override patterns
Open Level 3 detail