Technology / L2 detail
Infrastructure
Linked Level 3 activities
Level 3
Cloud provider selection
Expand from “LLM hosting capacity” to a portability and lock-in posture - ability to run stateful agent services, policy enforcement, tracing, and connectors across multiple hyperscalers and open-source stacks (eg Kubernetes, portable IAM abstractions, model gateway)
Open Level 3 detail
Level 3
On-premise vs hybrid strategy
Extend GenAI placement decisions to where autonomous execution and sensitive tool-actions are permitted, including split-brain patterns (reasoning in cloud, execution on-prem)
Open Level 3 detail
Level 3
Network and storage architecture
Upgrade for high-frequency agent calls to tools, vector stores, event buses, and audit stores, not just batch inference traffic
Open Level 3 detail
Level 3
Scalability and resilience engineering
Engineer for “always-on” agent services with bursts, retries, queueing, back-pressure, and graceful degradation, not just interactive GenAI sessions
Open Level 3 detail
Level 3
Infrastructure security and access controls
Move from model/API key management to end-to-end identity for agents, tool credentials, least-privilege runtime authorisation, and automated secret rotation
Open Level 3 detail