Skip to content

3. Layered Architecture Map ​

The reference architecture has nine layers.

LayerNameResponsibility
8OrchestrationAgent-as-tool, fan-out, delegation
7Observability & EvaluationTraces, spans, metrics, cost, failure diagnosis
6Guardrails & SafetyValidation, sandboxing, permissions, limits, retries
5Memory & StateShort-term context, working state, long-term retrieval
4Control LoopReAct cycle, iteration caps, termination, error handling
3Tools & ActionsTool contracts, execution, observations, side effects
2Structured OutputOutput protocols, tool-call schemas, parsing
1Context & MessagesRoles, task framing, token budget, context ordering
0Model EngineStateless next-token prediction

Layer 8 (Orchestration) is out of scope for the current material. This manual covers Layers 0 through 7.

Each chapter follows the same pattern:

  • Problem solved
  • Service provided to the layer above
  • Core components
  • Design rules
  • Failure modes