Skip to content

VIII.2VIII · Govern itgovern

Google SAIF - the controls layer

SAIF answers one question the risk frameworks deliberately leave open: given an AI system, which concrete safeguards do you build? This page is the full working map of Google’s Secure AI Framework - every element, component, risk, and control - written so you can run it against a real deployment.

What SAIF is - and the three layers people conflate

Google introduced SAIF on 8 June 2023 as “a conceptual framework for secure AI systems,” built on its security-by-default heritage (SLSA for supply-chain integrity, BeyondCorp for zero trust). It is positioned today as “a practitioner’s guide to navigating AI security” (saif.google; Introducing SAIF).

Three distinct things all wear the “SAIF” label - do not conflate them:

LayerWhat it isWhere it lives
The six core elements2023 strategic posture - the “why” and the high-level movesThe launch blog post
The operational frameworkComponents -> risks -> controls -> Risk Map -> self-assessmentsaif.google/secure-ai-framework
SAIF 2.0Oct 2025 extension for agentic systems (Agent Risk Map + agent principles)The 2025 strategy blog + Cloud

The operational framework is the one you do. The core elements are the posture it sits inside.

The six core elements

These are Google’s original strategic elements, quoted verbatim from the launch post. Read each as “extend the security discipline you already have to cover AI.”

#Element (verbatim)What it means in practice
1”Expand strong security foundations to the AI ecosystem”Your existing AppSec, IAM, and supply-chain controls apply to AI - start there, do not reinvent
2”Extend detection and response to bring AI into an organization’s threat universe”Put AI systems in scope for your SOC, threat intel, and IR - not a separate silo
3”Automate defenses to keep pace with existing and new threats”Attackers use AI at machine speed; your defenses must too
4”Harmonize platform level controls to ensure consistent security across the organization”One control plane across AI systems, not per-team snowflakes
5”Adapt controls to adjust mitigations and create faster feedback loops for AI deployment”Red-team, learn, and push mitigations continuously - AI risk is non-stationary
6”Contextualize AI system risks in surrounding business processes”Risk is a function of the business process the model sits in, not the model alone

The four components

SAIF structures a generative-AI system into four component areas - “the broadened scope of AI development compared to traditional software development” (components). This is the coordinate system for everything else: risks and controls are hung off these four areas.

ComponentSub-componentsThe security question
DataData Sources · Data Filtering & Processing · Training DataCan you trust what went into the model?
InfrastructureModel Frameworks & Code · Training, Tuning & Evaluation · Data & Model Storage · Model ServingCan the pipeline and its artifacts be tampered with?
ModelThe Model · Input Handling · Output HandlingCan the model itself be manipulated or leaked?
ApplicationApplication · AgentCan the surface around the model be abused, and can an agent act badly?

The fifteen risks

Every SAIF risk carries a short code - learn the codes, because the controls and Risk Map reference them (risks). Grouped by the component that introduces them:

ComponentRisk (code)
DataData Poisoning (DP) · Unauthorized Training Data (UTD) · Excessive Data Handling (EDH)
InfrastructureModel Source Tampering (MST) · Model Exfiltration (MXF) · Model Deployment Tampering (MDT) · Denial of ML Service (DMS)
ModelModel Reverse Engineering (MRE) · Prompt Injection (PIJ) · Model Evasion (MEV) · Sensitive Data Disclosure (SDD) · Inferred Sensitive Data (ISD)
ApplicationInsecure Integrated Component (IIC) · Insecure Model Output (IMO) · Rogue Actions (RA)

Model creator vs model consumer - what a pure consumer can descope

SAIF tags every risk with the persona that can mitigate it. A model creator trains or fine-tunes the model; a model consumer builds a product on someone else’s model (a hosted API, a downloaded open-weight checkpoint). Most enterprises are pure consumers, and SAIF lets them formally descope the risks they cannot touch - as long as the residual responsibility is understood.

SAIF persona attributionRisks (codes)What it means for a pure consumer
Creator-onlyDP · UTD · MST · EDHDescope. You never see the training pipeline, so you cannot poison it, mishandle training data, or tamper with model source. Push these onto the provider via procurement (model card, provenance attestation, ML-BOM).
BothMXF · MDT · PIJ · MEV · SDD · ISDShared. The creator hardens the base model; you still own the deployed copy, the prompt boundary, and what leaks at your inference surface.
Consumer-onlyDMS · MRE · IIC · IMO · RAFully yours. Serving availability, query-based extraction of your endpoint, insecure plugins/tools you wired in, unvalidated model output, and agent rogue actions are all your build.

The SAIF Risk Map

The Risk Map is the interactive diagram that ties it together - “how different security risks are introduced, exploited and mitigated throughout the AI development process.” Its key insight is that each risk has a path, tracked across three dimensions:

  • Introduced - where in the lifecycle the risk enters (e.g. Data Poisoning can enter at ingest, processing, training, or storage).
  • Exposed - where it becomes exploitable.
  • Mitigated - where a control can actually stop it.
flowchart TB
  subgraph DATA["Data"]
    A["Data Sources"] --> B["Filtering and<br/>Processing"] --> C["Training Data"]
  end
  subgraph INFRA["Infrastructure"]
    C --> D["Training /<br/>Tuning / Eval"] --> E["Data and Model<br/>Storage"] --> F["Model Serving"]
  end
  subgraph MODEL["Model"]
    F --> G["The Model"]
    G --> H["Input Handling"]
    G --> I["Output Handling"]
  end
  subgraph APP["Application"]
    H --> J["Application"] --> K["Agent"]
    I --> J
  end
  classDef n fill:#1c2436,stroke:#84b6ff,color:#dbe6ff;
  class A,B,C,D,E,F,G,H,I,J,K n;

Two properties matter for how you defend:

  • Risks are not siloed. Data Poisoning (DP) spans ingest, processing, training, and storage - so a single control point is never enough. Sensitive Data Disclosure (SDD) explicitly needs “multi-layered” defenses.
  • Some risks are inherent. Google flags Prompt Injection (PIJ) and Model Evasion (MEV) as inherent to how models work - you manage them, you do not eliminate them. Plan for detection and containment, not a silver bullet.

The six control categories

SAIF’s controls are grouped into six categories - four aligned to the components, plus two cross-cutting categories (Assurance and Governance) that apply to every risk. Each control names the risks it addresses, so you can work backward from a flagged risk to the exact control to build.

CategoryControl -> risks it mitigates
DataPrivacy Enhancing Technologies -> SDD · Training Data Management -> ISD, UTD · Training Data Sanitization -> DP, UTD · User Data Management -> SDD, EDH
InfrastructureModel & Data Inventory Mgmt -> DP, MST, MXF · Model & Data Access Controls -> DP, MST, MXF · Model & Data Integrity Mgmt -> DP, MST · Secure-by-Default ML Tooling -> DP, MST, MXF, MDT
ModelInput Validation & Sanitization -> PIJ · Output Validation & Sanitization -> PIJ, RA, SDD, ISD · Adversarial Training & Testing -> MEV, PIJ, SDD, ISD, IMO
ApplicationApplication Access Mgmt -> DMS, MRE · User Transparency & Controls -> SDD, EDH · Agent User Control -> SDD, RA · Agent Permissions -> IIC, SDD, RA · Agent Observability -> SDD, RA
Assurance (all risks)Red Teaming · Vulnerability Management · Threat Detection · Incident Response Management
Governance (all risks)User Policies & Education · Internal Policies & Education · Product Governance · Risk Governance

The control names alone are opaque; here is what each of the less-obvious ones actually does, quoting SAIF’s own one-line definitions (controls).

Data controls:

ControlWhat it does
Privacy Enhancing TechnologiesMinimize, de-identify, or restrict use of PII in training or evaluation (differential privacy, redaction, tokenization)
Training Data ManagementEnsure all data used to train and evaluate models is authorized for the intended purpose (provenance, licensing, consent)
Training Data SanitizationDetect and remove or remediate poisoned or sensitive data in training and evaluation sets
User Data ManagementStore, process, and use runtime user data (prompts, logs) in compliance with user consent

Assurance controls (all four are cross-cutting - they apply to every one of the fifteen risks):

ControlWhat it does
Red TeamingFind security and privacy weaknesses through self-driven adversarial attacks on the AI system
Vulnerability ManagementContinuously test and monitor production AI infrastructure and products for security/privacy regressions
Threat DetectionDetect and alert on internal or external attacks against AI assets, infrastructure, and products
Incident Response ManagementManage the organizational response to AI security and privacy incidents

Governance controls (also cross-cutting):

ControlWhat it does
User Policies & EducationPublish clear, user-facing AI security and privacy policies and guidance
Internal Policies & EducationPublish comprehensive AI security and privacy policies and training for your own employees
Product GovernanceValidate that every AI model and product meets the organization’s established security/privacy requirements before ship
Risk GovernanceInventory, measure, and monitor residual AI risk across the organization

The SAIF Risk Assessment

Launched 24 October 2024, the SAIF Risk Assessment is “a questionnaire-based tool that will generate an instant and tailored checklist.” It asks about your training/tuning/evaluation setup, access controls, adversarial-input prevention, secure design and coding practices, and any generative-AI agents. It then produces a report that, for each of the fifteen risks:

  1. States whether the risk applies to your system, and why.
  2. Gives the technical detail behind it.
  3. Names the mitigating controls, linked into the Risk Map so you can see where they act.

This is the fastest path from “we have an AI system” to “here is our prioritized control gap list.” Run it at design time and re-run it whenever the architecture changes.

Worked example - a support-ticket RAG agent

Take a concrete system: an internal support agent built on a hosted LLM API, with retrieval over the company’s ticket history and a tool that can issue refunds. Map it to the four components, then run it through the Risk Assessment logic.

ComponentThis system’s instance
DataNot trained by us - we consume a hosted model. Our only “data” is the RAG corpus (ticket history) and runtime prompts/logs.
InfrastructureProvider’s serving stack (opaque to us) + our vector store + our orchestration service.
ModelThird-party hosted model; we control Input Handling (prompt assembly, retrieved context) and Output Handling (response parsing).
ApplicationThe support app and an agent that calls a refund tool - so the Agent sub-component is live.

Because we are a pure consumer, the four creator-only risks (DP, UTD, MST, EDH) descope to the provider. Running the questionnaire flags the risks that survive - here are three, with the controls that fire:

Flagged riskWhy it applies hereControls that fire
Prompt Injection (PIJ)Retrieved tickets are untrusted text that reaches the model; a malicious ticket can carry injected instructions.Input Validation & Sanitization; Output Validation & Sanitization; Adversarial Training & Testing (red-team the RAG path)
Rogue Actions (RA)The agent can issue refunds - a hijacked goal (via PIJ) turns into unauthorized money movement.Agent Permissions (allowlist + refund cap); Agent User Control (human approval on refunds); Agent Observability (log every tool call); Output Validation
Sensitive Data Disclosure (SDD)Ticket history contains customer PII that can surface in an answer to the wrong user.Privacy Enhancing Technologies; Output Validation & Sanitization; User Transparency & Controls; User Data Management

The chain is the point: PIJ (inherent, cannot be eliminated) is the entry, RA is the impact, and the fired controls cluster on the Model and Application boundaries - exactly where a consumer’s residual responsibility sits. The Assurance controls (Red Teaming this PIJ->RA path, Threat Detection on the refund tool) apply on top, as always.

SAIF 2.0 - the agent extension

In October 2025 Google extended SAIF for agentic systems (AI security strategy, Oct 2025; Cloud SAIF). SAIF 2.0 adds:

  1. An Agent Risk Map - the Risk Map extended with agent-specific paths.
  2. Security capabilities built across Google’s own agents.
  3. Three agent principles that should govern any agent you deploy:

Agents must have well-defined human controllers, their powers must be carefully limited, and their actions and planning must be observable.

Those three principles map directly onto the SAIF Application controls: Agent User Control (well-defined human controller), Agent Permissions (powers carefully limited), and Agent Observability (actions and planning observable). If you build agents, these three controls are non-negotiable - they are the concrete implementation of the principles, and they line up with the agentic threats in III.4 · Persistence & propagation and the MCP guidance in IV.2 · Model Context Protocol (MCP).

CoSAI - where SAIF becomes vendor-neutral

SAIF is a Google framework; CoSAI is the industry standardization path that keeps it from being one vendor’s dialect.

  • The Coalition for Secure AI was founded 18 July 2024 at the Aspen Security Forum, housed under OASIS Open as an Open Project. Founding members span Amazon, Anthropic, Cisco, Cohere, IBM, Intel, Microsoft, NVIDIA, OpenAI, PayPal, Wiz, and Google (Introducing CoSAI).
  • By July 2025 it added an Agentic AI Security workstream and released “Principles for Secure-by-Design Agentic Systems” - Human-governed & Accountable, Bounded & Resilient, Transparent & Verifiable - which mirror SAIF 2.0’s three agent principles (CoSAI first anniversary).
  • On 16 September 2025 Google donated the SAIF data - as the CoSAI Risk Map (CoSAI-RM) - to CoSAI, making it a vendor-neutral common language (Google donates SAIF data).
  • On 18 November 2025 CoSAI released actionable frameworks for AI model signing and incident response (CoSAI frameworks).
  • As of mid-2026, CoSAI-RM plus the model-signing and incident-response frameworks (Nov 2025), and 2026 workstream papers on agentic security and agentic identity and access, are the current deliverables - check oasis-open.org for newer workstream releases before you cite them.

Practical takeaway: if you need a portable, non-Google-branded control taxonomy for a mixed-vendor program or a procurement conversation, cite CoSAI-RM rather than “Google SAIF” - it is the same map, governed neutrally.

How to apply SAIF - the workflow

Applying SAIF to a real deployment - the concrete artifact per step
# 1. MAP the system to the four components -> produce an ML-BOM / inventory
# (Data / Infrastructure / Model / Application), e.g. CycloneDX ML-BOM:
cyclonedx-py environment -o mlbom.json # deps; add model + dataset refs
# 2. RUN the SAIF Risk Assessment questionnaire at saif.google
# -> export the tailored checklist of which of the 15 risks apply, and why
# 3. SCAN the model artifacts before you trust them (MST / DP integrity):
modelscan -p ./models/<model.pkl> # unsafe deserialization, MST
fickling --check-safety ./models/<model.pkl> # pickle payloads that run on load
# 4. IMPLEMENT + EVIDENCE the mapped controls
# Assurance: red-team the PIJ / MEV / RA risks
garak --model_type rest -G rest.json --probes promptinject,dan
# Infrastructure: sign the model so MST / MXF tampering is detectable
cosign sign-blob --key <cosign.key> ./models/<model> > model.sig
# 5. FOR AGENTS: enforce the SAIF 2.0 Application controls -
# Agent Permissions (allowlist the tools an agent may call),
# Agent User Control (human approval on irreversible actions),
# Agent Observability (log every tool-call to the SIEM)
# 6. FOR PORTABILITY: re-express the gap list in CoSAI-RM terms
# so a mixed-vendor program and an auditor read the same map