Enterprise AI Agent #7: Responsible AI should not live in a PowerPoint. It should live in the same GitHub repo as the agent. This is one lesson I keep coming back to while building Agentic AI systems. Most teams discuss guardrails as principles. Privacy. Fairness. Security. Human oversight. Auditability. All important. All unenforceable. Because when an agent can read data, call tools, update records, trigger workflows, or talk to customers, a principle in a deck does not control runtime behaviour. And a rule in a system prompt is text the model can be argued out of. If an attacker can talk the model into ignoring it, it was never a guardrail. A guardrail is a deterministic function that returns allow, deny, or escalate - in a code path the model has no access to. That is why I am building SHUGO. An open-source, guardrails-first framework for AI agents. The name comes from 守護 (shugo) - to guard, to protect. The idea is simple. Treat guardrails as code. Not scattered prompts. Not policies disconnected from execution. Not controls bolted on after the pilot. SHUGO is MCP-native. It presents itself to your agent as a standard MCP server and sits between the agent and the tools it calls. Every tool call is checked against a readable policy file before it reaches anything real. No protocol changes. No agent code changes. Works with anything that speaks MCP. The framework is organized around five layers. 1️⃣ Identity & Access Who is the agent? Which user is it acting for? What can it reach? 2️⃣ Data & Context What context can enter the agent? How are sensitive data and retrieval boundaries controlled? 3️⃣ Action & Autonomy What can it read, write, or execute? What needs approval, a spend limit, or a stop condition? 4️⃣ Safety & Resilience How do we detect unsafe behaviour, fail closed, and roll back? 5️⃣ Governance & Assurance How do we trace decisions, evidence them, and respond to incidents? From my experience, the most important shift is this. A guardrail should not merely tell an agent what it should do. The system should enforce what the agent is allowed to do. Deterministic permissions before execution. Runtime controls during execution. Evidence after execution. That last one is where most tooling stops short. Enforcement without evidence is unauditable. So every rule in SHUGO carries the control it implements, and one command turns the audit log into a control-by-control evidence bundle. The goal is not another heavy governance platform. It is a small, readable, modular reference framework that teams can understand, extend, and adapt. Because capability makes an agent useful. Guardrails make it deployable. Building this in public. Repo, architecture, and implementation journey to follow. What should the first release prioritise - policy-as-code, approval gates, tool permissions, or audit evidence? #EnterpriseAI #AgenticAI #ResponsibleAI #AIGovernance #OpenSource #MCP
Interesting point. I would prioritize policy-as-code before approval gates. Approval workflows feel safer, but they often just move risk onto a tired human reviewer. A deterministic policy layer gives the reviewer something concrete to inspect: what was allowed, what was blocked, and what evidence exists afterward.
Policy-as-code first. Gates, permissions and evidence all fall out of it once the policy layer exists. The catch with an MCP proxy: it only sees agents that talk MCP. Most of the dangerous stuff we dig out of dependency trees doesn't - an SDK call three levels down, model output going straight into exec or a socket in the same process. None of that ever crosses the proxy. You end up guarding the front door while the side doors stay open, and the map of the side doors has to come from somewhere else.
I completely agree. Prompts aren't security boundaries. If an LLM can be convinced to ignore a rule, then that rule shouldn't live in the prompt it should be enforced in code. I also like the MCP-first approach. It gives teams a way to add guardrails without having to rebuild every agent. Looking forward to seeing how SHUGO evolves.
I agree with you, bro.
The model should request an action. It should not approve its own action. That approval decision should live outside the model, in policy code, with logs and evidence. Prompt-level safety is guidance. Runtime enforcement is control. And in enterprise AI, control needs to be testable, traceable, and auditable.