AI Pilot Quick Start

Audience: Platform engineers, AI governance admins
Time: < 20 min

Get AI Pilot enforcing controls on your first LLM or GenAI path: register a bouncer, bind AI assets, activate a control, and confirm decisions in Traffic / Activity.

What

AI Pilot sits on the bouncer traffic path. Every call to an LLM, MCP server, or GenAI tool can be authorized, inspected (PII + safety), and limited for cost — without changing application code.

Why

Enterprises need one place to prove who can use which models, that sensitive data does not leave the boundary, and that spend stays within budget. AI Pilot delivers that at the edge before traffic reaches providers.

How — choose a path

PathEnterprise labelBest when
AGateway ModeOne shared bouncer fronts many apps/LLM routes (DNS or load balancer points at the bouncer).
BApp-EmbeddedThe bouncer runs next to a single app; that app sends AI traffic to localhost (or the shared pod network).

Both paths use the same Control Plane and the same AI Inspection Engine for PII and prompt safety. See Deployment modes (AI Pilot) for a full comparison.

Prerequisites

  • Control Plane healthy and reachable
  • Sandbox (or production) API key for the bouncer
  • At least one LLM or GenAI endpoint you can reach from the bouncer network

Path A — Gateway Mode (~15 min)

  1. Deploy the bouncer in Gateway Mode in front of your LLM or GenAI upstream (~5 min).
  2. Register — open Settings → PEPs / Bouncers and confirm the bouncer appears with a fresh heartbeat (~2 min).
  3. Bind AI assets — in Settings → Resources (or AI Pilot → Intercept Scope), attach LLM / MCP / agent resources to this bouncer (~3 min).
  4. Activate a first control — open Controls, pick an AI-related template (or a simple allow-by-role control), deploy to sandbox (~5 min).
  5. Point clients at the bouncer endpoint as the LLM base URL (not the provider directly).

Troubleshooting: If the bouncer never appears, check Control Plane URL and API key on the host, then curl the Control Plane health endpoint. Full guide: Troubleshooting.

Path B — App-Embedded (~15 min)

  1. Deploy the bouncer beside the application (same host or pod) (~5 min).
  2. Register and confirm heartbeat in Settings → PEPs / Bouncers (~2 min).
  3. Bind the app’s AI resources to that bouncer (~3 min).
  4. Activate a first control in sandbox (~5 min).
  5. Route the app’s AI egress through the local bouncer listen port so nothing bypasses governance.

Troubleshooting: App still reaches the LLM directly? Confirm the app’s base URL points at the bouncer, not the provider. Bypass defeats AI Pilot.


Verify

  1. Send a test chat/completions (or GenAI) request through the bouncer.
  2. Open AI Pilot → Activity (or Traffic) for that bouncer — you should see the request with decision, model, and any inspection actions.
  3. Open Audit (platform or AI Pilot Audit tab) and confirm a matching decision for your caller.
Expected HTTPMeaning
200Allowed; forwarded (possibly with redaction).
403Control denied access.
400Safety / prompt guard blocked.
429Token or rate limit exceeded.

Troubleshoot

SymptomWhere to lookResolution
No Activity rowsBouncer heartbeat; client base URLFix registration; ensure traffic hits the bouncer
Control not enforcedControls → sandbox status; Policy Bridge syncActivate control; wait for sync; retest
Limits inconsistentCost settings; RedisEnable shared Redis for multi-replica token limits

Technical reference (env vars)

Enterprise labels map to deployment settings as follows (names only — values depend on your install):

Enterprise labelTypical settingUpstream target
Gateway ModeBOUNCER_TYPE=reverse-proxyTARGET_HOST = shared upstream (API or LLM gateway)
App-EmbeddedBOUNCER_TYPE=sidecarTARGET_HOST = local app listen address (often loopback)

Also set Control Plane URL, API key, bouncer ID, environment, and provider credentials (OPENAI_API_KEY, Azure endpoint, etc.) as documented in Network Bouncer configuration.


Next steps