BOS API · Open-source AI Security Gateway

Your company's AI.
Under control.

Don't let rogue keys and runaway bills stall your business. Open-source, self-hosted. Issue dedicated keys per team — access, security, and cost control all in one place.

Bidirectional safety checks
Fully self-hosted
Usage tracked by org
BOS APITWO-WAY SECURITY · DEMO
  1. A sample client request enters the BOS API gateway.

  2. Check the key, organization, allowed models and providers, QPS, and rolling quota.

  3. Inspect input before it leaves the gateway, applying configured detection and actions.

  4. Select a configured, authorized upstream channel and model.

  5. The upstream response returns to BOS API before output inspection.

  6. Inspect the model output and review rule results and actual actions.

  7. Return allowed content and link usage, request, and security event records.

Steps remain readable without animation. Block scenarios illustrate a configured blocking policy; see the security guide for protocol and streaming coverage.
01 MODEL & ACCESS

One key
per team.

Configure models and org permissions in one place. No more handing out upstream credentials to every application.

  • Centrally manage providers, channels, and private model endpoints
  • Issue keys by use case with model access and quota settings
  • Tie usage and request records to keys — see who is using what
Explore model management
BOS API / Console
Model resourcesSample data
Model IDChannelAccess
Cmodel-chatcloud-primaryEngineering
Dmodel-codecloud-secondaryEngineering
Lmodel-localprivate-endpointInternal apps
Console illustration · Sample data
CONFIGURATION WALKTHROUGH

One connected setup.
Your first model request.

Upstream channel → Organization → API Key → Verification. All data is fictional; this demo never connects to a live gateway.

  1. Connect a provider and model

    Provider
    Demo provider
    Base URL
    https://provider.example.com/v1
    Model
    demo-model
    Upstream credential
    [DEMO ONLY]

    Configure a channel, protocol, and model in provider and model management. Check availability.

    Read the guide
  2. Assign explicit access

    Organization
    Demo Engineering
    Allowed channel
    Demo provider
    Allowed model
    demo-model

    Create Demo Engineering and assign the configured channel and model. Unassigned resources remain outside its access scope.

    Read the guide
  3. Create a scoped application key

    Name
    demo-workspace
    Organization
    Demo Engineering
    Model restriction
    demo-model
    QPS
    5
    Rolling quota
    10,000 tokens / 24h
    Key
    sk-demo-••••

    Select that organization, set the name, model restriction, QPS, and rolling quota, then review connection parameters. These limits are sample settings.

    Read the guide
  4. Close the loop with a request

    Request ID
    req_demo_01
    Model
    demo-model
    Key
    demo-workspace
    Result
    200 OK · 128 tokens

    Use this key with the allowed model, then match the request ID, status, and tokens in usage and request records.

    Read the guide

Illustrative console structure and sample data. Follow your deployed console and its versioned documentation.

02 AI SECURITY CONTROLS

Inspect what goes in.
Review what comes out.

Check requests and responses at the gateway. Security events help you trace the source of risks.

  • Credential detection

    If a request carries a password or key pattern, the gateway flags it. Your security team can review.

  • Output inspection

    Check model replies for configured code markers and log match locations for review.

  • Security investigation

    Connect rules, match locations, and request records in one place. No cross-system lookups to investigate a risk.

Explore security controls
Input checks · Output inspection · Investigation
Request inputCredential detectionpassword=[REDACTED]
Model call
Model outputCode marker checks<script [omitted]

Security event

Match details
Rule · Source · Match location
Action review
Recorded matches and actual outcomes
Request correlation
Linked request records by request ID
Security workflow illustration · Sample content

See the security guide for detection and action coverage, streaming support, and event retention.

03 INTEGRATION

Change one line.
You're in.

Swap the base URL in your existing SDK. Add a key and model ID. Done.

Read the SDK and API guide
Terminal
curl --fail-with-body "https://bosapi.example.com/v1/chat/completions" \
  -H "Authorization: Bearer $BOS_GATEWAY_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "YOUR_MODEL_ID",
    "messages": [
      {"role": "user", "content": "Say hello in one sentence."}
    ]
  }'

OpenAI-compatible example. Inject your key via env, then replace the endpoint and model ID.

GROW AT YOUR PACE

Free for self-hosting.
Upgrade as your team grows.

From self-hosting to enterprise controls, choose the plan that fits your team.

Individuals and self-hosting

Community

$0

Free self-hosted

2 organizations20 API Keys
  • Gateway, console, providers and models
  • Model and provider access
  • QPS, rolling quotas, usage and request records
  • Basic security checks
Self-host for free →
Multiple teams, one gateway

Business

$149/month

More organizations and keys, with more timely technical support.

20 organizations500 API Keys
  • Enhanced capabilities listed for Team
  • Scale to 20 organizations and 500 keys
  • More timely technical support
Large and regulated organizations

Enterprise

Custom quote

Tailored deployment topology, governance, and support.

Tailored capacity and support
  • Tailored requests, QPS, environments and topology
  • Private delivery, isolated networks and recovery
  • Custom audits, identity and key integration
  • Launch assessment, upgrade assistance, 24/7 support
CLIENT INTEGRATIONS

Have a key. Bring it to your tools.

CC Switch handles the import, Vary AI handles config management and local routing.

CC SwitchExplore Vary AI
OPEN SOURCE & COMMUNITY

Build with the community.

Use Discord for open-source discussion and feedback. For commercial plans, contact sales on the pricing page.

Join Discord

If external sites are unreachable, check your network or use the documentation and sales consultation.

Run your enterprise AI gateway.
On your own server.

Get started freeQuickstart
BOS API · TYPEX

Sales consultation is unavailable

Sales reception could not be initialized. Please try again later. Documentation and free self-hosting remain available.

Read the docsSelf-host for free