Skip to content

Enterprise deploymentCustomer-hosted or fully managed.Contact salesView pricing

+Integrations · Agent frameworks

Intertrace + LlamaIndex

RAG pipelines whose model calls and retrieved content pass through the layer.
LlamaIndex · python
from llama_index.llms.openai import OpenAI
import os

llm = OpenAI(
    model="gpt-4o-mini",
    api_key=os.environ["INTERTRACE_RUNTIME_API_KEY"],
    api_base="https://intertrace.fly.dev/v1",
)
print(llm.complete("Hello"))

OpenAI llm api_base → Intertrace Gateway /v1.

+Three steps

  1. 01

    Get a runtime key

    Create an itr_rt_* key in Connect. It carries your tenant, so no org headers are needed.

  2. 02

    Point the client at Intertrace

    Paste the snippet. Nothing else in your code changes.

  3. 03

    Watch decisions arrive

    Every call shows up in Traffic with its verdict and the reason, in monitor mode first.

Full setup guide in the docs →

+What you get

Once it's connected

  • Prompt injection and instruction override caught before the model sees it
  • Sensitive data kept out of prompts and responses
  • Tool calls authorized before they execute
  • Every decision logged with its reason, per agent

+Related

+ The AI watching your AI

Protect your LlamaIndex agents today.

Start in monitor mode, see every decision, then turn on enforcement when you're ready.