Agent frameworks & SDKs
Connect LlamaIndex
Agents and RAG over your data. Point it at AgentKeyRoute so every request follows your governance profile and is recorded.
Get a key with the right protection
In the console, open Connect an app (opens in a new tab) and pick this tool. AgentKeyRoute recommends a governance profile, creates the key, and shows these same steps with your key and an allowed model filled in, plus a live test.
Setup
- Install LlamaIndex
pip install llama-index llama-index-llms-openai-like - Point it at the gateway
from llama_index.llms.openai_like import OpenAILike llm = OpenAILike( model="gpt-4.1", api_base="https://gateway.agentkeyroute.com/v1", api_key="<your API key>", is_chat_model=True, is_function_calling_model=True, ) print(llm.complete("Hello"))Replace
<your API key>with your AgentKeyRoute key.gpt-4.1is an example: use a model your key may use (GET /v1/modelslists them). - Check it works
Run the code once. The request appears in Requests (opens in a new tab) with the policy decision, the model that answered and what was redacted.
Good to know
- It acts autonomously, so it's registered as an autonomous workload. High-risk autonomous use waits for a person on risky requests.
- It uses the OpenAI-compatible API, so the base URL ends in
/v1. - If policy doesn't allow the model you chose for some data, the gateway answers with an allowed one.
X-AIGov-Modelnames it. - Refused? See Why was a request blocked?