Documentation
How to call the llm-bench API: quickstart, reference, errors, and what we do with your data.
The llm-bench API is OpenAI-compatible: you point the SDK you already use at our
base URL and change the key. What differs is what model means — here it names a
capability, a task you define, and we choose the model that serves it.
Start with the Quickstart. The reference pages below are for when you need a specific field, header or error code.
The Terms of Service , Privacy Policy and Data Processing Agreement govern use of the API. Where anything on these pages differs from those, those govern.
- Quickstart
Point the OpenAI SDK you already use at llm-bench and make a working call in under ten lines — including what to vault first and what `model` means here.
- API Reference: Data Plane
The OpenAI-compatible chat completions and Batch endpoints: what matches OpenAI exactly, what differs, every llmbench extension field, every response header, and the errors you can get.
- API Reference: Control Plane
Everything you can do with a management-scope key: API keys, account, provider credentials, capabilities, routing policies, schemas, validators, webhooks, usage and billing.
- Prompt Variables and Capabilities
Define your own task: how prompt variables are substituted, how a capability's prompts, output schema and validators are created and edited, and what an edit changes.
- Lifecycle and What You Pay
How a task moves from exploring to a fixed price, who pays for the model calls we make along the way, and how to see what you were actually charged.
- Error Reference
Every error code the OpenAI-compatible plane can return, what it means, and what to do about it.
- Migrating from OpenAI
What changes and what does not when you repoint an OpenAI SDK at llm-bench: base URL and key, the model field becoming a task slug, what fails loudly, what you gain, and the friction to expect.
- Data and Privacy
What we store, for how long, who else sees it, and what a deletion request does and does not reach — a plain-language index into the legal documents that govern.