All servicesRuns on your server
Flowthera Gateway
One secure, OpenAI-compatible API for all your models.
Give every app and team one address for AI. Existing tools that speak the OpenAI API work by changing the URL and key. You decide who can use which model, how much, and whether anything may leave your network.
What teams use it for
A product team
Points its app at the gateway instead of a cloud API, so customer data stays in-house and the cost stays fixed.
An agency with many clients
Issues one key per client project with its own limits, and can see usage per project.
An IT administrator
Allows a cloud provider only for one approved team, with that team’s own key, and blocks it for everyone else.
What it does
- Works with existing tools
- OpenAI-compatible chat, completion and embedding endpoints, including streaming.
- Keys with limits
- Requests per minute, concurrent requests and allowed models per key.
- Queue instead of crash
- When the machine is busy, requests wait in a short queue rather than failing.
- Cloud only when you allow it
- External providers are off by default. When allowed, every response sent outside is labelled.
- Usage you can see
- Requests, tokens and response time per key and per model, without storing the text.
How you start
- 1
Install the server.
- 2
Create a key for each app, team or client.
- 3
Change your app’s API address and key. Nothing else changes.
Free, and what paying adds
Free
- Included with the free server
- 3 API keys
- OpenAI-compatible endpoints
Paid
Included in the Server licence, pilot pricing
- Any number of keys
- Per-key limits and model lists
- Usage reports
- More than one external provider
You pay for your own hardware, never for our tokens. See all plans.
Questions
Is it a separate install?
No. The gateway is part of Flowthera Server. It is listed on its own because many customers buy it for this alone.
Which clients work with it?
Anything that can talk to the OpenAI API by changing the base URL: official OpenAI libraries, many editors and agent tools, and your own code.
Try Flowthera Gateway on your own hardware
We install it with you on a machine you choose and support your team through the pilot.