Change one base URL

Otium speaks the OpenAI Files and Batch API. If you already submit batch work to OpenAI, integration is a base-URL swap and a wider completion window. No new SDK, no rewrite.

Quickstart

1. Create an API key in the customer portal, under Developers.
2. Point your OpenAI client at https://api.getotium.ai/v1.
3. Upload all your work as one JSONL file, create a batch, poll for the result.

Send everything at once rather than a few requests at a time: Otium is your queue. A file can hold up to 200 MB, requests that share instructions are served from cache for free, and a big batch fills a machine sooner. No rate limiter or retry loop on your side.

python

from openai import OpenAI

client = OpenAI(
    base_url="https://api.getotium.ai/v1",
    api_key=OTIUM_API_KEY,
)

# 1. Upload a JSONL file of requests, one per line.
f = client.files.create(file=open("requests.jsonl", "rb"), purpose="batch")

# 2. Create the batch. The completion window is the price lever:
#    the wider it is, the cheaper the work runs.
batch = client.batches.create(
    input_file_id=f.id,
    endpoint="/v1/chat/completions",
    completion_window="7d",
)

# 3. Poll, then download the output file when it reports completed.
batch = client.batches.retrieve(batch.id)
print(batch.status)

Batch API

Free demo

Run a batch of up to 100 lines for free, before you add funds, and get results within the hour.
API reference 70 endpoints

Every endpoint for jobs, files, batches and health, with parameters, bodies, responses and schemas.
Usage limits

What an account can spend in a month, a day and at once, how tiers rise, and what a refused request returns.
Command-line client

Install otiumctl, sign in from a terminal, and validate, test and publish workflows in a shell or CI.
Self-hosted workers

Run the worker on your own GPUs: enroll a machine, serve the model, start the worker, and what it costs.
Behind a gateway

Add Otium to a gateway such as Mozilla AI’s Otari as one more provider, priced from the rate card.
OpenAPI spec Download v0.1.0

The machine-readable contract, to generate a typed client or load into your own tooling.

Workflows

Overview

A multi-step AI pipeline submitted as one document, compiled to a DAG, with one completion window for the whole job.
The workflow document

Every field of a workflow, how a step reads another step’s output, and how the order is worked out from that.
Conditions

Run a step only when the data calls for it, and include part of a prompt only when it applies.
Validation and fallback

Check every step’s output against a schema, retry it, hand it to a bigger model, and see what happened.
Assets

Reference data every item in a batch shares, published once, pinned by each batch, and kept out of your requests.
Tools and external steps

Call your own HTTP endpoint from a step, pause a run while your system or a person does the work, and get notified when a batch finishes.
Running workflows

Publish, submit a batch, choose a window, follow runs, collect outputs, and know what it costs.
Testing

Unit tests with canned step outputs, prompt snapshots, and the compiler’s checks, run offline and in CI.
Playground Tool

The real workflow compiler in your browser: load an example, edit it, see the graph and its cost.

Good to know

Reruns aren’t byte-identical

Even at temperature 0, the same input can come back slightly different: batching reorders the floating-point maths, and a retry may run on other hardware. Every provider that batches works this way. Key results on custom_id, keep downstream steps idempotent, and don’t compare two runs for equality.

Why this happens →

Getting a key

Create one in the customer portal, under API keys. Otium is in beta, so keys are issued once your account is created. Before you spend anything, the demo model runs the same API free, so you can check your integration end to end.

Try the free demo →

Background reading

The concepts behind the API: why a deadline lowers the price, and how to shape a batch job well.

Get an API key.

Otium is in beta. Leave your email and we’ll send you a link to create your account.

Free to try on our demo model. No credit card, no spam: we email you a link to finish.

Otium is in beta and open to everyone. Already have an account? Sign in.