Guides & Tutorials
8 min
Batch API for Open Models: Half-Price Chat, Embeddings and Responses Jobs with the OpenAI SDK
Paralon's Batch API takes a JSONL file of requests and returns a file of results, at 50% of the token price, through the same /v1/files and /v1/batches calls as OpenAI's. We ran it with the official Python SDK: 300 support tickets classified with zero failures, 100 embeddings and 20 Responses API drafts, billed at exactly half the live price, while live requests kept their normal latency.
Batch APIOpenAI SDKbulk inference