Guides & Tutorials8 min read
Batch API for Open Models: Half-Price Chat, Embeddings and Responses Jobs with the OpenAI SDK
Paralon's Batch API takes a JSONL file of requests and returns a file of results, at 50% of the token price, through the same /v1/files and /v1/batches calls as OpenAI's. We ran it with the official Python SDK: 300 support tickets classified with zero failures, 100 embeddings and 20 Responses API drafts, billed at exactly half the live price, while live requests kept their normal latency.
Read