Inference api

Oct 13, 20269 min read

Claude Code on an Open Model, No Router: the Anthropic Messages API on Qwen3.8 27B, Measured

7 lines

of environment variables, and no router

9 of 9

requests of a session answered, once all five model variables were set

Oct 12, 20267 min read

Add an Open Model to 9Router as a Custom Provider: Setup and What We Measured

9Router puts one local endpoint in front of your coding tools and many model providers. Here is how to add an OpenAI-compatible API to it as a custom provider, with ParalonCloud and Qwen3.8 27B as the worked example, and what happened when Claude Code and opencode fixed a bug through it.

Sep 21, 20268 min read

OpenJev Is Live on an OpenAI-Compatible API: an Open Jev Alternative You Can Call Today

TypeSafe's Jev is hosted-only and behind a waitlist. OpenJev, the open NLI cross-encoder built on Qwen3.5, is now served on ParalonCloud behind POST /v1/classify: a label and calibrated probabilities per input, 3 ms per item in a batch, no generated text. Measured against a 27B LLM judge on the same pairs, with the vLLM recipe so you can run it yourself.

Sep 19, 20266 min read

"Stream ended without finish_reason": What an OpenAI-Compatible API Should Do When the Worker Dies Mid-Stream

A customer's coding agent showed us a screenshot: Error: Stream ended without finish_reason. On our side the request row said completed. Both were wrong in their own way. Here is what happens to a streamed completion when the GPU worker's connection drops, why the common gateway behaviour turns it into a silent truncation, and the three rules we now follow: retry before the first token, an explicit error event after it, and never count a cut stream as a success.

Sep 10, 20266 min read

Run Cline on Your Own LLM API: OpenAI-Compatible Setup for VS Code, JetBrains and the CLI

Cline is one of the most-installed open-source coding agents for VS Code, and it lets you bring your own model. Here is the complete setup to point it at any OpenAI-compatible endpoint, using ParalonCloud's inference API and Qwen 3.8 27B as the worked example: the extension, the Plan/Act modes, the CLI, what to put in every field of the model configuration, and what a session actually costs.

Aug 22, 20268 min read

Image Generation API: Z-Image-Turbo, OpenAI-Compatible, ~5 Seconds per Image

Our inference API now generates images. Z-Image-Turbo — open-weight, Apache 2.0 — is live behind an OpenAI-compatible /v1/images/generations endpoint, running on consumer GPUs in our network. Free to try, $0.003 per image after. Try it from curl, Python, or straight from our Discord.

Aug 20, 20264 min read

Qwen 3.8 27B Is Live: a Free, OpenAI-Compatible Vision LLM API

Our inference API can now see. Qwen 3.8 27B — natively multimodal, 32k context, tool calling — is live on the ParalonCloud API, with a free trial key. Send screenshots and images through the same OpenAI-compatible endpoint you already use.

Jun 12, 20266 min read

Run OpenClaw on a Free LLM API (Full Qwen 3.6 Setup)

OpenClaw is free — the model behind it usually isn't. Here's the complete openclaw.json custom-provider setup to run OpenClaw on ParalonCloud's free OpenAI-compatible inference API, with Qwen 3.6 27B doing the thinking and an honest guide to living inside a 32k context window.

Jun 11, 20264 min read

Run pi, the Open-Source Coding Agent, on Your Own LLM API

pi is an open-source coding agent in the spirit of Claude Code — except you choose the model behind it. Here's the full setup to point pi at any OpenAI-compatible endpoint, using ParalonCloud's inference API and Qwen 3.6 27B as the worked example.

Apr 22, 20263 min read

Paralon Cloud Partners with Romanian-American University to Power AI Research and Education

Paralon Cloud announces a strategic academic partnership with the Romanian-American University, giving students and researchers access to our OpenAI-compatible inference API for AI projects, research, and education.