How much does it cost to rent a A100?

Owners set their own price per GPU-hour, which depends on the number of servers, the term and the start date. Send a request with what you need and we come back with offers.

What is the minimum term for reserved A100 capacity?

Usually one month or more, set by each owner. Longer terms usually get a lower price per GPU-hour.

How much memory does a A100 have?

40 or 80 GB HBM2e per GPU (NVIDIA Ampere).

Can I rent a single A100 server?

Yes, where the owner allows it: each listing shows how many servers it has and you can ask for one or for all of them.

NVIDIA Ampere

Rent A100 servers, reserved from data centers

A100 is the Ampere data-center GPU, in 40 GB and 80 GB versions. A generation behind Hopper, it is now one of the cheapest ways to get data-center memory and NVLink for training and batch inference.

Memory per GPU: 40 or 80 GB HBM2e
Architecture: Ampere
Listings: On request
From: Ask

A100 capacity listed now

No A100 capacity is listed right now. Send a request and we will source it from our owners.

Tell us what you need

What A100 is good for

Fine-tuning and batch inference on a budget
Research workloads that do not need FP8

What to ask before you reserve A100 capacity

40 GB or 80 GB, and SXM or PCIe.
How the servers are interconnected (InfiniBand or RoCE, and at what speed per GPU) if you will train across nodes.
Whether the price covers storage, egress and support, or only the GPU-hours.
The uptime they commit to, and what you get back when they miss it.

Questions

How much does it cost to rent a A100?: Owners set their own price per GPU-hour, which depends on the number of servers, the term and the start date. Send a request with what you need and we come back with offers.
What is the minimum term for reserved A100 capacity?: Usually one month or more, set by each owner. Longer terms usually get a lower price per GPU-hour.
How much memory does a A100 have?: 40 or 80 GB HBM2e per GPU (NVIDIA Ampere).
Can I rent a single A100 server?: Yes, where the owner allows it: each listing shows how many servers it has and you can ask for one or for all of them.

Tell us what you need

Sign in to send a request. It opens a conversation with the owners and the Paralon team, and you get an email for every reply.

Free, with Google, GitHub or an email code. No commitment.