The NVIDIA RTX A5000 rents from $0.23/hr in the cloud and costs around $3,200 new. It is a 24 GB Ampere workstation GPU aimed at professionals who need solid performance.
This guide covers current RTX A5000 cloud and used hardware pricing, the full spec sheet, which models fit in 24 GB, and how the card compares to the A6000 and A100. Cloud availability is thin, so the A5000 is often not the best value per dollar against newer alternatives.
Takeaways
- The RTX A5000 rents from $0.23/hr to $1.38/hr across the few clouds that list it.
- New cards list around $3,200 on Newegg, with used prices varying by condition and seller.
- The A5000 has 24 GB of GDDR6 ECC and 8,192 CUDA cores on the Ampere architecture, and supports 2-way NVLink.
- The A6000 is often better for memory-bound work: double the VRAM at 48 GB for $0.35/hr on Thunder Compute.
NVIDIA RTX A5000 Cloud Pricing
The pricing information in this guide is reviewed weekly.
| Provider | GPU / Instance | On-Demand $/GPU-hr* | Notes |
|---|---|---|---|
| Vast.ai | RTX A5000 | $0.23 | Median of 1 distinct verified US/CA host, priced as compute plus 100 GB storage; bandwidth billed separately. |
| Runpod | RTX A5000 | $0.27 | |
| Paperspace | RTX A5000 | $1.38 | |
| Last reviewed on October 1, 2026. | |||
Thunder Compute's RTX A6000 at $0.35/hr carries 48 GB, double the A5000's VRAM.
Methodology
- On-demand only. Cloud rates exclude reserved, spot, and committed-use discounts.
- Public listings. Cloud figures come from each provider's pricing page; Vast.ai uses the marketplace median from one verified US/CA host.
- Same silicon. Every cloud row is a 24 GB RTX A5000.
- Reviewed weekly. Marketplace and used prices reflect live availability, which fluctuates.
RTX A5000 Cost Benchmark
The 10-hour column shows what a single A5000 costs for a typical rendering or inference session across the providers that list it.
| Provider | On-Demand $/GPU-hr | 10-Hour Cost |
|---|---|---|
| Vast.ai | $0.23 | $2.27 |
| Runpod | $0.27 | $2.70 |
| Paperspace | $1.38 | $13.80 |
RTX A5000 Hardware Price: Buy vs Rent
A current Newegg listing shows the RTX A5000 at $3,200 new. Used pricing varies by seller, condition, and warranty status, so the new-card listing is the cleaner baseline for buy-versus-rent math. The card launched in April 2021 at an MSRP near $2,250.
Renting makes more sense for intermittent workloads: at $0.23/hr on Vast.ai, you would need about 13,700 hours of continuous use to break even with the new hardware cost, before power, cooling, and depreciation.
NVIDIA RTX A5000 Specs at a Glance
The RTX A5000 pairs 24 GB of GDDR6 ECC at 768 GB/s with 8,192 CUDA cores and 256 third-generation Tensor Cores on NVIDIA's Ampere architecture. It delivers 27.8 TFLOPS of FP32 and 64 second-generation RT Cores for rendering, at a 230W board power.
Unlike newer Ada cards, the A5000 has no FP8 support, so it cannot use the hardware-accelerated FP8 path that speeds up large-model inference. It does support 2-way NVLink at 112.5 GB/s, letting two cards pool 48 GB of memory for larger jobs.
| Specification | NVIDIA RTX A5000 |
|---|---|
| Architecture | Ampere (GA102) |
| CUDA Cores | 8,192 |
| Tensor Cores | 256 (3rd Gen) |
| RT Cores | 64 (2nd Gen) |
| GPU Memory | 24 GB GDDR6 ECC |
| Memory Bandwidth | 768 GB/s |
| FP32 Performance | 27.8 TFLOPS |
| NVLink | 2-way, 112.5 GB/s |
| FP8 Support | No |
| TDP | 230W |
| Release Date | April 2021 |
What Models Fit on a 24GB RTX A5000?
24 GB runs 7B-13B LLMs in FP16, up to ~32B in 4-bit, and image models like FLUX.1 in FP8. The estimates below use published weight sizes and assume 20-30% overhead for KV cache, activations, and framework buffers.
| Model | Type | Setup | Approx VRAM1 | Fits 24 GB? |
|---|---|---|---|---|
| Llama 3 8B | LLM | FP16 | ~16 GB | Yes |
| FLUX.1 [dev] | Image | FP8 | ~17 GB | Yes |
| Qwen 2.5 32B | LLM | 4-bit | ~20 GB | Yes |
| Llama 3 13B | LLM | FP16 | ~26 GB | Tight; use 8-bit |
| 1 Approximate VRAM for a single inference at typical settings. LLM figures are weights plus 20-30% for KV cache and activations; image figures include text encoders and the VAE. | ||||
How the RTX A5000 Compares
The A5000 sits between the consumer RTX 4090 and the workstation A6000, but its Ampere design trails newer Ada cards on throughput and lacks FP8.
| Feature | NVIDIA RTX A5000 | NVIDIA RTX 4090 | NVIDIA RTX A6000 | NVIDIA A100 80GB |
|---|---|---|---|---|
| Architecture | Ampere | Ada Lovelace | Ampere | Ampere |
| GPU Memory | 24 GB GDDR6 | 24 GB GDDR6X | 48 GB GDDR6 | 80 GB HBM2e |
| Memory Bandwidth | 768 GB/s | 1,008 GB/s | 768 GB/s | 1,935 GB/s (PCIe); 2,039 GB/s (SXM) |
| Native FP8 Support | No | Yes | No | No |
| NVLink | 112.5 GB/s | No | 112.5 GB/s | 600 GB/s |
| On-Demand Cloud Price | $0.23 - $1.38/hr | $0.50 - $0.74/hr | $0.35 - $1.89/hr | $1.09 - $5.03/hr |
RTX A5000 vs RTX A6000
The A6000 doubles the A5000's memory to 48 GB on the same Ampere architecture. Thunder Compute lists the A6000 at $0.35/hr, above the cheapest Vast.ai and Runpod A5000 listings but below Paperspace's $1.38/hr A5000 rate, which can make the A6000 the stronger value for memory-bound work.
The A5000 keeps an edge when a used card fits a fixed on-premise budget, or when 24 GB is plenty and the cheapest cloud rate ($0.23/hr on Vast.ai) matters most.
For current rates, see our NVIDIA RTX A6000 pricing guide.
Run Workstation GPUs on Thunder Compute
Thunder Compute doesn't list the RTX A5000, but offers the RTX A6000 at $0.35/hr, with double the VRAM at 48 GB. It comes with per-minute billing, no minimum commitment, and VS Code and Cursor extensions that connect your editor directly to a running instance.
For larger models or higher bandwidth, Thunder also lists the A100 at $1.09/hr. See current availability.
Last Thoughts on NVIDIA RTX A5000 Pricing
The RTX A5000 remains a capable 24 GB workstation card, and at around $3,200 new it is a reasonable dedicated-workstation buy. In the cloud, though, thin availability and the lack of FP8 leave it behind newer options on value unless the lowest marketplace rate is available.
For memory-bound rental workloads, a 48 GB A6000 at $0.35/hr can do more than an A5000, and an A100 handles the jobs that outgrow 24 GB. The A5000 is a fine card, but rarely the most flexible one to rent in 2026.
FAQ
What is the NVIDIA RTX A5000 price in 2026?
The RTX A5000 rents from $0.23/hr to $1.38/hr in the cloud. A new card lists around $3,200 on Newegg, with used prices varying by condition and seller.
How much VRAM does the RTX A5000 have?
The RTX A5000 has 24 GB of GDDR6 ECC memory with 768 GB/s of bandwidth.
How many CUDA cores does the RTX A5000 have?
The RTX A5000 has 8,192 CUDA cores, 256 third-generation Tensor Cores, and 64 second-generation RT Cores on NVIDIA's Ampere architecture.
Does the RTX A5000 support NVLink?
Yes. Two RTX A5000 GPUs can be linked with an NVLink bridge at 112.5 GB/s, pooling 48 GB of memory for larger workloads.
When was the RTX A5000 released?
The RTX A5000 was released in April 2021.
Is the RTX A5000 or A6000 better value?
The A6000 is often better value for memory-bound work: it doubles VRAM to 48 GB at Thunder Compute's $0.35/hr, though Vast.ai and Runpod list lower A5000 hourly rates.