While the AMD Instinct MI300X was promoted as the "H100 killer" for its massive 192 GB of VRAM, its actual value depends on your project.
The following breakdown compares the current landscape of MI300X on-demand pricing. Niche clouds are aggressively undercutting hyperscale giants to win over developers running large-scale LLM inference.
Takeaways
- Vultr and TensorWave have opened the MI300X price war below $2/hr.
- RunPod is the easiest MI300X self-service experience under $3/hr.
- Hyperscalers (Azure, Oracle) charge 3-4x more than niche clouds.
- At $1.38/hr, Thunder Compute H100s stay the absolute price-performance leader for most workflows.
Current on-demand MI300X prices (per GPU)
| Provider | SKU / Instance | On-Demand $/GPU-hr* | Notes |
|---|---|---|---|
| TensorWave | N/A | $1.71 | |
| Vultr | 8 x MI300X cluster | $1.85 | $14.80/hr node / 8 GPUs |
| Digital Ocean | N/A | $1.99 | |
| Hot Aisle | N/A | $1.99 | |
| RunPod | MI300X 192 GB | $2.99 | Community Cloud on-demand |
| Crusoe Cloud | N/A | $3.45 | |
| Cirrascale | N/A | $3.85 | $22,499/month (shortest commitment) |
| Oracle Cloud | BM.GPU.MI300X.8 | $6.00 | 8-GPU bare-metal ($48/hr) |
| Azure | ND MI300X v5 (8 x MI300X) | $7.86 | $62.85/hr VM / 8 GPUs in West US |
| * Normalized to a single MI300X, even when only multi-GPU nodes are offered. Last update: June 18, 2026 |
|||
Methodology
Why you can trust these numbers:
- On-demand only - no reservations or prepaid contracts.
- Same silicon - every figure refers to AMD MI300X (192 GB) SKUs.
- Public price lists - pulled in June 2026 from each provider's published pricing pages.
- U.S. regions, USD - prices elsewhere vary by 5-20 %.
Azure ND MI300X Instances
Through the ND_MI300X_v5-series, Azure offers hyper-scale virtual machines designed for high-end Deep Learning training and tightly coupled, scale-up and scale-out Generative AI or HPC workloads.
Powered by AMD Instinct MI300X accelerators and 4th Gen Intel Xeon Scalable (Sapphire Rapids) processors, these instances provide immense high-bandwidth memory (HBM) capacity, making it possible to fit larger LLMs into a single node with fewer GPUs.
| Spec | Standard_ND96isr_MI300X_v5 |
|---|---|
| Provider | Azure |
| MI300X GPUs | 8 |
| vCPUs | 96 |
| RAM | 1,850 GiB |
| Hourly price | $62.85 |
| Price per-GPU | $7.86 |
Why this matters for developers
- More memory, new math - MI300X packs 192 GB HBM3 and FP8 support, ideal for 70 B+ parameter models.
- Price gap vs. H100 - Even Vultr's single-GPU MI300X at $1.85/hr costs about 34% more than Thunder Compute's H100 at $1.38/hr.
- H100 still wins ROI - Unless your model truly needs 192 GB or FP8, an H100 80 GB at $1.38/hr often delivers better value.
- Bookmark this page - we refresh the numbers monthly so you don't have to.
Get the full picture in our AI GPU rental market trends overview.