​
Use cases

Thunder Compute is optimized for AI/ML development workflows. That said, Thunder Compute has the full functionality of an EC2-style on-demand GPU cloud instance.

​
CUDA versioning

  • CUDA version 12.0 or greater (version 12.6 installed)
  • CUDNN version 9.0 or greater

Do not attempt to reinstall CUDA. If it seems like you need an older CUDA driver, you almost always are better off upgrading your other dependencies (e.g., PyTorch)

​
Officially supported libraries

The following libraries and tools are thoroughly tested:

  • PyTorch (version 2.7.1 installed)
  • Notebooks
  • AI model serving tools like ComfyUI, Ollama, VLLM, Unsloth, and more

Note: make sure you install the cuda-compatible version of these libraries. The cuda-compatible PyTorch binary and latest CUDA drivers are pre-installed on every Thunder Compute instance.

​
Pre-installed libraries

​
Technical specs

  • Egress/Ingress: 7Gbps
  • IP: dynamic
  • Location: U.S. (region varies)
  • E series CPU instances in Azure

​
Experimental (less stable)

The following workloads are less tested, experimental, or unstable:

  • Tensorflow [experimental]
  • PyTorch Lightning [experimental]
  • Jax [experimental]
  • Custom CUDA Kernels [unpredictable behavior, particularly with errors and profiling. Message us for details]

If you encounter compatibility issues with these experimental workloads, consider switching to Production mode for maximum compatibility and predictable performance.

​
Unsupported

Currently, Thunder Compute lacks official support for graphics workloads such as OpenGL, Vulkan, and FFMPEG. If you’d like to run these, contact us.

For workloads requiring graphics support, custom kernels, or components incompatible with the prototyping tier, use Production mode which provides maximum stability and reliability with all optimizations disabled.

​
Cryptocurrency mining

Mining, staking, or otherwise interacting with cryptocurrency is strictly prohibited on Thunder Compute. If cryptocurrency-related activity is detected, the associated account is immediately banned from Thunder Compute and any billing credit is revoked. The account is then billed for the full amount of usage.

​
Geographic availability

Thunder Compute is only available for B2B customers, i.e., requires a VAT ID (or similar) in the following countries:

  • United Arab Emirates
  • Angola
  • Bahrain
  • Brazil
  • Switzerland
  • Côte d’Ivoire (Ivory Coast)
  • Colombia
  • Algeria
  • Georgia
  • Iraq
  • Jordan
  • Kazakhstan
  • South Korea (Republic of Korea)
  • Kuwait
  • Morocco
  • North Macedonia
  • Oman
  • Paraguay
  • Qatar
  • Saudi Arabia
  • Tunisia
  • Turkey (Türkiye)
  • Tanzania
  • Ukraine
  • Uganda
  • Uzbekistan
  • Yemen
  • India
  • Moldova (Republic of Moldova)

Thunder Compute is not currently available in the following countries:

  • Belarus
  • China
  • Cuba
  • Indonesia
  • Iran
  • Kenya
  • North Korea
  • Malaysia
  • Mexico
  • Nigeria
  • Russia
  • Sudan
  • Syria
  • Uruguay

If you’re located in one of these countries and need access to Thunder Compute, please contact us to discuss potential alternatives.

​
Miscellaneous tips

We use a new kind of virtualization to maximize GPU utilization, reducing your cost. To learn more about how this works, check out this blog post.

If you encounter any strange issues or errors, please check our troubleshooting guide or contact us.

To help you get started with Thunder Compute, we recommend checking out these guides: