# Create new instance Source: https://www.thundercompute.com/docs/api-reference/instances/create-new-instance https://api.thundercompute.com:8443/openapi.json post /instances/create/{cpu_cores}/{template}/{gpu_type} Create a new compute instance with specified configuration. # Create new instance Source: https://www.thundercompute.com/docs/api-reference/instances/create-new-instance-1 https://api.thundercompute.com:8443/openapi.json post /instances/create/{cpu_cores} Create a new compute instance with specified configuration. # Create new instance Source: https://www.thundercompute.com/docs/api-reference/instances/create-new-instance-2 https://api.thundercompute.com:8443/openapi.json post /instances/create Create a new compute instance with specified configuration. # Delete instance Source: https://www.thundercompute.com/docs/api-reference/instances/delete-instance https://api.thundercompute.com:8443/openapi.json post /instances/{instance_id}/delete Delete a compute instance. # List user instances Source: https://www.thundercompute.com/docs/api-reference/instances/list-user-instances https://api.thundercompute.com:8443/openapi.json get /instances/list Get a list of all instances for the authenticated user. # Modify instance configuration Source: https://www.thundercompute.com/docs/api-reference/instances/modify-instance-configuration https://api.thundercompute.com:8443/openapi.json post /instances/{instance_id}/modify Modify the configuration of a compute instance. # Resize instance disk Source: https://www.thundercompute.com/docs/api-reference/instances/resize-instance-disk https://api.thundercompute.com:8443/openapi.json post /instances/{instance_id}/resize Resize the disk of a compute instance. # Start instance Source: https://www.thundercompute.com/docs/api-reference/instances/start-instance https://api.thundercompute.com:8443/openapi.json post /instances/{instance_id}/up Start a stopped compute instance. # Stop instance Source: https://www.thundercompute.com/docs/api-reference/instances/stop-instance https://api.thundercompute.com:8443/openapi.json post /instances/{instance_id}/down Stop a running compute instance. # Create instance snapshot Source: https://www.thundercompute.com/docs/api-reference/snapshots/create-instance-snapshot https://api.thundercompute.com:8443/openapi.json post /instances/snapshot Create a snapshot of a compute instance. # Delete snapshot Source: https://www.thundercompute.com/docs/api-reference/snapshots/delete-snapshot https://api.thundercompute.com:8443/openapi.json delete /snapshots/{snapshot_id} Delete a user snapshot. # Get user snapshots Source: https://www.thundercompute.com/docs/api-reference/snapshots/get-user-snapshots https://api.thundercompute.com:8443/openapi.json get /snapshots Get a list of all snapshots for the authenticated user. # Get available templates Source: https://www.thundercompute.com/docs/api-reference/utilities/get-available-templates https://api.thundercompute.com:8443/openapi.json get /thunder-templates Get a list of all available templates including default and user snapshots. # Get system status Source: https://www.thundercompute.com/docs/api-reference/utilities/get-system-status https://api.thundercompute.com:8443/openapi.json get /status Show availability for each type of GPU. # Billing Source: https://www.thundercompute.com/docs/billing Understand Thunder Compute's usage-based billing, payment methods, billing alerts, current rates, and tips for saving on GPU cloud costs. ## Payment Options There are **two ways to pay** for Thunder Compute: ### Option 1: Save a Payment Method Save a credit card through our Stripe portal to get automatically billed for usage. You can manage your payment method anytime by going to [console.thundercompute.com/settings/billing](https://console.thundercompute.com/settings/billing) and clicking "manage billing". ### Option 2: Preload Credit Add credit directly to your account as an alternative to saving a payment method. This credit never expires and will be used before any saved payment method. **Order of payment** 1. Any preloaded credit you've added 2. Charges to your saved payment method You can switch between options or use both by saving a payment method later even if you started with preloaded credit. ## Billing Alerts * **Instance reminders:** We'll email you about any running instances so you're never caught off guard. * **Threshold charges:** As your usage grows, we'll bill your card at preset checkpoints (which rise over time) to prevent runaway bills. ## Our rates All compute resources are billed per minute only while your instances run. Storage incurs charges even when instances are stopped. Rates and promotions are subject to change without notice. For current rates, see our [pricing page](https://www.thundercompute.com/pricing). ## Credit terms * **Preloaded credit:** Credit you add to your account does not expire and will be used before charging your saved card. * **Revocation:** Promotional credit can be revoked at our discretion. * **Account policy:** We have a strict one-account-per-person policy. ## Money-Saving Tips While Thunder Compute is already the cheapest GPU cloud platform, there are a few strategies we recommend to reduce your bill: * Turn off instances when you're done. * Right‑size with `tnr modify` to match your workload. * Delete instances you no longer need. * Use snapshots to compress long‑term data. We think this balances a smooth experience with strong verification—but if you have feedback or questions, please hop into our [Discord](https://discord.com/invite/nwuETS9jJK). We're always happy to improve! # CLI Reference Source: https://www.thundercompute.com/docs/cli-reference Comprehensive reference for the Thunder Compute CLI. Manage instances (create, start, stop, delete), configure GPUs/CPUs, handle files, and use snapshots. ## Account Management ### Login Authenticate the CLI, which provides a link to the [console](https://console.thundercompute.com/settings?tab=tokens) where you can generate an API token. ``` tnr login ``` Under the hood, this generates and saves an API token to `~/.thunder/token`. You can store a token file here to programmatically authenticate, or by setting the `TNR_API_TOKEN` environment variable in your shell. ### Logout Log out of the CLI with: ``` tnr logout ``` This deletes the stored API token. ### API Token Management * Generate/manage tokens in the [console](https://console.thundercompute.com/settings?tab=tokens) * Tokens never expire but can be revoked * Use unique tokens per device ## Managing Instances ### Create an Instance Create a new Thunder Compute instance: ``` tnr create ``` This creates a new instance with default configuration and automatically assigns an instance ID. #### CPU Configuration Configure custom vCPU count: ``` tnr create --vcpus ``` Each vCPU comes with 8GB of RAM. For example, a 4 core instance has 32GB of RAM, and an 8 core instance has 64GB of RAM. By default, 4 vCPUs and 32GB of memory are included with your instance. Additional vCPUs are billed hourly at the rates shown [here](https://www.thundercompute.com/pricing) #### GPU Configuration Specify a GPU type: ``` tnr create --gpu ``` Available GPU types: * `t4`: NVIDIA T4 (16GB VRAM) - Best for most ML workloads * `a100` (default): NVIDIA A100 (40GB VRAM) - For large models and high-performance computing * `a100xl` : NVIDIA A100 (80GB VRAM) - For even larger models, the biggest and the best You can use the `--num-gpus` flag to specify multiple GPU configurations: ``` tnr create --gpu --num-gpus ``` #### Template Configuration Templates make it easy to quickly launch common AI tools. Your instance will already be configured with everything you need to get running to generate images, run an LLM, and more. To use a template, add the `--template` flag when creating an instance: ``` tnr create --template ``` Available templates: * `ollama`: Ollama server environment * `comfy-ui`: ComfyUI for AI image generation * `webui-forge`: WebUI Forge for Stable Diffusion After instance creation, start the server using `start-` when connected. For example: ``` start-ollama ``` ### Stop an Instance Stops a running instance. ``` tnr stop ``` Stopped instances continue to accrue storage cost. ### Start an Instance Starts a stopped instance. ``` tnr start ``` ### Delete an Instance ``` tnr delete ``` This action permanently removes an instance and all associated data. ## Using instances ### Connect to an Instance Use the `connect` command to access your instance. This wraps SSH, managing keys while automatically setting up everything you need to get started. ``` tnr connect ``` The instance must be running before you can connect to it. See if the instance is running and get the instance ID (default `0`) with `tnr status`. ### Port Forwarding Connect with port forwarding with the `-t` or `--tunnel` flag: ``` tnr connect -t PORT1 -t PORT2 ``` Features: * Forward multiple ports using repeated `-t/--tunnel` flags * Example: `tnr connect 0 -t 8000 -t 8080` forwards both ports 8000 and 8080 * Enables local access to remote web servers, APIs, and services ### Copy Files Transfer files between local and remote instance with the `scp` command: ``` tnr scp ``` You can transfer files in either direction, from your local machine to an instance, or from the instance to your local machine. You indicate the direction of transfer with the path format, shown below. Path format: * Remote: `instance_id:path` (e.g., `0:/home/user/data`) * Local: Standard paths (e.g., `./data` or `/home/user/file.txt`) * Must specify exactly one remote and one local path * Paths can be either absolute or relative. Examples: ``` # Upload to instance tnr scp ./local_file.txt 0:/remote/path/ # Download from instance tnr scp 0:/remote/file.txt ./local_path/ ``` File transfers have a 60-second connection timeout. SSH key setup, compression, and `~/` expansion are handled automatically. ## Managing Snapshots Snapshots capture the state of a stopped instance's disk, allowing you to create new instances from that point in time. ### Create a Snapshot Create a snapshot from a stopped instance: ``` tnr snapshot ``` * ``: The ID of the instance to snapshot. The instance must be stopped. * ``: A unique name for your snapshot. * Must contain only lowercase letters (a-z), numbers (0-9), and hyphens (-). * Must be between 1 and 62 characters long. Snapshots are stored compressed to save space. You can view the compressed size using the `--list` command after creation. You can use a snapshot as a template to launch new instances. The snapshot defines the initial disk content and size. While you can modify other configuration options (like vCPU count or GPU type) during the `tnr create` command, the new instance's disk size must be equal to or greater than the original instance's disk size. Decreasing the disk size is not supported. ``` tnr create --template [--gpu ] #etc ``` ### List Snapshots List all available snapshots and their details, including compressed size: ``` tnr snapshot --list ``` ### Delete a Snapshot Delete a specific snapshot by name: ``` tnr snapshot --delete ``` This action permanently deletes the snapshot. It does not affect instances created from this snapshot. ## System Management ### Modify Instance Modify the instance's vCPU count (and RAM), GPU type, or disk size: ``` tnr modify \ --disk-size-gb \ --gpu \ --vcpus ``` All flags are optional, but at least one change must be provided. These changes will affect the billing price of the instance. Instances must be stopped to modify the vCPU count/RAM or GPU type. You can resize disk at any time. Each additional vCPU adds 8GB of RAM to your instance. Storage can only be increased, not decreased. For smaller storage needs, create a new instance and transfer your files. ### View Instance Status List all instances and details including `instance_ID`, `IP Address`, `Disk Size`, `GPU Type`, `GPU Count`, `vCPU Count`, `RAM`, and `Template`: ``` tnr status ``` use the `--no-wait` flag to disable automatic monitoring for status updates # Compatibility Source: https://www.thundercompute.com/docs/compatibility Learn about Thunder Compute's technical specs, supported AI/ML libraries (PyTorch, Hugging Face), limitations, and strengths ## Use cases Thunder Compute is optimized for AI/ML development workflows. That said, Thunder Compute has the full functionality of an EC2-style on-demand GPU cloud instance. ## CUDA versioning * CUDA version 12.0 or greater * CUDNN version 9.0 or greater Do not attempt to reinstall CUDA. If it seems like you need an older CUDA driver, you almost always are better off upgrading your other dependencies (e.g., PyTorch) ## Officially supported libraries The following libraries and tools are thoroughly tested: * PyTorch * Notebooks * AI model serving tools like ComfyUI, Ollama, VLLM, Unsloth, and more Note: make sure you install the cuda-compatible version of these libraries. The cuda-compatible PyTorch binary and latest CUDA drivers are pre-installed on every Thunder Compute instance. ## Pre-installed libraries * CUDA toolkit * Docker (see [Docker on Thunder Compute](/guides/using-docker-on-thundercompute)) * PyTorch (and derivatives), Numpy, Pandas * Jupyterlab ## Technical specs * Egress/Ingress: 7Gbps * IP: dynamic * Location: U.S. (region varies) * E series CPU instances in Azure ## Experimental (less stable) The following workloads are less tested, experimental, or unstable: * Tensorflow \[experimental] * PyTorch Lightning \[experimental] * Jax \[experimental] * Custom CUDA Kernels \[unpredictable behavior, particularly with errors and profiling. Message us for details] ## Unsupported Currently, Thunder Compute lacks official support for graphics workloads such as OpenGL, Vulkan, and FFMPEG. If you'd like to run these, contact us. ## Cryptocurrency mining Mining, staking, or otherwise interacting with cryptocurrency is strictly prohibited on Thunder Compute. If cryptocurrency-related activity is detected, the associated account is immediately banned from Thunder Compute and any billing credit is revoked. The account is then billed for the full amount of usage. ## Geographic availability Thunder Compute is only available for B2B customers, i.e., requires a VAT ID (or similar) in the following countries: * United Arab Emirates * Angola * Bahrain * Brazil * Switzerland * Côte d’Ivoire (Ivory Coast) * Colombia * Algeria * Georgia * Iraq * Jordan * Kazakhstan * South Korea (Republic of Korea) * Kuwait * Morocco * North Macedonia * Oman * Paraguay * Qatar * Saudi Arabia * Tunisia * Turkey (Türkiye) * Tanzania * Ukraine * Uganda * Uzbekistan * Yemen * India * Moldova (Republic of Moldova) Thunder Compute is not currently available in the following countries: * Belarus * China * Cuba * Indonesia * Iran * Kenya * North Korea * Malaysia * Mexico * Nigeria * Russia * Sudan * Syria * Uruguay If you're located in one of these countries and need access to Thunder Compute, please contact us to discuss potential alternatives. ## Miscellaneous tips We use a new kind of virtualization to maximize GPU utilization, reducing your cost. To learn more about how this works, check out this [blog post](https://www.thundercompute.com/blog/how-thunder-compute-works-gpu-over-tcp). If you encounter any strange issues or errors, please check our [troubleshooting guide](/docs/troubleshooting) or contact us. ## Recommended Guides To help you get started with Thunder Compute, we recommend checking out these guides: * [Running Jupyter Notebooks](/guides/running-jupyter-notebooks-on-thunder-compute) - Use Jupyter for interactive development * [Using Instance Templates](/guides/using-instance-templates) - Get started quickly with pre-configured environments # Run DeepSeek R1 Affordably Source: https://www.thundercompute.com/docs/guides/deepseek-r1-running-locally-on-thunder-compute Run DeepSeek R1 affordably on Thunder Compute. This guide shows how to set up an A100 GPU instance and use Ollama for cost-effective model deployment. # Cheapest Way to Run DeepSeek R1 on Thunder Compute Looking for the **cheapest way to run DeepSeek R1** or just want to **try DeepSeek R1** without buying hardware? Thunder Compute lets you spin up pay‑per‑minute A100 GPUs so you only pay for the time you use. Follow the steps below to get the model running in minutes. > **Quick reminder:** Make sure your Thunder Compute account is set up. If not, start with our [Quickstart Guide](/quickstart). If you prefer video instructions, watch this overview: