GPU instances
Long-lived GPU instances for developers building AI
$ tnr create --gpu a100
✓ Instance 0 created
$ tnr connect 0
✓ Connected to instance 0
ubuntu@instance-0:~$ nvidia-smi -L
GPU 0: NVIDIA A100 80GB PCIe
GPU instances for developers. Full Ubuntu sandboxes for agents running ML experiments, CUDA code, and other GPU workloads.
Instances for hands-on development and sandboxes for RL environments and evals at scale
Long-lived GPU instances for developers building AI
$ tnr create --gpu a100
✓ Instance 0 created
$ tnr connect 0
✓ Connected to instance 0
ubuntu@instance-0:~$ nvidia-smi -L
GPU 0: NVIDIA A100 80GB PCIe
Sandboxes for RL tasks, evals, and CI jobs that need a GPU in isolated Ubuntu VMs.
import thunder_sandbox as thunder
sandbox = thunder.Sandbox.create(
cpu=4, memory=32, storage=50,
gpu_type=thunder.GPUType.H100, gpu_count=1,
timeout=900)
sandbox.wait_until_ready()
process = sandbox.exec("nvidia-smi")
Cost effective GPU sandboxes billed per second for the exact length of your rollouts.
Real quotes from ML engineers and RL researchers building on Thunder Compute
Research and engineering from the team building Thunder Compute.
Pick the form factor that suits your workload
Long-lived GPU servers for developers
Scalable GPU-enabled microVMs for RL environments, evals, and CI/CD