Instance Infrastructure
Hardware Specifications
- GPU Options:
- A6000 48GB (Prototyping only)
- A100 80GB (Both modes)
- H100 80GB (Both modes)
- Memory: 18 vCPUs and 90GB RAM per GPU (Production mode, Prototyping is fully customizable)
- Location: Canada (Quebec)
Pre-installed Software
- CUDA: Version 13.0
- CUDA Driver: Version 580
- PyTorch: Version 2.9.0+cu128
- JupyterLab: Pre-installed
- Additional scientific Python libraries (NumPy, Pandas, etc.)
Do not attempt to reinstall CUDA. If compatibility issues arise, upgrade your other dependencies (e.g., PyTorch) rather than downgrading CUDA.
Networking
- Egress/Ingress: 7 Gbps
- IP Address: Dynamic
Port Access
- Public URLs (CLI): Use
tnr ports forward to expose HTTP services at https://<uuid>-<port>.thundercompute.net with automatic HTTPS and DDoS protection. See Port Forwarding for details.
- Local tunneling (CLI): Use
tnr connect <instance_id> -t <port> to tunnel ports to your local machine
- VS Code: Use the built-in port forwarding feature