NVIDIA Ampere, 80 GB HBM2e, SXM
The NVIDIA A100 80GB is the Ampere-generation flagship GPU with 80 GB of HBM2e memory and 2 TB/s of bandwidth. The industry standard for LLM training and fine-tuning. Runs 30B models at FP16 and supports 70B with tensor parallelism. Available on packet.ai from $1.43/GPU-hour.
Dedicated $1.43/hr · Monthly $940/mo
The A100 combines 80 GB HBM2e with third-generation NVLink for multi-GPU training at scale.
TF32 training and FP16 inference with sparsity. Established as the industry baseline for mixed-precision training.
Enough memory for 7B to 30B models natively. The sweet spot for cost-effective LLM work.
Connect up to 8 GPUs in an HGX node with NVSwitch for distributed training at scale.
Partition a single A100 into up to 7 isolated MIG instances for multi-tenant inference and dev/test.
Dedicated or monthly — plus multi-node clusters.
Full A100 card reserved exclusively for you. Zero noisy-neighbour risk, 99.99% SLA.
Deploy Hourly →Reserved A100 at a flat monthly rate. Full single-tenant isolation, predictable cost.
Deploy Monthly →Scale training across multiple A100 nodes with NVLink and InfiniBand interconnect.
80 GB handles 30B at FP16 natively. Industry-standard toolchain support.
NVLink 3.0 and SXM form factor make A100 clusters the standard for large-scale training.
80 GB HBM2e and MIG support make A100 the flexible choice for serving multiple models.
Ampere flagship — 80 GB HBM2e, 2 TB/s bandwidth, industry standard for LLM training and fine-tuning.
$1.43/GPU-hour dedicated, or $940/month flat rate.
30B at FP16 natively, 70B at 4-bit. For full FP16 70B, use H200 or B200.
H100 SXM is ~3× faster on transformer workloads and supports FP8. A100 is ~28% cheaper and has wider toolchain support.
Yes — up to 7 isolated MIG instances, down to 10 GB each. Great for multi-model inference serving.
SSH-ready in under 5 minutes on Dedicated hourly. Multi-node clusters provision in under 1 hour.
The industry standard for LLM training. From $1.43/hr dedicated or $940/mo flat.
On-demand · hourly billing · EU region (Frankfurt)