Your model needs NVLink but your budget does not allow CoreWeave's 8-GPU minimum or AWS rates. This guide shows when PCIe works, when it does not, and how to access NVLink from $3.75/hr.
NVLink vs PCIe: NVLink 4.0 on the H100 SXM delivers 900 GB/s of bidirectional GPU-to-GPU bandwidth. PCIe 5.0 x16, the fastest CPU-to-GPU interface available today, tops out at 128 GB/s. That is a 7x gap with a direct cost consequence for solo developers scaling past a single GPU.
Key takeaways
The NVLink vs PCIe question comes up every time a solo developer, indie hacker, or small team tries to scale past a single GPU. Both are interconnects. Both move data. But they solve different problems at very different speeds, and the wrong choice shows up as GPU utilisation stuck at 60% and training jobs that refuse to scale linearly.
If you are building something cost-sensitive, the good news is that NVLink is no longer gated behind enterprise contracts or 8-GPU minimums. This post covers exactly when you need it, when you do not, and what it costs today.
The fundamental difference between NVLink and PCIe is not architecture, it is bandwidth per GPU. NVLink is a dedicated GPU-to-GPU fabric. PCIe is a general-purpose CPU-to-peripheral bus that happens to connect GPUs.
900 GB/s
NVLink 4.0 per GPU
(H100/H200)
1.8 TB/s
NVLink 5.0 per GPU
(B200)
128 GB/s
PCIe 5.0 x16 max
64 GB/s
PCIe 4.0 x16 max
| GPU | Interconnect | BW / GPU | vs PCIe 5.0 | packet.ai price |
|---|---|---|---|---|
| A100 80GB SXM | NVLink 3.0 | 600 GB/s | 4.7x | $1.43/hr (live) |
| H100 SXM | NVLink 4.0 | 900 GB/s | 7x | Launching Soon (waitlist) |
| H200 SXM | NVLink 4.0 | 900 GB/s | 7x | Launching Soon (waitlist) |
| B200 SXM | NVLink 5.0 | 1,800 GB/s | 14x | $3.75/hr (live) |
| PCIe 4.0 GPU | PCIe 4.0 x16 | 64 GB/s | 0.5x | N/A |
| PCIe 5.0 GPU | PCIe 5.0 x16 | 128 GB/s | 1x (baseline) | N/A |
Source: NVIDIA official datasheets. PCIe per PCI-SIG spec. packet.ai prices verified August 2026. H100 and H200 SXM on waitlist. B200 and A100 available on-demand.
Interconnect bandwidth only matters when GPUs are talking to each other. The amount of communication depends entirely on the parallelism strategy your job uses. For most solo developers running models under 70B parameters, PCIe is completely sufficient.
PCIe is sufficient
NVLink required
| Model Size | Example | Parallelism Strategy | Interconnect Needed | Recommended GPU |
|---|---|---|---|---|
| 7B-13B | Llama 3.1 8B, Mistral 7B | Single GPU | PCIe fine | A100 $1.43/hr (live) |
| 34B-70B | Llama 3.1 70B, Qwen 72B | Tensor Parallel (2-4 GPU) | NVLink required | H200 SXM (waitlist) |
| 405B | Llama 3.1 405B | Tensor Parallel (8 GPU) | NVLink required | B200 $3.75/hr (live) |
| 1T+ | Frontier / pretraining | 3D Parallel + InfiniBand | NVLink + IB | GPU Clusters (quote) |
In tensor parallelism, a single matrix multiplication is split across multiple GPUs. Each GPU processes its shard of the weight matrix, then every GPU must synchronize results using an AllReduce collective before the next transformer layer begins. This happens after every single layer in the model.
A 70B parameter model running at BF16 has 140 GB of weights and typically 80+ transformer layers. Each AllReduce call moves a volume of data proportional to the activation tensor size across all GPUs simultaneously. On a PCIe cluster, those calls queue behind the shared 128 GB/s ceiling. On an NVLink cluster with NVSwitch, every GPU pair communicates at full 900 GB/s simultaneously, and gradient synchronization across eight GPUs takes roughly the same time regardless of which GPUs are communicating.
NVLink-connected clusters with NVSwitch achieve 92-96% linear scaling for data-parallel training. PCIe Gen5 clusters reach 80-88%, and PCIe Gen4 clusters 70-80%. That gap compounds at every additional GPU added to the cluster.
Pipeline parallelism as a PCIe workaround
If NVLink is unavailable, pipeline parallelism splits the model sequentially across GPUs rather than sharding each layer. This requires far less inter-GPU bandwidth. The tradeoff is pipeline bubbles: idle GPU time between micro-batches. For latency-sensitive workloads, this is a real cost. See packet.ai multi-node GPU cluster training guide for how this changes once you scale beyond a single node.
NVLink C2C (chip-to-chip) is a separate variant of NVLink used to connect a GPU die directly to a CPU die on the same package. The GB200 Grace Blackwell Superchip uses NVLink C2C at 900 GB/s to connect two B200 GPU dies and one Grace CPU in a memory-coherent superchip. This differs from the NVLink 5.0 fabric used for GPU-to-GPU communication between separate GPUs in a cluster.
In a GB200 NVL72 rack, 72 B200 GPUs operate as a single logical unit with 13.5 TB of unified HBM3e memory. The GPU-to-GPU bandwidth via NVLink 5.0 is 1.8 TB/s per GPU, and the full-rack NVLink fabric delivers 130 TB/s aggregate. This makes multi-GPU tensor parallelism for frontier models (405B+ parameters) feasible without pipeline bubbles or PCIe constraints.
The B200's NVLink 5.0 runs at 1.8 TB/s per GPU, doubling the H100's NVLink 4.0 bandwidth, placing the interconnect gap over PCIe 5.0 at approximately 14x. For 8-GPU HGX B200 clusters, total NVLink fabric bandwidth reaches 14.4 TB/s.
For teams renting B200 clusters today, packet.ai B200 SXM is available on-demand from $3.75/hr - NVLink 5.0 fabric included, no waitlist, single GPU access. For a full cost breakdown, see the B200 GPU cloud pricing guide.
NVLink was once gated behind enterprise contracts and 8-GPU cluster minimums. That has changed. For solo developers and small teams, the key variable is not whether you can access NVLink, it is which provider gives you the lowest on-demand hourly rate without a commitment requirement.
| Provider | B200 on-demand / GPU-hr | Min GPUs | Contract required | Monthly (1 GPU, 24/7) |
|---|---|---|---|---|
| packet.ai | $3.75 | 1 GPU | None | ~$2,728 |
| Lambda Labs | $6.99 | 1 GPU | None | ~$5,087 |
| RunPod | $5.89 | 1 GPU | None | ~$4,285 |
| CoreWeave | $8.60+ (8-GPU min) | 8 GPUs | Yes (sales process) | ~$50,000+ |
| AWS p6 | $14.24 | 8 GPUs | No (on-demand) | ~$10,395 |
Prices verified August 2026. CoreWeave and AWS require 8-GPU cluster minimums. packet.ai, Lambda, and RunPod offer single-GPU access. Monthly figures assume 24/7 continuous operation at the listed on-demand rate.
packet.ai B200 at $3.75/hr is the lowest published on-demand NVLink rate in 2026, 46% below Lambda, 36% below RunPod, and 74% below AWS p6 for identical silicon. One B200 running continuously costs about $2,728/month on packet.ai versus $10,395/month on AWS. For a breakdown of cost-per-token economics at this price point, see the LLM inference cost guide.
Run through these three questions before choosing a GPU configuration. For model-specific VRAM sizing, see the VRAM requirements guide first.
Does your model fit on a single GPU at inference precision?
If yes (13B at FP16 fits on a single A100 80 GB), PCIe is fine and the A100 at $1.43/hr is the cost-efficient choice. Interconnect is irrelevant when you are not crossing GPU boundaries. Most solo developer workloads on 7B-13B models stay here.
Are you using tensor parallelism or sharding across GPUs?
If yes, you need NVLink. Tensor parallelism (TP) generates AllReduce calls after every transformer layer. On 4+ GPUs running TP, PCIe Gen5 at 128 GB/s becomes the hard ceiling within the first few layers of a 70B model. See how NVLink 4.0 changes the cost equation for multi-GPU workloads.
Do you need NVLink access without a contract or cluster minimum?
Most NVLink GPU providers require an 8-GPU cluster (CoreWeave) or a sales engagement. packet.ai lets you rent a single B200 SXM on-demand from $3.75/hr, self-serve, in under 5 minutes. No cluster minimum. No sales call. For solo developers and small teams, this is the fastest and cheapest path to NVLink today.
H100 SXM5 GPUs with NVLink 4.0 deliver up to 2.6x faster LLM inference than H100 PCIe variants in multi-GPU configurations, according to data from GPU cloud providers running equivalent workloads on both form factors.
Availability on packet.ai today
B200 SXM on-demand from $3.75/hr - the only live NVLink GPU on packet.ai, no waitlist, single-GPU access. H100 SXM (Launching Soon) and H200 SXM (Launching Soon) are on the waitlist. A100 80GB is live at $1.43/hr. Not ready to manage GPUs yet? See packet.ai Token Factory for a managed inference API on the same hardware. Join the H100 SXM waitlist here.
If you are a solo developer or small team running 70B+ models with tensor parallelism in PyTorch or vLLM, the SXM form factor with NVLink is the correct choice. On packet.ai today: rent the B200 SXM from $3.75/hr per GPU - no contracts, no cluster minimums, deploy in under 5 minutes.
Last reviewed: 2026-08-03. Prices verified against packet.ai live product pages. B200 SXM on-demand from $3.75/hr - no contracts, 1 GPU minimum, deploy in 5 minutes. H100 SXM and H200 SXM on waitlist. See full pricing page for all GPU tiers.
Same models. Same API. Fraction of the cost. Start free — no credit card required.
Start Building →
