B300
coming soon.
Blackwell Ultra with up to 288 GB of HBM3e at 8 TB/s, 1.5× Blackwell's dense FP4 compute and 2× its attention performance, for reasoning-model inference and large-scale training.
Not available to rent yet
What the B300
is built for.
Tensor-core precisions: NVFP4, FP6, FP8, BF16, FP16 and TF32.
Best at
- Reasoning-model inference with long contexts
- Large MoE models on fewer GPUs
- FP4 and FP8 training and inference
- Multi-tenant serving with MIG
Coming soon
The B300 is not on sale yet. Tell us what you would run on it and we will let you know when it launches.
Get notifiedWill my model fit
on a B300?
Rules of thumb for weights plus a modest KV cache or optimizer state. Longer contexts and bigger batches need more.
| Workload | Needs | On a B300 |
|---|---|---|
| Llama 3.1 8B · FP16 inference | ~18 GB | Fits |
| Qwen 32B · FP8 inference | ~36 GB | Fits |
| Llama 70B · FP8 inference | ~78 GB | Fits |
| Llama 70B · FP16 inference | ~140 GB | Fits |
| Llama 8B · full fine-tune (BF16) | ~70 GB | Fits |
| 70B · QLoRA fine-tune | ~48 GB | Fits |
| Flux.1 [dev] · BF16 | ~33 GB | Fits |
| Llama 405B · FP8 inference | ~410 GB | Too big |
Not the right fit?
Compare the fleet.
These are on sale now, billed by the minute with no contract.
The B300
is coming soon.
Tell us what you would run on it and we'll let you know when it launches.
Get notified
