GPU comparison

A40 vs RTX 4060

Specifications and current cloud pricing, side by side.

AmperevsAda LovelaceUpdated 31 days ago

The A40 wins for the most common use case of LLM inference because its 48 GB VRAM and 696 GB/s bandwidth exceed the corresponding 8 to 16 GB and 272 GB/s values on the RTX 4060 while delivering 37.4 TFLOPS FP32.

A40 listed from $0.52/GPU/hrRTX 4060 listed from $0.15/GPU/hr

Right now, from live stock

Specifications Compared

SpecA40RTX 4060
TDP300W115W
VRAM48 GB8-16 GB
CUDA Cores10,7523,072
Memory TypeGDDR6GDDR6
ArchitectureAmpereAda Lovelace
FP16 (dense)149.7 TFLOPSNot published
Form FactorsPCIePCIe
INT8 (dense)299.3 TOPSNot published
InterconnectNVLink, PCIe 4.0PCIe 4.0
Tensor Cores33696
FP32 Performance37.4 TFLOPS15.1 TFLOPS
Memory Bandwidth696 GB/s272 GB/s
FP8 (with sparsity)Not published242 TFLOPS
FP16 (with sparsity)299.4 TFLOPSNot published
INT8 (with sparsity)598.6 TOPSNot published

Performance Analysis

FP16 dense performance reaches 149.7 TFLOPS on the A40 while the RTX 4060 leaves FP16 unpublished. The FP32 delta of 37.4 TFLOPS versus 15.1 TFLOPS shows the A40 supplies more than double the single precision throughput for training phases that rely on dense calculations. Memory bandwidth of 696 GB/s versus 272 GB/s permits the A40 to sustain larger batch sizes by accelerating data transfers during both training and inference steps. FP16 with sparsity attains 299.4 TFLOPS on the A40. The RTX 4060 lists FP8 with sparsity at 242 TFLOPS. These labeled figures indicate where dense versus sparsity modes affect execution speed in model pipelines.

Current On-Demand Offers

Cheapest secure on-demand offer per provider that is reported in stock right now, per GPU per hour; multi-GPU instances show the whole-instance price alongside. Deploy opens the DeployGPU console for providers on the platform, otherwise the provider's own site. Stock is rechecked every minute.

A40

ProviderRegionGPUsPer GPU / hrInstance / hrDeploy
LeaderGPUThe Netherlands8$0.52$4.13Deploy
RunPodglobal1$0.59—Deploy

2 providers in stock, 2 offers. All A40 offers, price history and alerts

RTX 4060

RTX 4060 is not offered on-demand by any provider we track right now. See the RTX 4060 rental page for last-seen listed prices and a price alert.

Which GPU to watchWatch the price of

Notify me when A40 drops below a price

One email when the cheapest in-stock on-demand price per GPU-hour falls below your threshold. Cheapest right now: $0.52/GPU-hr.

QuantaCloud

Comparing providers? We broker across all of them.

Stop tab-switching between pricing pages. Tell us what you need, 16+ GPUs reserved or cluster capacity, and we return one quote at partner rates within 24 hours.

No waitlist24hr quote turnaroundInfiniBand fabric

Compare real-time pricing across 25+ providers

When to Choose the A40

The A40 fits use cases that demand 48 GB VRAM capacity together with 696 GB/s bandwidth for large data movement. Its 149.7 TFLOPS FP16 dense rating supports extended training runs that exceed the limits of the RTX 4060 configuration.

When to Choose the RTX 4060

The RTX 4060 aligns with power limited setups through its 115 W TDP rating against the 300 W of the A40. Its 15.1 TFLOPS FP32 performance meets lighter inference tasks where 8 to 16 GB VRAM suffices.

Use Cases

LLM Training
A40

The A40 provides 48 GB VRAM and 149.7 TFLOPS FP16 dense which exceed the RTX 4060 limits.

LLM Inference
A40

The A40 supplies 696 GB/s bandwidth and 48 GB VRAM that enable larger batch handling than the RTX 4060.

Fine-tuning
A40

The A40 delivers 299.4 TFLOPS FP16 with sparsity for efficient parameter updates beyond RTX 4060 capacity.

Stable Diffusion
RTX 4060

The RTX 4060 operates at 115 W TDP with sufficient 8 to 16 GB VRAM for image generation workloads.

Scientific Computing
A40

The A40 offers 37.4 TFLOPS FP32 and 696 GB/s bandwidth suited to compute intensive simulations.

Frequently Asked Questions

What is the memory bandwidth of the A40 versus the RTX 4060?▾

Memory bandwidth measures 696 GB/s on the A40 and 272 GB/s on the RTX 4060.

Which GPU has higher FP32 performance?▾

The A40 reaches 37.4 TFLOPS FP32 while the RTX 4060 reaches 15.1 TFLOPS FP32.

What TDP ratings apply to the A40 and RTX 4060?▾

The A40 carries a 300 W TDP rating and the RTX 4060 carries a 115 W TDP rating.

Does the A40 support NVLink?▾

The A40 includes NVLink interconnect while the RTX 4060 supports only PCIe 4.0.

What FP16 figures are published for each GPU?▾

The A40 lists 149.7 TFLOPS FP16 dense and 299.4 TFLOPS FP16 with sparsity while the RTX 4060 leaves FP16 unpublished.

Which is cheaper to rent, the A40 or the RTX 4060?▾

Cloud rental prices for both the A40 and RTX 4060 vary by provider, configuration, and availability. This page shows live pricing from 25+ providers updated every 60 seconds. Scroll to the Live Cloud Pricing section to compare current rates.

How much VRAM does the A40 have compared to the RTX 4060?▾

The A40 has 48 GB of GDDR6 memory. The RTX 4060 has 8 to 16 GB of GDDR6 memory.

Can I find A40 and RTX 4060 GPUs available to rent right now?▾

Yes. This page shows real-time availability across 25+ cloud GPU providers. The Live Cloud Pricing section displays only in-stock offers with current pricing.

What is the main difference between the A40 and the RTX 4060?▾

The A40 uses the Ampere architecture (2020) while the RTX 4060 uses Ada Lovelace (2023). The A40 has 48 GB of GDDR6 at 696 GB/s; the RTX 4060 has 8-16 GB of GDDR6 at 272 GB/s, so the A40 has 2.6x the memory bandwidth of the RTX 4060.

Rent these GPUs

Each GPU page lists every current on-demand offer by provider, per GPU-hour, updated every minute.

Related comparisons

How this page is made

  • Specifications come from the NVIDIA, AMD and Intel datasheets for the A40 and the RTX 4060. Dense and sparse throughput are listed separately.
  • Prices and availability are live: every offer shown is an in-stock, on-demand listing from a provider we track, rechecked every minute.
  • The written comparison (overview, performance notes, when to choose each card, verdict, use cases and FAQ) was drafted with an AI model from the specification table above and passed an automated check that rejects any figure not in that table. It was last generated on . It contains no prices; those are always read live.
  • Read how we collect the data, or report an error on this page.

Next steps