Are GPU Compute Networks Supply or Demand Constrained?

  • Pro

Primer

GPU compute networks like Render and Akash are two-sided markets consisting of a supply of physical compute resources and demand-side users who consume the compute resources. To grow, the networks need to scale the demand from paying users as well as the supply of compute resources to attract and service customers. In practice, it is a bit of a chicken-and-egg-type problem, where suppliers need revenue to incentivize them to join, while at the same time, the demand side needs enough compute suppliers to handle their jobs.

In practice, growth comes in oscillating spurts of both demand and supply growth. And, one can assess the current state of compute networks and hypothesize whether the networks are waiting for demand growth or supply growth. Put another way, are the growth constraints for compute networks currently on the supply side or the demand side?

To give a sense of the current state of compute networks, Akash has nearly 1,200 open resource leases (demand) across 4,000 CPUs and 66 GPUs (supply). That represents a roughly 40% utilization rate of the 10,000 CPUs and 170 GPUs supplied to the network. More granularly, for highly demanded AI-focused A100 GPUs, Akash has nearly 100% utilization across 22 GPUs.

Akash Network stats

Across other GPU markets like Render, Nosana, and Livepeer, there are similar levels of lagging supply. Render is one of the largest with over 3,000 GPUs while Livepeer has an estimated 400 of weaker GPUs for transcoding and Nosana has over 60 GPUs specific for AI inference tasks.

Analyst Thoughts

Let us know what you loved about the report, what may be missing, or share any other feedback by filling out this short form. All responses are subject to our Privacy Policy and Terms of Service.
Get an edge with
Blockworks Intel
Upgrade For $4,500/Yr
Upgrade to unlock 300+ industry leading reports from our researchers, including: