Nvidia H100 GPU Rental Rates
NVIDIA H100 GPU rental rates vary significantly between decentralized platforms and traditional cloud providers, with decentralized options generally offering lower prices
123.
Comparative Hourly Rates for NVIDIA H100
As of January 24, 2024, the hourly rental rates for a single NVIDIA H100 GPU across various providers were:
- Lowest Rate (Decentralized): Akash ML and Lambda Cloud both offered the lowest rate at $1.99 per hour 123.
- Higher Rate (Centralized/Hybrid): CoreWeave charged $4.25 per hour 123.
This data highlights that decentralized platforms like Akash ML are positioned as cost-effective alternatives to centralized cloud services
4.
Market Dynamics and Availability
The pricing and availability of high-end GPUs like the H100 are influenced by supply and demand
1.
- Decentralized Supply: Decentralized networks aim to make highly sought-after H100 GPUs more accessible by tapping into idle GPU resources 5. For example, in January 2024, io.net possessed 151 H100 GPUs 6.
- Cost-Effectiveness: Decentralized platforms are disrupting the traditional cloud-computing model by offering lower prices for GPU-intensive tasks like AI and machine learning 2.
- Future Initiatives: There have been initiatives indicated to make H100 and A100 GPUs even more affordable in the near future 5.
Onchain Derivative Market
The rental price of the NVIDIA H100 GPU has also been integrated into decentralized finance (DeFi)
78.
- Onchain Trading: Injective launched the first onchain market for tokenized NVIDIA H100 GPU rental rates, allowing users to trade the hourly cost of accessing H100s directly onchain 78.
- Price Tracking: This market, created in collaboration with Squaretower, uses a decentralized oracle to deliver a price feed that tracks the hourly cost of H100s across top compute providers 8.
- Asset Class: The "Nvidia H100 GPU Rental Rates" are included as a novel asset category in Injective's Real-World Asset (RWA) perpetuals volume 9.