Cloud Compute โ˜๏ธ, Energy โšก and Cost ๐Ÿ’ฒ - Comparison Tool

In order to do our analysis, we gathered data from 5 major cloud compute providers โ€“ Microsoft Azure, Amazon Web Services, Google Cloud Platform, Scaleway Cloud, and OVH Cloud โ€“ about the price and nature of their AI-specific compute offerings (i.e. all instances that have GPUs). For each instance, we looked at its characteristics โ€“ the type and number of GPUs and CPUs that it contains, as well as the quantity of memory it contains and its storage capacity. For each CPU and GPU model, we looked up its TDP (Thermal Design Potential) -- its power consumption under the maximum theoretical load), which is an indicator of the operating expenses required to power it. For GPUs specifically, we also looked at the Manufacturer's Suggested Retail Price (MSRP), i.e. how much that particular GPU model cost at the time of its launch, as an indicator of the capital expenditure required for the compute provider to buy the GPUs to begin with.

Energy โšก vs Hourly Cost ๐Ÿ’ฒ

In our analysis, we found that there is also a strong positive correlation between the two factors, across different compute providers:

Double click the names of cloud providers to see the trend per company

Double click the names of GPU models to see the trends per GPU

CapEx ๐Ÿ’ฐ vs Hourly Cost ๐Ÿ’ฒ

We also found that there is also a strong positive correlation the initial cost of the GPU and its cost per hour:

Double click the names of cloud providers to see the trend per company

Double click the names of GPU models to see the trends per GPU

Generate your own plot ๐Ÿ“ˆ

X axis

Pick a characteristic to plot on the X (horizontal) axis

Y axis

Pick a characteristic to plot on the Y (vertical) axis

Plot color

Pick a characteristic for the colors/labels

Plot the X (horizontal) axis in logarithmic scale

Plot the Y (vertical) axis in logarithmic scale

Choose from the dropdown lists on the left to plot different characteristics and find new trends ๐Ÿ•ต๐Ÿปโ€โ™‚๏ธ

N.B. Not all combinations are possible -- if you get a blank figure, try another combination!