Next in Tech| 177: Ep. 177 - Datacenters and AI

Generative AI is having far reaching impacts on datacenters and new data shedding light on the nature and extent of the impacts. Analysts Melissa Incera and Dan Thompson return to the podcast to dig into the data and discuss the ramifications for enterprises, datacenter builders and operators and those putting AI to work with host Eric Hanselman. The computational requirements of generative AI are unique, taking demands similar to high performance computing or cryptomining and spreading them across a vast new community of users. The demands for GPU-based capacity are consuming more power, sometimes with order of magnitude increases. It’s also driving retrofitting of existing datacenters. The need for higher capacity and innovations like liquid cooling are causing a new surge. We’re at the beginning of the shift from a focus on model training to greater amounts of inferencing, changing where capacity is needed.
Looking at money flows in this market offers additional nuance. Investments in AI startups have been massive. Capital investments from hyperscalers in their own infrastructure is also massive, but it remains to be seen if they’ll pay off in equivalent amounts of revenue. Is all of this sustainable? It’s an complicated question in the many aspects of the word.
Host: Eric Hanselman (www.spglobal.c...)
Guests:
Melissa Incera (www.spglobal.c...)
Dan Thompson (www.spglobal.c...)
Links to show content:
Webinar replay (registration required) (www.spglobal.c...)
For 451 Research clients:
clients.451res... (nam11.safelink...)
clients.451res... (nam11.safelink...)
451 Research commissioned report highlights:
Full report (registration required) (nam11.safelink...)
Episode link: play.headliner...