Image
Image

By Don Yocham, CFA

Posted: January 8, 2025

Getting AI to Hyperscale

I’ve often discussed with you the bottlenecks that tech companies must clear to fulfill their AI dreams.

The most immediate hurdle to growth is supplying power to energy-intensive models. Clearing this hurdle requires new transmission lines, building traditional natural gas-fired power plants on site, and going nuclear.

Sufficient data to train models has rapidly become another near-term growth limiter. AI needs human-generated data to train models. However, AI-generated content already exceeds 57% of all internet content, and that flood of AI data makes it exceedingly expensive to train new models.

For instance, the earliest public version of ChatGPT (GPT-3) cost between $5 and $10 million to train, while GPT-4 exceeded $100 million.

The cost of training the next model upgrade, codenamed GPT-5 Orion, has exceeded half a billion dollars. It is months behind schedule and still not ready for release.

These obstacles will not deter Big Tech, however. In fact, they’re going bigger as they shift from large-scale data centers to hyperscale.

AI capital budgets surged from an annual rate of $80 billion early last year to $200 billion by the third quarter and will likely approach $300 billion later this year.

But this hyperscaling— packing as many chips as closely as possible—exposes yet another bottleneck to AI growth.

And busting through that limit means massive profits for one company in particular.

Back-End Connections

As AI chip clusters grow, the connections between chips grow exponentially.

A 25,000-chip cluster requires 75,000 connections, or 3 times as many connections as chips.

Increase the number of chips in a cluster to 1,000,000—this won’t happen within the next year, but they will get there—and the number of connections leaps to 10,000,000 (or 10 times as many connections as chips).

The network of connections becomes massive, thereby driving demand for networking chips that ensure all those Nivida Blackwell chips—at $70,000 each—never sit idle.

And that’s where Arista Networks (NYSE: ANET) comes in.

It’s a strong competitor in the space, generating an 18% increase in sales, while the average communications equipment company has seen sales decline 2.3% over the past year.

It also boasts fat operating profit margins of 35% compared to its sub-industry.

But, as is always the case, sales and operating profits mean nothing when a company can’t also outperform the capital it used to generate them.

And that’s where Arista Networks shines.

Competitive profits, or the amount by which operating profits exceed capital costs, drive stock prices higher over time. And doing so consistently at an increasing rate creates the ultimate boost.

Over the last several quarters, Arista’s management has increased competitive profits from 26% of sales to 31%. Meanwhile, the losses have piled up for its competitors.

That widening advantage is partly due to declining competitor sales. However, a more significant driver of the diverging profitability is that the competition has invested heavily in catching up.

They just can’t make those investments pay.

I’ll break down more of the fundamentals driving Arista’s outperformance in my following Capital InFocus report.

You’ll have it by Friday. So keep an eye on your inbox.

Until then,

Think Free. Be Free.

Don Yocham, CFA

Managing Editor of The Capital List

Related ARTICLES:

Image

Getting AI to Hyperscale


By Don Yocham

Posted: January 8, 2025

I’ve often discussed with you the bottlenecks that tech companies must clear to fulfill their AI dreams. The most immediate hurdle to growth is...

Image

Trump’s Tariff Threats and Inflation


By Don Yocham

Posted: January 5, 2025

Welcome to 2025. Hopes run high among investors that two years of 20%-plus gains for the S&P will lead to a third. And with...

Image

Market on Fire and What to Look for in 2025


By Don Yocham

Posted: January 3, 2025

Happy New Year. 2024 is now in the rear-view mirror. And what a year it was. For starters, we turned a sharp corner politically...

Image

AI Eating Itself


By Don Yocham

Posted: December 20, 2024

Nothing goes up in a straight line forever. Every trend, process, or dynamic has limits. They encounter negative feedback loops that send them running...

Image

Tesla: The Ultimate Trump Trade


By Don Yocham

Posted: December 16, 2024

“Trump trades” are all the rage right now. But that trade isn’t really “this stock” or “that stock.” It’s the whole market. Tax cuts,...

Image

Markets Rising for a Reason


By Don Yocham

Posted: December 13, 2024

Yesterday, I described some factors that could keep this market moving. This economy has so much going on under the hood that even today’s...

Image

Gensliger’s Out


By Don Yocham

Posted: December 5, 2024

I laid out in October the disaster unfolding at Intel Corp (NASDAQ: INTC). The company began losing its competitive edge in 2018 when it...

Image

The Elemental Energy Link


By Don Yocham

Posted: November 21, 2024

Every three days, a new data center opens somewhere in the world—with many classified as hyperscale. These data centers consume massive amounts of energy....

Image

Holding Capital to Account


By Don Yocham

Posted: November 1, 2024

To paraphrase Trump, Big Tech has spent “bigly” on AI data. Microsoft Corp. (NASDAQ: MSFT) invested $20 billion in AI during the latest quarter....

Image

Energy To Ride Out the Storm


By Don Yocham

Posted: October 30, 2024

We will experience a monumental election in just a few days. Despite a strong economy (at least according to the stats), low unemployment, and...

FREE Newsletters:

"*" indicates required fields