META's first-phase AI supercluster of hundreds of thousands of GPUs, targeting roughly 1 million at full scale, shows strong AI execution; its engineering talent and GPU-reliability work could let it sell compute at a premium, and earnings should start showing Muse and this infrastructure making money.
Jump to any passage
Meta and Nvidia just teamed up to build one of the craziest AI supercluster out right now.
earlier today, Meta Platforms did announce their super AI cluster and they already told us that it finished the first phase, which includes hundreds of thousands of GPUs today.
And as we know, Meta is killing it. Meta is killing it with the AI market. I don't know if they're number one, but they're definitely doing amazing with Muse.
What the future target while they didn't give a timeline is expected to reach roughly 1 million distributed GPUs all functioning in lock step. That is at full scale.
Metam was able to share some images. This is the GB200 versus the GB300. So, both of these are already deployed. But what I found pretty interesting was the GP200 was across two rack system. The GP300 was on a one rack solution style.
Now, Meta did talk about their backend aggregation schematic and and this is the image they show. It shows the GPU fabric groups connecting through aggregation nodes and it pretty much just kind of explains the GPU count.
and these are the types of networking solutions that Meta is working with that Nvidia is working with and I'm glad to see some in action right now
The other thing that I thought was pretty cool is meta is a true engineering talent.
Regardless, Meta is trying to improve the reliability of GPUs. if Meta ever wants to sell compute, they can truly get it at a premium rate.
They have 64 active GPUs in this 72 GPU domain and they have eight kind of in in spares. Meta reports goodp put above 85% for Muse 1/3 pre-training and above 90% for its reinforcement learning runs.
Meta did describe power capping, batteries, and liquid cooling as part of the solution.
My biggest win here is though is you're seeing Meta attempting to build a million plus GPU infrastructure data center for the AI market and that gives a lot and a lot of clarity about what the demand looks like for AI solutions.
I am super excited for Meta's earnings because we're going to start to hear eventually of Muse making money for them, of this AI infrastructure making tons and tons of money for them.
Watchpoints
What this channel has said about $META
Jose Najarro Stocks has 12 calls on this stock; only the adjacent ones are shown.