Google Says its AI Supercomputer Is Faster, Greener than Nvidia A100 Chip

The Google logo is displayed at their offices on Nov. 1, 2018, in Granary Square, in London. (AP)
The Google logo is displayed at their offices on Nov. 1, 2018, in Granary Square, in London. (AP)
TT
20

Google Says its AI Supercomputer Is Faster, Greener than Nvidia A100 Chip

The Google logo is displayed at their offices on Nov. 1, 2018, in Granary Square, in London. (AP)
The Google logo is displayed at their offices on Nov. 1, 2018, in Granary Square, in London. (AP)

Alphabet Inc's Google released on Tuesday new details about the supercomputers it uses to train its artificial intelligence models, saying the systems are both faster and more power-efficient than comparable systems from Nvidia Corp.

Google has designed its own custom chip called the Tensor Processing Unit, or TPU. It uses those chips for more than 90% of the company's work on artificial intelligence training, the process of feeding data through models to make them useful at tasks such as responding to queries with human-like text or generating images.

The Google TPU is now in its fourth generation. Google on Tuesday published a scientific paper detailing how it has strung more than 4,000 of the chips together into a supercomputer using its own custom-developed optical switches to help connect individual machines.

Improving these connections has become a key point of competition among companies that build AI supercomputers because so-called large language models that power technologies like Google's Bard or OpenAI's ChatGPT have exploded in size, meaning they are far too large to store on a single chip.

The models must instead be split across thousands of chips, which must then work together for weeks or more to train the model. Google's PaLM model - its largest publicly disclosed language model to date - was trained by splitting it across two of the 4,000-chip supercomputers over 50 days.

Google said its supercomputers make it easy to reconfigure connections between chips on the fly, helping avoid problems and tweak for performance gains.

"Circuit switching makes it easy to route around failed components," Google Fellow Norm Jouppi and Google Distinguished Engineer David Patterson wrote in a blog post about the system. "This flexibility even allows us to change the topology of the supercomputer interconnect to accelerate the performance of an ML (machine learning) model."

While Google is only now releasing details about its supercomputer, it has been online inside the company since 2020 in a data center in Mayes County, Oklahoma. Google said that startup Midjourney used the system to train its model, which generates fresh images after being fed a few words of text.

In the paper, Google said that for comparably sized systems, its chips are up to 1.7 times faster and 1.9 times more power-efficient than a system based on Nvidia's A100 chip that was on the market at the same time as the fourth-generation TPU.

A Nvidia spokesperson declined to comment.

Google said it did not compare its fourth-generation to Nvidia's current flagship H100 chip because the H100 came to the market after Google's chip and is made with newer technology.

Google hinted that it might be working on a new TPU that would compete with the Nvidia H100 but provided no details, with Jouppi telling Reuters that Google has "a healthy pipeline of future chips."



Trump Offers Support to Musk's Car Company in a Surprising Post as Tesla Stock Plunges

Mar 22, 2025; Philadelphia, PA, USA; Elon Musk and President Donald Trump during the Division I Men's Wrestling Championship held at Wells Fargo Center. Mandatory Credit: Eric Hartline-Imagn Images/File Photo
Mar 22, 2025; Philadelphia, PA, USA; Elon Musk and President Donald Trump during the Division I Men's Wrestling Championship held at Wells Fargo Center. Mandatory Credit: Eric Hartline-Imagn Images/File Photo
TT
20

Trump Offers Support to Musk's Car Company in a Surprising Post as Tesla Stock Plunges

Mar 22, 2025; Philadelphia, PA, USA; Elon Musk and President Donald Trump during the Division I Men's Wrestling Championship held at Wells Fargo Center. Mandatory Credit: Eric Hartline-Imagn Images/File Photo
Mar 22, 2025; Philadelphia, PA, USA; Elon Musk and President Donald Trump during the Division I Men's Wrestling Championship held at Wells Fargo Center. Mandatory Credit: Eric Hartline-Imagn Images/File Photo

President Donald Trump took to social media Thursday morning to support Elon Musk's car company, a startling development given their bitter public feud.

”I want Elon, and all businesses within our Country, to THRIVE,” Trump wrote on Truth Social, Reuters reported.

The post wasn't enough to help Tesla's stock, which fell sharply after the company reported another quarter of lackluster financial results and Musk warned of some potentially “rough quarters” into next year. At midday, the stock was down around 9%.

Late Wednesday, Tesla said revenue fell 12% and profit dropped 16% in the April-June quarter. Many prospective buyers have been turned off by Musk’s foray into right-wing politics, and the competition has ramped up in key markets such as Europe and China.

Investors have been unnerved by Musk's social media spat with the president because Trump has threatened to retaliate by ending government contracts and breaks for Musk's various businesses, including Tesla.

But Trump struck a starkly different tone Thursday morning.

“Everyone is stating that I will destroy Elon’s companies by taking away some, if not all, of the large scale subsidies he receives from the US Government. This is not so!" Trump wrote. “The better they do, the better the USA does, and that’s good for all of us.”

After Trump's massive budget bill passed earlier this month, Tesla faces the loss of the $7,500 EV tax credit and stands to make much less money from selling regulatory credits to other automakers. Trump’s tariffs on countries including China and Mexico will also cost Tesla hundreds of millions of dollars, the company said on its earnings call.

Musk has blasted the budget bill on his own social media platform X for adding to US debt at a time when it is already too large. The Tesla CEO has called the budget pushed by the president a “disgusting abomination” and has threatened to form a new political party.

On Wednesday's call, Musk said the electric vehicle maker will face “a few rough quarters” as it moves into a future focused less on selling cars and more on offering people rides in self-driving cars. He also talked up the company's business making humanoid robotics. But he acknowledged those businesses are a ways off from contributing to Tesla’s bottom line.

Tesla began a rollout in June of its paid robotaxi service in Austin, Texas, and hopes to introduce the driverless cabs in several other cities soon. Musk told analysts that the service will be available to probably “half of the population of the US by the end of the year — that’s at least our goal, subject to regulatory approvals.”

“We’re in this weird transition period where we’ll lose a lot of incentives in the US,” Musk said, adding that Tesla “probably could have a few rough quarters” ahead. He added, though, “Once you get to autonomy at scale in the second half of next year, certainly by the end of next year, I would be surprised if Tesla’s economics are not very compelling.”