Nvidia Unveils Latest Chips, Technology to Speed up AI Computing

The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
TT

Nvidia Unveils Latest Chips, Technology to Speed up AI Computing

The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)

Nvidia Corp on Tuesday announced several new chips and technologies that it said will boost the computing speed of increasingly complicated artificial intelligence algorithms, stepping up competition against rival chipmakers vying for lucrative data center business.

Nvidia's graphic chips (GPU), which initially helped propel and enhance the quality of videos in the gaming market, have become the dominant chips for companies to use for AI workloads. The latest GPU, called the H100, can help reduce computing times from weeks to days for some work involving training AI models, the company said.

The announcements were made at Nvidia's AI developers conference online.

"Data centers are becoming AI factories - processing and refining mountains of data to produce intelligence," said Nvidia Chief Executive Officer Jensen Huang in a statement, calling the H100 chip the "engine" of AI infrastructure.

Companies have been using AI and machine learning for everything from making recommendations of the next video to watch to new drug discovery, and the technology is increasingly becoming an important tool for business.

The H100 chip will be produced on Taiwan Manufacturing Semiconductor Company's cutting edge four nanometer process with 80 billion transistors and will be available in the third quarter, Nvidia said.

The H100 will also be used to build Nvidia's new "Eos" supercomputer, which Nvidia said will be the world's fastest AI system when it begins operation later this year.

Facebook parent Meta announced in January that it would build the world's fastest AI supercomputer this year and it would perform at nearly 5 exaflops. Nvidia on Tuesday said its supercomputer will run at over 18 exaflops.

Exaflop performance is the ability to perform 1 quintillion - or 1,000,000,000,000,000,000 - calculations per second.

In addition to the GPU chip, Nvidia introduced a new processor chip (CPU) called the Grace CPU Superchip that is based on Arm technology. It's the first new chip by Nvidia based on the Arm architecture to be announced since the company's deal to buy Arm Ltd fell apart last month due to regulatory hurdles.

The Grace CPU Superchip, which will be available in the first half of next year, connects two CPU chips and will focus on AI and other tasks that require intensive computing power.

More companies are connecting chips using technology that allows faster data flow between them. Earlier this month Apple Inc unveiled its M1 Ultra chip connecting two M1 Max chips.

Nvidia said the two CPU chips were connected using its NVLink-C2C technology, which was also unveiled on Tuesday.

Nvidia shares were up more than 1% in midday trade.



Nvidia CEO Says Global Cooperation in Tech will Continue under Trump Administration

Nvidia CEO Jensen Huang poses for a photo after receiving an honorary doctorate in engineering from the Hong Kong University of Science and Technology, in Hong Kong on November 23, 2024. (Photo by Holmes CHAN / AFP)
Nvidia CEO Jensen Huang poses for a photo after receiving an honorary doctorate in engineering from the Hong Kong University of Science and Technology, in Hong Kong on November 23, 2024. (Photo by Holmes CHAN / AFP)
TT

Nvidia CEO Says Global Cooperation in Tech will Continue under Trump Administration

Nvidia CEO Jensen Huang poses for a photo after receiving an honorary doctorate in engineering from the Hong Kong University of Science and Technology, in Hong Kong on November 23, 2024. (Photo by Holmes CHAN / AFP)
Nvidia CEO Jensen Huang poses for a photo after receiving an honorary doctorate in engineering from the Hong Kong University of Science and Technology, in Hong Kong on November 23, 2024. (Photo by Holmes CHAN / AFP)

Nvidia CEO Jensen Huang said on Saturday that global cooperation in technology will continue even if the incoming US administration imposes stricter export controls on advanced computing products.
US President-elect Donald Trump, in his first term in office, imposed restrictions on the sale of US technology to China citing national security - a policy continued under President Joe Biden. The curbs forced Nvidia, the world's leading maker of chips used for artificial intelligence applications, to change its product lineup in China.
"Open science in global collaboration, cooperation across math and science has been around for a very long time. It is the foundation of social advancement and scientific advancement," Huang told media during a visit to Hong Kong.
Cooperation is "going to continue. I don't know what's going to happen in the new administration, but whatever happens, we'll balance simultaneously compliance with laws and policies, continue to advance our technology and support and serve customers all over the world."
The head of the world's most valuable company was speaking in the financial hub after receiving an honorary doctorate in engineering from the Hong Kong University of Science and Technology, Reuters reported.
During the visit, Huang participated in a fireside chat with the university's Council Chairman Harry Sham in front of an audience of students and academics.
Asked about the huge energy requirements of graphics processing units - chips behind artificial intelligence - Huang said, "If the world uses more energy to power the AI factories of the world, we are a better world when that happens".
Huang said "the goal of AI is not for training, the goal of AI is for inference". He said AI can discover, for instance, new ways to store carbon dioxide in reservoirs, new wind turbine designs and new materials for storing electricity.
He said people should start thinking about placing AI supercomputers slightly off the power grid and let them use sustainable energy and in places away from populations.
"My hopes and dreams is that in the end, what we all see is that using energy for intelligence is the best use of energy we can imagine," Huang said.
Earlier on Saturday, Huang told graduates that "the age of AI has started" in a speech after receiving the honorary degree.
"A new computing era that will impact every industry and every field of science."