Nvidia Unveils Latest Chips, Technology to Speed up AI Computing

The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
TT

Nvidia Unveils Latest Chips, Technology to Speed up AI Computing

The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)
The Nvidia's new Grace CPU Superchip unveiled at the chipmaker's AI developer conference is seen in this undated handout image obtained by Reuters. (Nvidia/Handout via Reuters)

Nvidia Corp on Tuesday announced several new chips and technologies that it said will boost the computing speed of increasingly complicated artificial intelligence algorithms, stepping up competition against rival chipmakers vying for lucrative data center business.

Nvidia's graphic chips (GPU), which initially helped propel and enhance the quality of videos in the gaming market, have become the dominant chips for companies to use for AI workloads. The latest GPU, called the H100, can help reduce computing times from weeks to days for some work involving training AI models, the company said.

The announcements were made at Nvidia's AI developers conference online.

"Data centers are becoming AI factories - processing and refining mountains of data to produce intelligence," said Nvidia Chief Executive Officer Jensen Huang in a statement, calling the H100 chip the "engine" of AI infrastructure.

Companies have been using AI and machine learning for everything from making recommendations of the next video to watch to new drug discovery, and the technology is increasingly becoming an important tool for business.

The H100 chip will be produced on Taiwan Manufacturing Semiconductor Company's cutting edge four nanometer process with 80 billion transistors and will be available in the third quarter, Nvidia said.

The H100 will also be used to build Nvidia's new "Eos" supercomputer, which Nvidia said will be the world's fastest AI system when it begins operation later this year.

Facebook parent Meta announced in January that it would build the world's fastest AI supercomputer this year and it would perform at nearly 5 exaflops. Nvidia on Tuesday said its supercomputer will run at over 18 exaflops.

Exaflop performance is the ability to perform 1 quintillion - or 1,000,000,000,000,000,000 - calculations per second.

In addition to the GPU chip, Nvidia introduced a new processor chip (CPU) called the Grace CPU Superchip that is based on Arm technology. It's the first new chip by Nvidia based on the Arm architecture to be announced since the company's deal to buy Arm Ltd fell apart last month due to regulatory hurdles.

The Grace CPU Superchip, which will be available in the first half of next year, connects two CPU chips and will focus on AI and other tasks that require intensive computing power.

More companies are connecting chips using technology that allows faster data flow between them. Earlier this month Apple Inc unveiled its M1 Ultra chip connecting two M1 Max chips.

Nvidia said the two CPU chips were connected using its NVLink-C2C technology, which was also unveiled on Tuesday.

Nvidia shares were up more than 1% in midday trade.



Google Reportedly Weighs Large Data Center in Vietnam

FILE PHOTO: The logo for Google is seen at the Google Store Chelsea in Manhattan, New York City, US, November 17, 2021. REUTERS/Andrew Kelly/File Photo
FILE PHOTO: The logo for Google is seen at the Google Store Chelsea in Manhattan, New York City, US, November 17, 2021. REUTERS/Andrew Kelly/File Photo
TT

Google Reportedly Weighs Large Data Center in Vietnam

FILE PHOTO: The logo for Google is seen at the Google Store Chelsea in Manhattan, New York City, US, November 17, 2021. REUTERS/Andrew Kelly/File Photo
FILE PHOTO: The logo for Google is seen at the Google Store Chelsea in Manhattan, New York City, US, November 17, 2021. REUTERS/Andrew Kelly/File Photo

Alphabet's Google is considering building a large data center in Vietnam, a person briefed on the plans said, in what would be the first such investment by a big US technology company in the Southeast Asian nation.
Google is weighing setting up a "hyperscale" data center close to Ho Chi Minh City, Vietnam's southern economic hub, the source said, declining to be named because the information is not public.
The investment, the size of which the source did not specify, would be a shot in the arm for Vietnam which has so far failed to attract major overseas capital in data centers due to its patchy infrastructure, with large tech companies preferring to house their centers in rival nations in the region.
According to Reuters, it was not clear how quickly Google will reach a decision on an investment but the source said internal talks are on and the data center could be ready in 2027.
A spokesperson for Google declined to comment about the data center plan.
Hyperscale centers are the largest in the industry, with power consumption usually similar to that of a big city.
A hyperscale data center with power consumption capacity of 50 megawatts (MW) could cost between $300 million and $650 million, according to estimates based on data published by real estate consultant Jones Lang LaSalle in a report this year on data centers in Vietnam.
Google's move was motivated by the large number of its domestic and foreign cloud services clients in Vietnam and the country's expanding digital economy, the source said, noting the Southeast Asian nation was one of the fastest-growing markets for YouTube, Google's popular online video sharing platform.
Currently the top data center operators in Vietnam, based on computing space, are industrial investment firm IDC Becamex and telecommunications company VNPT, both Vietnamese state-owned enterprises, according to an internal market report by an industrial park in Vietnam seen by Reuters.
The Nikkei reported in May that Chinese e-commerce company Alibaba was considering building a data center in Vietnam. Alibaba did not reply to a request for comment.