Nvidia Shows New Research on Using AI to Improve Chip Designs

The logo of technology company Nvidia is seen at its headquarters in Santa Clara, California February 11, 2015. (Reuters)
The logo of technology company Nvidia is seen at its headquarters in Santa Clara, California February 11, 2015. (Reuters)
TT

Nvidia Shows New Research on Using AI to Improve Chip Designs

The logo of technology company Nvidia is seen at its headquarters in Santa Clara, California February 11, 2015. (Reuters)
The logo of technology company Nvidia is seen at its headquarters in Santa Clara, California February 11, 2015. (Reuters)

Nvidia Corp, the world's leading designer of computer chips used in creating artificial intelligence, on Monday showed new research that explains how AI can be used to improve chip design.

The process of designing a chip involves deciding where to place tens of billions of tiny on-off switches called transistors on a piece of silicon to create working chips. The exact placement of those transistors has a big impact on the chip's cost, speed and power consumption.

Chip design engineers use complex design software from firms like Synopsys Inc and Cadence Design Systems Inc to help them optimize the placement of those transistors.

On Monday, Nvidia released a paper showing that it could use a combination of artificial intelligence techniques to find better ways to place big groups of transistors. The paper aimed to improve on a 2021 paper by Alphabet Inc's Google, whose findings later became the subject of controversy.

The Nvidia research took an existing effort developed by University of Texas researchers using what is called reinforcement learning and added a second layer of artificial intelligence on top of it to get even better results.

Nvidia chief scientist Bill Dally said the work is important because chip manufacturing improvements are slowing with per-transistor costs in new generations of chip manufacturing technology now higher than previous generations.

That goes against the famous prediction by Intel Corp co-founder Gordon Moore that chips would always get cheaper and faster.

"You're no longer actually getting an economy from that scaling," Dally said. "To continue to move forward and to deliver more value to customers, we can't get it from cheaper transistors. We have to get it by being more clever on the design."



AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
TT

AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights

Singapore-headquartered AI cloud provider Sustainable Metal Cloud (SMC) is planning to expand globally as its sees fast-growing demand for its energy saving technology, its CEO said on Thursday.

"Due to client demand, we’re looking to expand in EMEA (Europe Middle East and Africa) and North America," CEO and co-founder Tim Rosenfield said, Reuters reported.

The startup, a partner of AI chip giant Nvidia, already operates what it calls "sustainable AI factories" in Australia and Singapore and is set to launch in India and Thailand.

Its clients in Singapore, where it operates over 1,200 of Nvidia's high-end H100 AI chips, include Facebook owner Meta who uses SMC's cloud to run its Llama 2 AI model.

While most data centres depend on air cooling technology, SMC uses immersion technology, submerging servers from Dell fitted with GPUs (graphics processing units) from Nvidia in a synthetic oil called polyalphaolefin to draw heat away faster.

The technology behind the approach reduces energy consumption by up to 50% compared to traditional air cooling, according to the CEO.

Demand for AI is expected to increase 10-fold compared with 2023, according to the International Energy Agency (IEA).

The electricity consumption of data centres globally is expected to top 1,000 terawatt-hours in 2026, roughly equivalent to Japan's total annual consumption, the IEA said in March.

SMC is currently raising $400 million in equity and $550 million in debt according to a source with direct knowledge of the matter.

The company declined to comment. The fundraising was first reported by Bloomberg.