Microsoft Offers Cloud Customers AMD Alternative to Nvidia AI Processors 

A view shows a Microsoft logo at Microsoft offices in Issy-les-Moulineaux near Paris, France, March 25, 2024. (Reuters)
A view shows a Microsoft logo at Microsoft offices in Issy-les-Moulineaux near Paris, France, March 25, 2024. (Reuters)
TT

Microsoft Offers Cloud Customers AMD Alternative to Nvidia AI Processors 

A view shows a Microsoft logo at Microsoft offices in Issy-les-Moulineaux near Paris, France, March 25, 2024. (Reuters)
A view shows a Microsoft logo at Microsoft offices in Issy-les-Moulineaux near Paris, France, March 25, 2024. (Reuters)

Microsoft said on Thursday it plans to offer its cloud computing customers a platform of AMD artificial intelligence chips that will compete with components made by Nvidia, with details to be given at its Build developer conference next week.

It will also launch a preview of new Cobalt 100 custom processors at the conference.

Microsoft's clusters of Advanced Micro Devices' flagship MI300X AI chips will be sold through its Azure cloud computing service. They will give its customers an alternative to Nvidia's H100 family of powerful graphics processing units (GPUs) which dominate the data center chip market for AI but can be hard to obtain due to high demand.

To build AI models or run applications, companies typically must string together - or cluster - multiple GPUs because the data and computation will not fit on a single processor.

AMD, which expects $4 billion in AI chip revenue this year, has said the chips are powerful enough to train and run large AI models.

As well as Nvidia's top-shelf AI chips, Microsoft's cloud computing unit sells access to its own in-house AI chips called Maia.

Separately, the Cobalt 100 processors Microsoft plans to preview next week offer 40% better performance over other processors based on Arm Holdings' technology, the company said. Snowflake and others have begun to use them.

The Cobalt chips, which were announced in November, are being tested to power Teams, Microsoft's messaging tool for businesses, and positioned to compete with the in-house Graviton CPUs made by Amazon.com.



AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
TT

AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights

Singapore-headquartered AI cloud provider Sustainable Metal Cloud (SMC) is planning to expand globally as its sees fast-growing demand for its energy saving technology, its CEO said on Thursday.

"Due to client demand, we’re looking to expand in EMEA (Europe Middle East and Africa) and North America," CEO and co-founder Tim Rosenfield said, Reuters reported.

The startup, a partner of AI chip giant Nvidia, already operates what it calls "sustainable AI factories" in Australia and Singapore and is set to launch in India and Thailand.

Its clients in Singapore, where it operates over 1,200 of Nvidia's high-end H100 AI chips, include Facebook owner Meta who uses SMC's cloud to run its Llama 2 AI model.

While most data centres depend on air cooling technology, SMC uses immersion technology, submerging servers from Dell fitted with GPUs (graphics processing units) from Nvidia in a synthetic oil called polyalphaolefin to draw heat away faster.

The technology behind the approach reduces energy consumption by up to 50% compared to traditional air cooling, according to the CEO.

Demand for AI is expected to increase 10-fold compared with 2023, according to the International Energy Agency (IEA).

The electricity consumption of data centres globally is expected to top 1,000 terawatt-hours in 2026, roughly equivalent to Japan's total annual consumption, the IEA said in March.

SMC is currently raising $400 million in equity and $550 million in debt according to a source with direct knowledge of the matter.

The company declined to comment. The fundraising was first reported by Bloomberg.