AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
TT

AI Cloud Provider SMC Plans Global Rollout

People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights
People attend a media tour of Sustainable Metal Cloud's Sustainable AI Factory in Singapore July 25, 2024. REUTERS/Caroline Chia/File Photo Purchase Licensing Rights

Singapore-headquartered AI cloud provider Sustainable Metal Cloud (SMC) is planning to expand globally as its sees fast-growing demand for its energy saving technology, its CEO said on Thursday.

"Due to client demand, we’re looking to expand in EMEA (Europe Middle East and Africa) and North America," CEO and co-founder Tim Rosenfield said, Reuters reported.

The startup, a partner of AI chip giant Nvidia, already operates what it calls "sustainable AI factories" in Australia and Singapore and is set to launch in India and Thailand.

Its clients in Singapore, where it operates over 1,200 of Nvidia's high-end H100 AI chips, include Facebook owner Meta who uses SMC's cloud to run its Llama 2 AI model.

While most data centres depend on air cooling technology, SMC uses immersion technology, submerging servers from Dell fitted with GPUs (graphics processing units) from Nvidia in a synthetic oil called polyalphaolefin to draw heat away faster.

The technology behind the approach reduces energy consumption by up to 50% compared to traditional air cooling, according to the CEO.

Demand for AI is expected to increase 10-fold compared with 2023, according to the International Energy Agency (IEA).

The electricity consumption of data centres globally is expected to top 1,000 terawatt-hours in 2026, roughly equivalent to Japan's total annual consumption, the IEA said in March.

SMC is currently raising $400 million in equity and $550 million in debt according to a source with direct knowledge of the matter.

The company declined to comment. The fundraising was first reported by Bloomberg.



Mark Zuckerberg, AI's 'Open Source' Evangelist

FILE PHOTO: Meta's CEO Mark Zuckerberg testifies during the Senate Judiciary Committee hearing on online child sexual exploitation at the US Capitol, in Washington, US, January 31, 2024. REUTERS/Nathan Howard/File Photo
FILE PHOTO: Meta's CEO Mark Zuckerberg testifies during the Senate Judiciary Committee hearing on online child sexual exploitation at the US Capitol, in Washington, US, January 31, 2024. REUTERS/Nathan Howard/File Photo
TT

Mark Zuckerberg, AI's 'Open Source' Evangelist

FILE PHOTO: Meta's CEO Mark Zuckerberg testifies during the Senate Judiciary Committee hearing on online child sexual exploitation at the US Capitol, in Washington, US, January 31, 2024. REUTERS/Nathan Howard/File Photo
FILE PHOTO: Meta's CEO Mark Zuckerberg testifies during the Senate Judiciary Committee hearing on online child sexual exploitation at the US Capitol, in Washington, US, January 31, 2024. REUTERS/Nathan Howard/File Photo

Mark Zuckerberg, the founder of Facebook and CEO of Meta, has become an unexpected evangelist for open source technology when it comes to developing artificial intelligence, pitting him against OpenAI and Google.
The 40-year-old tech tycoon laid out his vision in an open letter titled "Open Source AI is the Path Forward" this week. Here is what you need to know about the open versus closed model AI debate, said Agence France Presse.
What is 'open source'?
The history of computer technology has long pitted open source aficionados against companies clinging to their intellectual property.
"Open source" refers to software development where the program code is made freely available to the public, allowing developers to tinker and build on it as they wish.
Many of the internet's foundational technologies, such as the Linux operating system and the Apache web server, are products of open source development.
However, open source is not without challenges. Maintaining large projects, ensuring consistent quality, and managing a wide range of contributors can be complex.
Finally, almost by definition, keeping open source projects financially sustainable is a challenge.
Why is Meta AI 'open source'?
Zuckerberg is probably the last person you would expect to embrace open source.
The company maintains total control over its Instagram and Facebook platforms, leaving little to no leeway for outside developers or researchers to tinker around.
The Cambridge Analytica scandal, in which an outside vendor was revealed in 2018 to be using the platform to gather user information for nefarious practices, only made the company more protective.
Meta's sudden embrace of the open source ethos is driven by its bitterness towards Apple, whose iPhone rules keep a tight control on what Meta and all outside apps can do on their devices.
"One of my formative experiences has been building our services constrained by what Apple will let us build on their platforms," Zuckerberg said.
“Between the way they tax developers, the arbitrary rules they apply, and all the product innovations they block from shipping, it's clear that Meta and many other companies would be freed up if...competitors were not able to constrain what we could build,” he wrote.
That concern has now spread to generative AI, but this time it is Microsoft-backed OpenAI and Google that are the closed-fence culprits that charge developers and keep a tight lid on their AI technology.
Doubters argue that Meta is embracing open source because it came late to the AI party, and is seeking to blow open the field with free access to a powerful model.
What is Llama?
Meta's open source LLaMA 3.1 (for Large Language Model Meta AI) is the company’s latest version of its generative AI technology that can spew out human standard content in just seconds.
Performance-wise, it can be compared to OpenAI’s GPT-4 or Google’s Gemini, and like those models is "trained" before deployment by ingesting data from the internet.
But unlike those models, developers can access the technology for free, and make adaptations as they see fit for their specific use cases.
Meta says that LLaMA 3.1 is as good as the best models out there, but unlike its main rivals, it only deals with text, with the company saying it will later match the others with images, audio and video.
Security threat
In the rivalry over generative AI, defenders of the closed model argue that the Meta way is dangerous, as it allows bad actors to weaponize the powerful technology.
In Washington, lobbyists argue over the distinction, with opponents to open source insisting that models like Llama can be weaponized by countries like China.
Meta argues that transparency assures a more level playing field and that a world of closed models will ensure that only a few big companies, and a powerhouse nation like China, will be in control.
Startups, universities, and small businesses will "miss out on opportunities," Zuckerberg said.