Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
TT

Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)

Cerebras Systems launched on Tuesday a tool for AI developers that allows them to access the startup's outsized chips to run applications, offering what it says is a much cheaper option than industry-standard Nvidia processors.

Access to Nvidia graphics processing units (GPUs) - often via a cloud computing provider - to train and deploy large artificial intelligence models used for applications such as OpenAI's ChatGPT can be difficult to obtain and expensive to run, a process developers refer to as inference.

"We're delivering performance that cannot be achieved by a GPU," Cerebras CEO Andrew Feldman told Reuters in an interview. "We're doing it at the highest accuracy, and we're offering it at the lowest price."

The inference portion of the AI market is expected to be fast-growing and attractive - ultimately worth tens of billions of dollars if consumers and businesses adopt AI tools.

The Sunnyvale, California-based company plans to offer several types of the inference product via a developer key and its cloud. The company will also sell its AI systems to customers who prefer to operate their own data centers.

Cerebras' chips - each the size of a dinner plate and called Wafer Scale Engines - avoid one of the issues with AI data crunching: the data crunched by large models that power AI applications typically won't fit on a single chip and can require hundreds or thousands of chips strung together.

That means Cerebras' chips can achieve speedier performances, Feldman said.

It plans to charge users as little as 10 cents per million tokens, which are one of the ways companies can measure the amount of output data from a large model.

Cerebras is aiming to go public and filed a confidential prospectus with the Securities and Exchange Commission this month, the company said.



Indonesia Expects $1 Billion Investment Commitment from Apple in a Week

FILE PHOTO: A logo is pictured outside the Apple Fifth Avenue store as Apple's Vision Pro headset is presented there, in Manhattan in New York City, US, February 2, 2024. REUTERS/Brendan McDermid/File Photo
FILE PHOTO: A logo is pictured outside the Apple Fifth Avenue store as Apple's Vision Pro headset is presented there, in Manhattan in New York City, US, February 2, 2024. REUTERS/Brendan McDermid/File Photo
TT

Indonesia Expects $1 Billion Investment Commitment from Apple in a Week

FILE PHOTO: A logo is pictured outside the Apple Fifth Avenue store as Apple's Vision Pro headset is presented there, in Manhattan in New York City, US, February 2, 2024. REUTERS/Brendan McDermid/File Photo
FILE PHOTO: A logo is pictured outside the Apple Fifth Avenue store as Apple's Vision Pro headset is presented there, in Manhattan in New York City, US, February 2, 2024. REUTERS/Brendan McDermid/File Photo

Indonesia is expecting to get a $1 billion investment commitment from tech firm Apple Inc in a week, its investment minister said on Tuesday, after the government banned iPhone 16 sales for failing to meet local content rules.
Indonesia stopped sales of the smartphone because it requires those sold domestically to comprise at least 40% locally-made parts, which it said Apple had not adhered to. Indonesia plans to increase this requirement, a deputy minister said on Tuesday.
Investment Minister Rosan Roeslani told lawmakers in a hearing that Indonesia expects more investment if Apple decides to make the country part of its supply chain, Reuters reported.
Apple did not immediately respond to a request for comment.
"Whoever benefits from the sales must invest here, create jobs here. What's important is how the global value chain moves here, because once it does, suppliers follow," Rosan said, adding the investment commitment is part of a first phase.
Apple had previously made a $100 million investment proposal to build an accessory and component plant in Indonesia to reverse the ban, but the government rejected that on the grounds it did not meet the principal of fairness.
Apple has no manufacturing facilities in Indonesia, a country of about 280 million people, but has since 2018 set up application developer academies. Indonesia considers that strategy an attempt to meet local content requirement for the sale of older iPhone models.