Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
TT
20

Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)

Cerebras Systems launched on Tuesday a tool for AI developers that allows them to access the startup's outsized chips to run applications, offering what it says is a much cheaper option than industry-standard Nvidia processors.

Access to Nvidia graphics processing units (GPUs) - often via a cloud computing provider - to train and deploy large artificial intelligence models used for applications such as OpenAI's ChatGPT can be difficult to obtain and expensive to run, a process developers refer to as inference.

"We're delivering performance that cannot be achieved by a GPU," Cerebras CEO Andrew Feldman told Reuters in an interview. "We're doing it at the highest accuracy, and we're offering it at the lowest price."

The inference portion of the AI market is expected to be fast-growing and attractive - ultimately worth tens of billions of dollars if consumers and businesses adopt AI tools.

The Sunnyvale, California-based company plans to offer several types of the inference product via a developer key and its cloud. The company will also sell its AI systems to customers who prefer to operate their own data centers.

Cerebras' chips - each the size of a dinner plate and called Wafer Scale Engines - avoid one of the issues with AI data crunching: the data crunched by large models that power AI applications typically won't fit on a single chip and can require hundreds or thousands of chips strung together.

That means Cerebras' chips can achieve speedier performances, Feldman said.

It plans to charge users as little as 10 cents per million tokens, which are one of the ways companies can measure the amount of output data from a large model.

Cerebras is aiming to go public and filed a confidential prospectus with the Securities and Exchange Commission this month, the company said.



Google Hopes to Reach Gemini Deal with Apple this Year

FILE PHOTO: Alphabet and Google CEO Sundar Pichai speaks to media following his meeting with Polish Prime Minister Donald Tusk (not pictured) at Google Campus in Warsaw, Poland, February 13, 2025. REUTERS/Aleksandra Szmigiel/File Photo
FILE PHOTO: Alphabet and Google CEO Sundar Pichai speaks to media following his meeting with Polish Prime Minister Donald Tusk (not pictured) at Google Campus in Warsaw, Poland, February 13, 2025. REUTERS/Aleksandra Szmigiel/File Photo
TT
20

Google Hopes to Reach Gemini Deal with Apple this Year

FILE PHOTO: Alphabet and Google CEO Sundar Pichai speaks to media following his meeting with Polish Prime Minister Donald Tusk (not pictured) at Google Campus in Warsaw, Poland, February 13, 2025. REUTERS/Aleksandra Szmigiel/File Photo
FILE PHOTO: Alphabet and Google CEO Sundar Pichai speaks to media following his meeting with Polish Prime Minister Donald Tusk (not pictured) at Google Campus in Warsaw, Poland, February 13, 2025. REUTERS/Aleksandra Szmigiel/File Photo

Google hopes to enter an agreement with Apple by the middle of this year to include its Gemini AI technology on new phones, CEO Sundar Pichai said in testimony at an antitrust trial in Washington on Wednesday.
Pichai testified in the Alphabet unit's defense against proposals by the US Department of Justice which include ending lucrative deals with Apple, Samsung, AT&T and Verizon to be the default search engine on new mobile devices, Reuters reported.
During questioning by DOJ attorney Veronica Onyema, Pichai said that while Google does not yet have an agreement with Apple to include its Gemini AI on iPhones, Pichai spoke with Apple CEO Tim Cook about the possibility last year.
A potential deal this year would see Google's Gemini AI included within Apple Intelligence, Apple's own set of AI features, Pichai said.
Google also plans to experiment with including ads in its Gemini app, Pichai said.
Prosecutors have sought to illustrate how Google could extend its dominance in online search to AI. Google maintained its monopoly in part by paying billions of dollars to wireless carriers and smartphone manufacturers, US District Judge Amit Mehta ruled last year.
The judge is now weighing what actions Google should take to restore competition. The outcome of the case could fundamentally reshape the internet by potentially unseating Google as the go-to portal for information online.
The DOJ and a broad coalition of state attorneys general are pressing for remedies including requiring Google to sell off its Chrome web browser, banning it from paying to be the default search engine and requiring it to share search data with competitors.
The data-sharing provisions would discourage Google from investing in research and development, Pichai testified on Wednesday.
Provisions that would require the company to share its search index and search query data are "extraordinary," and amount to a "defacto divestiture of our IP related to search," Pichai said.
"It would be trivial to reverse engineer and effectively build Google search from the outside," he said.
That would make it "unviable to invest in R&D the way we have for the past two decades," Pichai added.
Google has said it plans to appeal once the judge makes a final ruling.