Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
TT
20

Cerebras Launches AI Inference Tool to Challenge Nvidia

Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)
Cerebras Systems logo is seen in this illustration taken March 31, 2023. (Reuters)

Cerebras Systems launched on Tuesday a tool for AI developers that allows them to access the startup's outsized chips to run applications, offering what it says is a much cheaper option than industry-standard Nvidia processors.

Access to Nvidia graphics processing units (GPUs) - often via a cloud computing provider - to train and deploy large artificial intelligence models used for applications such as OpenAI's ChatGPT can be difficult to obtain and expensive to run, a process developers refer to as inference.

"We're delivering performance that cannot be achieved by a GPU," Cerebras CEO Andrew Feldman told Reuters in an interview. "We're doing it at the highest accuracy, and we're offering it at the lowest price."

The inference portion of the AI market is expected to be fast-growing and attractive - ultimately worth tens of billions of dollars if consumers and businesses adopt AI tools.

The Sunnyvale, California-based company plans to offer several types of the inference product via a developer key and its cloud. The company will also sell its AI systems to customers who prefer to operate their own data centers.

Cerebras' chips - each the size of a dinner plate and called Wafer Scale Engines - avoid one of the issues with AI data crunching: the data crunched by large models that power AI applications typically won't fit on a single chip and can require hundreds or thousands of chips strung together.

That means Cerebras' chips can achieve speedier performances, Feldman said.

It plans to charge users as little as 10 cents per million tokens, which are one of the ways companies can measure the amount of output data from a large model.

Cerebras is aiming to go public and filed a confidential prospectus with the Securities and Exchange Commission this month, the company said.



DeepSeek Available to Download Again in South Korea After Suspension 

The DeepSeek logo is seen on January 29, 2025. (Reuters)
The DeepSeek logo is seen on January 29, 2025. (Reuters)
TT
20

DeepSeek Available to Download Again in South Korea After Suspension 

The DeepSeek logo is seen on January 29, 2025. (Reuters)
The DeepSeek logo is seen on January 29, 2025. (Reuters)

Chinese artificial intelligence service DeepSeek became available again on South Korean app markets on Monday for the first time in about two months, when downloads were suspended after authorities cited breaches in data protection rules.

South Korea's Personal Information Protection Commission said on Thursday that DeepSeek transferred user data and prompts without permission when the service first launched in South Korea in January.

Downloading the app was suspended in February after the questions over personal data protection surfaced, but the service was available for download again on South Korea's app market including via Apple's App Store and Google Play Store.

"We process your personal information in compliance with the Personal Information Protection Act of Korea," DeepSeek said in a revised privacy policy note applied to the app.

DeepSeek said users had the option to refuse to allow the transfer of personal information to a number of companies in China and the United States.

DeepSeek did not immediately respond to a request for comment on Monday.

South Korea's data protection agency said DeepSeek had voluntarily decided to make the app available for download, which it is free to do after at least partially reflecting its recommendations.