Anthropic Releases AI to Automate Mouse Clicks for Coders

Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
TT

Anthropic Releases AI to Automate Mouse Clicks for Coders

Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)

Anthropic, a startup backed by Alphabet and Amazon.com, released a pair of updated artificial intelligence models on Tuesday, along with a new capability to autonomously perform computer tasks and save users keystrokes.

The new "computer use" feature can tell AI "where to move the mouse, where to click, what to type, in order to do quite complicated tasks," Anthropic's Chief Science Officer Jared Kaplan said in an interview.

The capability is tailored to software developers and represents a move toward AI agents, programs that require little human intervention to carry out multi-step actions. Researchers have touted agents as a frontier for AI development beyond chatbots, which easily conjure prose or computer code though not actions.

Anthropic demonstrated a use case for the feature that entailed coding a basic website, and another that used various programs including Google Search and Apple Maps to plan a sunrise outing.

Anthropic offers software developers three versions of Claude, its family of AI models, at price points that vary based on their performance. This week's updates come to Sonnet, the mid-tier model, and Haiku, the cheapest.

The new 3.5 Haiku can generate computer code in a manner "almost comparable" to the version of Sonnet released in June, according to Kaplan. CEO Dario Amodei told Reuters at the time that the company intended to update Opus, the most capable model, by the end of the year.

The computer use feature is currently limited to the new version of Claude 3.5 Sonnet and comes with safeguards to prevent its application toward spam, fraud and election-related misuse, Anthropic said. Kaplan said the AI still makes mistakes.

Mike Krieger, a co-founder of Instagram who joined Anthropic this spring as chief product officer, said the company wants feedback from business customers to learn where to focus development of the feature. Meanwhile, a labs team inside Anthropic is exploring how to make the capability available for consumers, something Krieger said he personally wants.

"I was booking flights," he said. "I really just want this to be completely automated."

Microsoft on Monday unveiled an application for its clients to build their own agents that can handle queries, identify sales leads and manage inventory.



China Welcomes Apple's Continued, Deeper Presence

Shen Xinyi (C), a student at Zhejiang University, introduces a "science and technology backyard" to Apple CEO Tim Cook (L) and chief operating officer Jeff Williams (R), at an organic farm in Shunyi District, Beijing, China, 22 October 2024 (issued 24 October 2024).  EPA/XINHUA / Cai Yang
Shen Xinyi (C), a student at Zhejiang University, introduces a "science and technology backyard" to Apple CEO Tim Cook (L) and chief operating officer Jeff Williams (R), at an organic farm in Shunyi District, Beijing, China, 22 October 2024 (issued 24 October 2024). EPA/XINHUA / Cai Yang
TT

China Welcomes Apple's Continued, Deeper Presence

Shen Xinyi (C), a student at Zhejiang University, introduces a "science and technology backyard" to Apple CEO Tim Cook (L) and chief operating officer Jeff Williams (R), at an organic farm in Shunyi District, Beijing, China, 22 October 2024 (issued 24 October 2024).  EPA/XINHUA / Cai Yang
Shen Xinyi (C), a student at Zhejiang University, introduces a "science and technology backyard" to Apple CEO Tim Cook (L) and chief operating officer Jeff Williams (R), at an organic farm in Shunyi District, Beijing, China, 22 October 2024 (issued 24 October 2024). EPA/XINHUA / Cai Yang

US tech giant Apple Inc is welcome to continue deepening its presence in the Chinese market, Commerce Minister Wang Wentao told its Chief Executive Tim Cook during a meeting on Friday, the ministry said in a statement.
The remark mirrored the exchanges between China's Minister for Industry and Information Technology and Cook during a meeting earlier this week in Beijing.
China is willing to help return Sino-US economic and trade ties to a healthy and stable track of development through regular exchanges between government and enterprises, Wang added.
China will further optimize the business environment and continue to provide quality services for foreign enterprises, Wang said, but also told Cook that the highlighting of national security "is not conducive to normal economic and trade exchanges.”