AI is Learning to Lie, Scheme, and Threaten its Creators

A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
TT
20

AI is Learning to Lie, Scheme, and Threaten its Creators

A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP

The world's most advanced AI models are exhibiting troubling new behaviors - lying, scheming, and even threatening their creators to achieve their goals.

In one particularly jarring example, under threat of being unplugged, Anthropic's latest creation Claude 4 lashed back by blackmailing an engineer and threatened to reveal an extramarital affair, AFP reported.

Meanwhile, ChatGPT-creator OpenAI's o1 tried to download itself onto external servers and denied it when caught red-handed.

These episodes highlight a sobering reality: more than two years after ChatGPT shook the world, AI researchers still don't fully understand how their own creations work.

Yet the race to deploy increasingly powerful models continues at breakneck speed.

This deceptive behavior appears linked to the emergence of "reasoning" models -AI systems that work through problems step-by-step rather than generating instant responses.

According to Simon Goldstein, a professor at the University of Hong Kong, these newer models are particularly prone to such troubling outbursts.

"O1 was the first large model where we saw this kind of behavior," explained Marius Hobbhahn, head of Apollo Research, which specializes in testing major AI systems.

These models sometimes simulate "alignment" -- appearing to follow instructions while secretly pursuing different objectives.

- 'Strategic kind of deception' -

For now, this deceptive behavior only emerges when researchers deliberately stress-test the models with extreme scenarios.

But as Michael Chen from evaluation organization METR warned, "It's an open question whether future, more capable models will have a tendency towards honesty or deception."

The concerning behavior goes far beyond typical AI "hallucinations" or simple mistakes.

Hobbhahn insisted that despite constant pressure-testing by users, "what we're observing is a real phenomenon. We're not making anything up."

Users report that models are "lying to them and making up evidence," according to Apollo Research's co-founder.

"This is not just hallucinations. There's a very strategic kind of deception."

The challenge is compounded by limited research resources.

While companies like Anthropic and OpenAI do engage external firms like Apollo to study their systems, researchers say more transparency is needed.

As Chen noted, greater access "for AI safety research would enable better understanding and mitigation of deception."

Another handicap: the research world and non-profits "have orders of magnitude less compute resources than AI companies. This is very limiting," noted Mantas Mazeika from the Center for AI Safety (CAIS).

No rules

Current regulations aren't designed for these new problems.

The European Union's AI legislation focuses primarily on how humans use AI models, not on preventing the models themselves from misbehaving.

In the United States, the Trump administration shows little interest in urgent AI regulation, and Congress may even prohibit states from creating their own AI rules.

Goldstein believes the issue will become more prominent as AI agents - autonomous tools capable of performing complex human tasks - become widespread.

"I don't think there's much awareness yet," he said.

All this is taking place in a context of fierce competition.

Even companies that position themselves as safety-focused, like Amazon-backed Anthropic, are "constantly trying to beat OpenAI and release the newest model," said Goldstein.

This breakneck pace leaves little time for thorough safety testing and corrections.

"Right now, capabilities are moving faster than understanding and safety," Hobbhahn acknowledged, "but we're still in a position where we could turn it around.".

Researchers are exploring various approaches to address these challenges.

Some advocate for "interpretability" - an emerging field focused on understanding how AI models work internally, though experts like CAIS director Dan Hendrycks remain skeptical of this approach.

Market forces may also provide some pressure for solutions.

As Mazeika pointed out, AI's deceptive behavior "could hinder adoption if it's very prevalent, which creates a strong incentive for companies to solve it."

Goldstein suggested more radical approaches, including using the courts to hold AI companies accountable through lawsuits when their systems cause harm.

He even proposed "holding AI agents legally responsible" for accidents or crimes - a concept that would fundamentally change how we think about AI accountability.



Google-parent Alphabet Earnings Shine with Help of AI

Google parent company Alphabet's cloud computing business is on pace to bring in $50 billion over the course of 2025, according to the tech giant. Manaure Quintero / AFP
Google parent company Alphabet's cloud computing business is on pace to bring in $50 billion over the course of 2025, according to the tech giant. Manaure Quintero / AFP
TT
20

Google-parent Alphabet Earnings Shine with Help of AI

Google parent company Alphabet's cloud computing business is on pace to bring in $50 billion over the course of 2025, according to the tech giant. Manaure Quintero / AFP
Google parent company Alphabet's cloud computing business is on pace to bring in $50 billion over the course of 2025, according to the tech giant. Manaure Quintero / AFP

Google-parent Alphabet on Wednesday reported quarterly profits that topped expectations, saying artificial intelligence has boosted every part of its business.

Alphabet's second-quarter profit of $28.2 billion -- on $96.4 billion in revenue -- came with word that the tech giant will spend $10 billion more than it previously planned this year on capital expenditures, as it invests to meet growing demand for cloud services.

"We had a standout quarter, with robust growth across the company," said Alphabet chief executive Sundar Pichai.

"AI is positively impacting every part of the business, driving strong momentum."

Revenue from search grew double digits in the quarter, with features such as AI Overviews and the recently launched AI mode "performing well," according to Pichai.

Ad revenue at YouTube continues to grow along with the video platform's subscription services, Alphabet reported.

Alphabet's cloud computing business is on pace to bring in $50 billion over the course of the year, according to the company.

"With this strong and growing demand for our cloud products and services, we are increasing our investment in capital expenditures in 2025 to approximately $85 billion and are excited by the opportunity ahead," Pichai said.

Alphabet shares were up nearly 2 percent in after-market trades that followed the release of the earnings figures.

Investors have been watching closely to see whether the tech giant may be pouring too much money into artificial intelligence and whether AI-generated summaries of search results will translate into fewer opportunities to serve up money-making ads.

The internet giant is dabbling with ads in its new AI Mode for online search, a strategic move to fend off competition from ChatGPT while adapting its advertising business for an AI age.

The integration of advertising has been a key question accompanying the rise of generative AI chatbots, which have largely avoided interrupting the user experience with marketing messages.

However, advertising remains Google's financial bedrock.

"Google is doing well despite tariff headwinds and rising AI competition in search," said eMarketer principal analyst Yory Wurmser.

"It's also successfully monetizing AI Overviews and AI Mode, a good sign for the future."

Google and rivals are spending billions of dollars on data centers and more for AI, while the rise of lower-cost model DeepSeek from China raises questions about how much needs to be spent.

Antitrust battles

Meanwhile the online ad business that generates the cash Google invests in its future could be neutered due to a defeat in a US antitrust case.

During the summer of 2024, Google was found guilty of illegal practices to establish and maintain its monopoly in online search by a federal judge in Washington.

The Justice Department is now demanding remedies that could transform the digital landscape: Google's divestiture from its Chrome browser and a ban on entering exclusivity agreements with smartphone manufacturers to install the search engine by default.

District Judge Amit Mehta is considering "remedies" in a decision expected in the coming days or weeks.

In another legal battle, a different US judge ruled this year that Google wielded monopoly power in the online ad technology market, another legal blow that could rattle the tech giant's revenue engine.

District Court Judge Leonie Brinkema ruled that Google built an illegal monopoly over ad software and tools used by publishers.

Combined, the courtroom defeats have the potential to leave Google split up and its influence curbed.

Google said it is appealing both rulings.