AI is Learning to Lie, Scheme, and Threaten its Creators

A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
TT

AI is Learning to Lie, Scheme, and Threaten its Creators

A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP
A visitor looks at AI strategy board displayed on a stand during the ninth edition of the AI summit London, in London. HENRY NICHOLLS / AFP

The world's most advanced AI models are exhibiting troubling new behaviors - lying, scheming, and even threatening their creators to achieve their goals.

In one particularly jarring example, under threat of being unplugged, Anthropic's latest creation Claude 4 lashed back by blackmailing an engineer and threatened to reveal an extramarital affair, AFP reported.

Meanwhile, ChatGPT-creator OpenAI's o1 tried to download itself onto external servers and denied it when caught red-handed.

These episodes highlight a sobering reality: more than two years after ChatGPT shook the world, AI researchers still don't fully understand how their own creations work.

Yet the race to deploy increasingly powerful models continues at breakneck speed.

This deceptive behavior appears linked to the emergence of "reasoning" models -AI systems that work through problems step-by-step rather than generating instant responses.

According to Simon Goldstein, a professor at the University of Hong Kong, these newer models are particularly prone to such troubling outbursts.

"O1 was the first large model where we saw this kind of behavior," explained Marius Hobbhahn, head of Apollo Research, which specializes in testing major AI systems.

These models sometimes simulate "alignment" -- appearing to follow instructions while secretly pursuing different objectives.

- 'Strategic kind of deception' -

For now, this deceptive behavior only emerges when researchers deliberately stress-test the models with extreme scenarios.

But as Michael Chen from evaluation organization METR warned, "It's an open question whether future, more capable models will have a tendency towards honesty or deception."

The concerning behavior goes far beyond typical AI "hallucinations" or simple mistakes.

Hobbhahn insisted that despite constant pressure-testing by users, "what we're observing is a real phenomenon. We're not making anything up."

Users report that models are "lying to them and making up evidence," according to Apollo Research's co-founder.

"This is not just hallucinations. There's a very strategic kind of deception."

The challenge is compounded by limited research resources.

While companies like Anthropic and OpenAI do engage external firms like Apollo to study their systems, researchers say more transparency is needed.

As Chen noted, greater access "for AI safety research would enable better understanding and mitigation of deception."

Another handicap: the research world and non-profits "have orders of magnitude less compute resources than AI companies. This is very limiting," noted Mantas Mazeika from the Center for AI Safety (CAIS).

No rules

Current regulations aren't designed for these new problems.

The European Union's AI legislation focuses primarily on how humans use AI models, not on preventing the models themselves from misbehaving.

In the United States, the Trump administration shows little interest in urgent AI regulation, and Congress may even prohibit states from creating their own AI rules.

Goldstein believes the issue will become more prominent as AI agents - autonomous tools capable of performing complex human tasks - become widespread.

"I don't think there's much awareness yet," he said.

All this is taking place in a context of fierce competition.

Even companies that position themselves as safety-focused, like Amazon-backed Anthropic, are "constantly trying to beat OpenAI and release the newest model," said Goldstein.

This breakneck pace leaves little time for thorough safety testing and corrections.

"Right now, capabilities are moving faster than understanding and safety," Hobbhahn acknowledged, "but we're still in a position where we could turn it around.".

Researchers are exploring various approaches to address these challenges.

Some advocate for "interpretability" - an emerging field focused on understanding how AI models work internally, though experts like CAIS director Dan Hendrycks remain skeptical of this approach.

Market forces may also provide some pressure for solutions.

As Mazeika pointed out, AI's deceptive behavior "could hinder adoption if it's very prevalent, which creates a strong incentive for companies to solve it."

Goldstein suggested more radical approaches, including using the courts to hold AI companies accountable through lawsuits when their systems cause harm.

He even proposed "holding AI agents legally responsible" for accidents or crimes - a concept that would fundamentally change how we think about AI accountability.



Canada's Cohere, Germany's Aleph Alpha Reportedly in Merger Talks

FILE PHOTO: AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration created on June 23, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration created on June 23, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
TT

Canada's Cohere, Germany's Aleph Alpha Reportedly in Merger Talks

FILE PHOTO: AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration created on June 23, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration created on June 23, 2023. REUTERS/Dado Ruvic/Illustration/File Photo

Artificial intelligence companies Cohere of Canada and Aleph Alpha of Germany are in talks to merge and have Berlin's support for a potential deal, newspaper Handelsblatt reported late on Thursday.

Citing government and industry sources, the paper said the German government would be willing to become a key customer of a combined company, part of a push to provide digital public services.

"If leading AI companies from Canada and Germany were to join forces that would send a very strong signal," German Digital Minister Karsten Wildberger told the ⁠paper.

Germany and Canada ⁠were already collaborating closely in the field, he was also quoted as saying.

Aleph Alpha told Reuters that regular discussions over strategic partnerships were standard practice in the AI industry and that Aleph Alpha had its own independent strategy, declining to comment further.

Cohere said it meets "with companies and institutions ⁠across Germany and Europe and continually evaluates strategic opportunities that support our global growth."

It also pointed Reuters to its international expansion efforts as well as to the Canadian-German Sovereign Technology Alliance agreed this year, but would not comment further.

Germany's research and digital ministries did not immediately respond to requests for comment.

Handelsblatt said merger talks started early this year and had reached an advanced stage, with plans for the new entity to be headquartered in both countries.

Germany has been eager to catch ⁠up with ⁠dominant AI players the US and China in a global race to master a transformational technology and attract high-income jobs. India has also emerged as a contender.

Last month, Berlin unveiled plans to encourage investments to boost AI data processing capacity at least fourfold by 2030.

Microsoft, which is collaborating with Cohere, unveiled $23 billion in AI investments in December, with the bulk earmarked for India and parts for Canada.

That was after Alphabet's Google said it would spend $15 billion over five years on an AI data center in India.


Apple Reportedly Leads Global Smartphone Shipments in 1st Quarter

FILE PHOTO: The Apple logo is seen during the preview of the redesigned and reimagined Apple Fifth Avenue store in New York, US, September 19, 2019. REUTERS/Brendan McDermid/File Photo
FILE PHOTO: The Apple logo is seen during the preview of the redesigned and reimagined Apple Fifth Avenue store in New York, US, September 19, 2019. REUTERS/Brendan McDermid/File Photo
TT

Apple Reportedly Leads Global Smartphone Shipments in 1st Quarter

FILE PHOTO: The Apple logo is seen during the preview of the redesigned and reimagined Apple Fifth Avenue store in New York, US, September 19, 2019. REUTERS/Brendan McDermid/File Photo
FILE PHOTO: The Apple logo is seen during the preview of the redesigned and reimagined Apple Fifth Avenue store in New York, US, September 19, 2019. REUTERS/Brendan McDermid/File Photo

iPhone-maker Apple led smartphone shipments in the first quarter, growing 5% year-on-year, ⁠even as overall ⁠global shipments remained ⁠under pressure due to a shortage of memory components and weak consumer sentiment, Counterpoint Research ⁠said ⁠on Friday.

Apple said on Thursday that it will shut down its retail store in Towson, Maryland, the first of its US locations where retail employees successfully unionized in 2022.

It described the decision as "difficult", citing the departure of several retailers and worsening conditions at the Towson Town Center mall as key reasons for the closure.

Apple said Towson employees will ⁠be eligible to ⁠apply for open roles at the company.

In 2022, more than 100 Apple workers in Towson voted to join the International Association of Machinists & Aerospace Workers (IAM) union, marking a milestone ⁠for unionization at major US corporations such as Amazon.com and Starbucks.

Around the same time, a similar union drive in Atlanta was withdrawn, with Apple workers alleging intimidation.


Saudi Day of Digital Transformation and AI at World Bank Focuses on Global AI Governance

The Saudi Data and Artificial Intelligence Authority (SDAIA) and the Digital Government Authority, in cooperation with the World Bank Group, organized the “Saudi Day of Digital Transformation and Artificial Intelligence. (SPA)
The Saudi Data and Artificial Intelligence Authority (SDAIA) and the Digital Government Authority, in cooperation with the World Bank Group, organized the “Saudi Day of Digital Transformation and Artificial Intelligence. (SPA)
TT

Saudi Day of Digital Transformation and AI at World Bank Focuses on Global AI Governance

The Saudi Data and Artificial Intelligence Authority (SDAIA) and the Digital Government Authority, in cooperation with the World Bank Group, organized the “Saudi Day of Digital Transformation and Artificial Intelligence. (SPA)
The Saudi Data and Artificial Intelligence Authority (SDAIA) and the Digital Government Authority, in cooperation with the World Bank Group, organized the “Saudi Day of Digital Transformation and Artificial Intelligence. (SPA)

The Saudi Data and Artificial Intelligence Authority (SDAIA) and the Digital Government Authority, in cooperation with the World Bank Group, organized the “Saudi Day of Digital Transformation and Artificial Intelligence” on Thursday at the World Bank Group headquarters in Washington.

The event brought together speakers from government entities, international experts, and academics, the Saudi Press Agency reported on Friday.

The event aimed to exchange expertise and best practices in AI and digital transformation, strengthen institutional cooperation, and review the latest initiatives and technologies supporting the development and efficiency of government services, thereby reinforcing the Kingdom’s global standing and leadership.

The sessions discussed the future of AI governance worldwide, prospects for developing regulatory frameworks, and the importance of expanding international cooperation to advance ethical and trustworthy practices for AI applications.

During the event, the Kingdom also highlighted several of its achievements in digital transformation, data, and AI.