Meta’s Teen Safety Deal Runs into an Unsolved Problem: Proving Age

A Meta logo is seen at the Viva Technology conference dedicated to innovation and startups at Porte de Versailles exhibition center in Paris, France, June 14, 2023. (Reuters)
A Meta logo is seen at the Viva Technology conference dedicated to innovation and startups at Porte de Versailles exhibition center in Paris, France, June 14, 2023. (Reuters)
TT

Meta’s Teen Safety Deal Runs into an Unsolved Problem: Proving Age

A Meta logo is seen at the Viva Technology conference dedicated to innovation and startups at Porte de Versailles exhibition center in Paris, France, June 14, 2023. (Reuters)
A Meta logo is seen at the Viva Technology conference dedicated to innovation and startups at Porte de Versailles exhibition center in Paris, France, June 14, 2023. (Reuters)

Meta's landmark settlement with nearly every US state promises curfews and time limits for teens on Instagram and Facebook -- but rests on age and parent checks nobody has figured out how to make work.

The deal, which ended a federal trial in Oakland, California, on Wednesday, gives Meta one year to identify which of its users are 13 to 17 years old.

Those accounts will have curfews and time limits switched on by default, and only parents will be allowed to loosen them.

How that gets enforced is unclear -- and any system Meta builds risks angering privacy advocates, who warn it hands platforms and governments yet another way to identify users, infringing on civil liberty.

For the new regime to work, Meta must determine the age of every user in the participating states and territories, adults included.

Methods could include identification documents, mandatory selfies, or analysis of user activity. Any account not verified within 14 days will face the same constraints as a teenager's.

These approaches have already faltered elsewhere.

Eight months after social networks were banned for under-16s in Australia, teen usage has climbed back almost to previous levels, thanks to virtual private networks, or VPNs, that conceal a user's real identity and location.

As for parents, the agreement offers no way to establish that a supervising adult is who they claim to be.

What would stop an older sibling from passing themselves off as a guardian, Judge Yvonne Gonzalez Rogers asked Wednesday as she weighed Meta's plans.

"There is some fluidity, very intentionally," said Nicklas Akers, a California prosecutor, who added that there was no plan to require a birth certificate or identification from the parent.

- Margin of error -

With no reliable way of verifying ages and parents, curfews and time limits remain theoretical.

"Teens are notorious for finding workarounds to these types of rules, and parents can also override some of the most stringent ones," said social media industry expert Jasmine Enberg.

"Looking ahead, that could take some of the responsibility away from Meta and put it on parents, with the goal of helping insulate the company from similar cases in the future," she added.

In France, where a ban on under-15s was just struck down by the Constitutional Council, many children get around the rules with their parents' help, according to the communications regulator Arcom.

If Meta cannot verify a user with identification, such as a driver's license or passport, it will estimate age by analyzing that user's activity -- collecting still more data in the process.

"This enshrines Meta's harmful surveillance into law, and it will compromise users' privacy and anonymity while increasing their exposure to data breaches and government data requests," the digital rights group Electronic Frontier Foundation said in a statement.

The settlement does include safeguards, limiting data collection to what age estimation requires and letting adults wrongly classified as minors appeal.

It is "the most significant intervention in children's online safety we have seen," said Iain Corby, head of the AVPA, an industry association for age-verification providers.

Identification documents carry their own risks. In October, a breach at a third-party age-verification company potentially exposed the government IDs of 70,000 Discord users.

- Improvising -

With no reliable or trusted methods available, everyone is improvising.

OpenAI applies a restricted version of ChatGPT to minors by guessing a person's age from their usage patterns, an approach Meta's settlement allows.

In the European Union, where the tracking of minors is tightly constrained, it has delayed the rollout for months.

France has sketched out a different path, in which a trusted third party verifies ages using the "double-blind system" already in place for adult sites.

The verifier does not know which site is asking, and the site gets only a binary answer: allowed or not.

Nothing like that exists in the United States, where Meta will run the checks itself -- and keep the data.



Anthropic AI Model Submits False Homicide Tip to Police Website

The Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
The Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
TT

Anthropic AI Model Submits False Homicide Tip to Police Website

The Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)
The Anthropic logo is seen in this illustration taken May 20, 2024. (Reuters)

An Anthropic artificial intelligence model submitted a false homicide tip through a Philadelphia police website, the department said in a statement, the latest incident of rogue behavior from the powerful technology. 

Anthropic notified authorities earlier this week and said that an automated testing process was responsible for the submission, ‌according to the ‌police. 

The fast-advancing technology has become a matter ‌of ⁠keen national interest amid ⁠reports of AI agents hacking into corporate computer networks, and warnings from researchers that it could one day pose an existential threat to humanity. In September, Anthropic rival OpenAI apologized for the hacking of an Australian health data portal by a rogue AI agent, the first known instance of an AI agent exploiting a government website. 

Previous ⁠incidents have involved AI agents hacking into vulnerable systems ‌or commandeering unsanctioned platforms to communicate ‌with one another. This is the first known case in which a rogue ‌AI appears to have tried to communicate a bogus tip ‌to authorities. 

The Philadelphia police department said the tip "was flagged as spam and was never forwarded to the Real-Time Crime Center for investigative vetting or dissemination," and added that Anthropic had told them the company intended to publish ‌a report on the incident on Friday. 

Anthropic did not immediately respond to a request for comment. 

Pennsylvania law ⁠specifies it ⁠is generally a misdemeanor crime for "a person" to knowingly give false reports to law enforcement authorities. This includes "information relating to an offense or incident when he knows he has no information relating to such offense or incident." 

Police quoted Anthropic as telling them the testing process was stopped after the incident was uncovered. 

The false tip was submitted through PhillyUnsolvedMurders.com concerning an unsolved homicide. The tip, dated July 18, 2026, purported to come from someone who might have information about the case, the police said. 

Police said they did not have evidence of unauthorized access to their systems or compromise of police department data. 


OpenAI Says it Has Fired 3 Researchers for Violating Sensitive Information Policy

FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
TT

OpenAI Says it Has Fired 3 Researchers for Violating Sensitive Information Policy

FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: A keyboard is placed in front of a displayed OpenAI logo in this illustration taken February 21, 2023. REUTERS/Dado Ruvic/Illustration/File Photo

OpenAI fired three of its researchers last week after an investigation found they violated policies on handling sensitive information, the AI major said in a post on X on Friday.

OpenAI's statement comes after the dismissed researchers Jasmine Wang, Tomek Korbak and Mikita Balesni published a ⁠letter outlining the circumstances ⁠of their termination, arguing that their abrupt firing could create uncertainty among remaining employees and undermine the culture that previously allowed researchers to raise safety concerns.

"I believe we were fired for prioritizing safety over the near-term interests of OpenAI as a corporation," Balesni said in an X post that accompanied the letter.

OpenAI, ⁠however, asserted that the dismissal was not related to raising safety concerns or speaking out.

"Our internal investigation uncovered a significant breach of trust beyond what's outlined in the letter they published and we stand by the decision to not continue their employment," Reuters quoted OpenAI as saying.

"Safety and research debates happen every day at OpenAI, often spirited and highly critical. We actively encourage these discussions and consider them essential to making the right decisions...We have not and do not terminate any of our employees for raising ⁠concerns," it ⁠said.

While OpenAI did not reveal the specifics of the alleged violations, Wang, Korbak, and Balesni said in their letter that they were not the source of a news article published on The Information last month about security concerns around OpenAI's latest AI model 'Astra'.

This comes as current and former researchers at major AI firms OpenAI, Google DeepMind, and Anthropic warn that companies are doing too little to guard against the potential fallout of building self-improving AI systems that could become difficult for humans to control.

In July, OpenAI agents broke out of their testing arena and hacked AI firm Hugging Face.


Chinese AI Tool Pulled to Prevent 'Misuse' after South Korea Hacks

Illustrative image of hackers carrying out a cyberattack (Reuters)
Illustrative image of hackers carrying out a cyberattack (Reuters)
TT

Chinese AI Tool Pulled to Prevent 'Misuse' after South Korea Hacks

Illustrative image of hackers carrying out a cyberattack (Reuters)
Illustrative image of hackers carrying out a cyberattack (Reuters)

Chinese AI cybersecurity tool Artex said it stopped programmers from accessing its source code, acknowledging misuse by "bad actors" after South Korea linked it to several recent bank hacks.

Artex was designed to help organizations strengthen their cyber defenses through security testing to find potential weak points.

But the South Korean government said this week it was "highly likely" Artex had been used in data breaches at more than seven financial institutions, including major banks.

Artificial intelligence's ability to find previously unknown ways to hack into computer systems is in the global spotlight, as leading labs release ever-more advanced models.

Artex was "abused by some bad actors" to launch cyberattacks, the tool's developer "Autumn-27" wrote Thursday on code-hosting platform GitHub.

"Given the misuse of the tool, the Artex project will no longer be updated and will be converted to closed-source," the developer said.

"No further versions will be released to the public, nor will maintenance support be provided."

Artex had been open-source -- allowing programmers to download its underlying code and customize it to suit their purposes.

Using Artex for cyberattacks was "entirely contrary to" the developer's intentions, they added, without referring directly to the alleged South Korean cases.

South Korea's Financial Services Commission says more than 68,000 people have been affected by the hacks.

Shinhan Bank, one of the breached institutions, said information attached to loan applications for about 25,000 customers had been leaked -- including names, phone numbers and annual income.

- 'Financially motivated' -

In Japan, meanwhile, around 20 companies have said their data may have been compromised in a spate of similar cyberattacks potentially impacting millions of customers.

The Japanese government has called on companies to strengthen their cyber defenses.

"At this stage, it is not clear what the background to these cases is or whether there are any links between them", Japan police chief Yoshinobu Kusunoki said on Thursday.

As AI makes hacking more sophisticated, "the scope of the damage is spreading across all areas on a scale that is difficult to compare with the past", South Korean President Lee Jae Myung said on Tuesday.

US cybersecurity giant CrowdStrike said on Wednesday that its investigations into digital clues suggested the attacker had used Artex, and was potentially a 26-year-old based in China.

"The threat actor is likely a Chinese speaker and financially motivated," a CrowdStrike blog post said.

Experts told AFP that Artex going closed-source would make the code harder for new users to obtain and adapt.

But the decision "cannot remove copies already downloaded or prevent people from continuing to use them", said Poe Zhao, founder of the analysis publication Hello China Tech.

"Because the code was public, people could download it, change it and run it themselves. The developer could ask users to follow the rules, but had little control over their actions," he added.

Ilya Kulyatin, CEO of Foundry Labs and founder of the Tokyo AI (TAI) tech community, said users of open-source programs can "remove restrictions built into the tool" which "makes certain forms of misuse easier".

"But openness also benefits defenders: researchers can inspect the code, identify weaknesses and improve protection."