Firms and Researchers at Odds over Superhuman AI

Three-quarters of respondents to a survey by the US-based Association for the Advancement of Artificial Intelligence agreed that 'scaling up' LLMs was unlikely to produce artificial general intelligence. Joe Klamar / AFP/File
Three-quarters of respondents to a survey by the US-based Association for the Advancement of Artificial Intelligence agreed that 'scaling up' LLMs was unlikely to produce artificial general intelligence. Joe Klamar / AFP/File
TT
20

Firms and Researchers at Odds over Superhuman AI

Three-quarters of respondents to a survey by the US-based Association for the Advancement of Artificial Intelligence agreed that 'scaling up' LLMs was unlikely to produce artificial general intelligence. Joe Klamar / AFP/File
Three-quarters of respondents to a survey by the US-based Association for the Advancement of Artificial Intelligence agreed that 'scaling up' LLMs was unlikely to produce artificial general intelligence. Joe Klamar / AFP/File

Hype is growing from leaders of major AI companies that "strong" computer intelligence will imminently outstrip humans, but many researchers in the field see the claims as marketing spin.

The belief that human-or-better intelligence -- often called "artificial general intelligence" (AGI) -- will emerge from current machine-learning techniques fuels hypotheses for the future ranging from machine-delivered hyperabundance to human extinction, AFP said.

"Systems that start to point to AGI are coming into view," OpenAI chief Sam Altman wrote in a blog post last month. Anthropic's Dario Amodei has said the milestone "could come as early as 2026".

Such predictions help justify the hundreds of billions of dollars being poured into computing hardware and the energy supplies to run it.

Others, though are more skeptical.

Meta's chief AI scientist Yann LeCun told AFP last month that "we are not going to get to human-level AI by just scaling up LLMs" -- the large language models behind current systems like ChatGPT or Claude.

LeCun's view appears backed by a majority of academics in the field.

Over three-quarters of respondents to a recent survey by the US-based Association for the Advancement of Artificial Intelligence (AAAI) agreed that "scaling up current approaches" was unlikely to produce AGI.

'Genie out of the bottle'

Some academics believe that many of the companies' claims, which bosses have at times flanked with warnings about AGI's dangers for mankind, are a strategy to capture attention.

Businesses have "made these big investments, and they have to pay off," said Kristian Kersting, a leading researcher at the Technical University of Darmstadt in Germany and AAAI member.

"They just say, 'this is so dangerous that only I can operate it, in fact I myself am afraid but we've already let the genie out of the bottle, so I'm going to sacrifice myself on your behalf -- but then you're dependent on me'."

Skepticism among academic researchers is not total, with prominent figures like Nobel-winning physicist Geoffrey Hinton or 2018 Turing Prize winner Yoshua Bengio warning about dangers from powerful AI.

"It's a bit like Goethe's 'The Sorcerer's Apprentice', you have something you suddenly can't control any more," Kersting said -- referring to a poem in which a would-be sorcerer loses control of a broom he has enchanted to do his chores.

A similar, more recent thought experiment is the "paperclip maximiser".

This imagined AI would pursue its goal of making paperclips so single-mindedly that it would turn Earth and ultimately all matter in the universe into paperclips or paperclip-making machines -- having first got rid of human beings that it judged might hinder its progress by switching it off.

While not "evil" as such, the maximiser would fall fatally short on what thinkers in the field call "alignment" of AI with human objectives and values.

Kersting said he "can understand" such fears -- while suggesting that "human intelligence, its diversity and quality is so outstanding that it will take a long time, if ever" for computers to match it.

He is far more concerned with near-term harms from already-existing AI, such as discrimination in cases where it interacts with humans.

'Biggest thing ever'

The apparently stark gulf in outlook between academics and AI industry leaders may simply reflect people's attitudes as they pick a career path, suggested Sean O hEigeartaigh, director of the AI: Futures and Responsibility program at Britain's Cambridge University.

"If you are very optimistic about how powerful the present techniques are, you're probably more likely to go and work at one of the companies that's putting a lot of resource into trying to make it happen," he said.

Even if Altman and Amodei may be "quite optimistic" about rapid timescales and AGI emerges much later, "we should be thinking about this and taking it seriously, because it would be the biggest thing that would ever happen," O hEigeartaigh added.

"If it were anything else... a chance that aliens would arrive by 2030 or that there'd be another giant pandemic or something, we'd put some time into planning for it".

The challenge can lie in communicating these ideas to politicians and the public.

Talk of super-AI "does instantly create this sort of immune reaction... it sounds like science fiction," O hEigeartaigh said.



Analysts Warn US Could Be Handing Chip Market to China

A smartphone with a displayed AMD logo is placed on a computer motherboard in this illustration taken March 6, 2023. (Reuters)
A smartphone with a displayed AMD logo is placed on a computer motherboard in this illustration taken March 6, 2023. (Reuters)
TT
20

Analysts Warn US Could Be Handing Chip Market to China

A smartphone with a displayed AMD logo is placed on a computer motherboard in this illustration taken March 6, 2023. (Reuters)
A smartphone with a displayed AMD logo is placed on a computer motherboard in this illustration taken March 6, 2023. (Reuters)

As the Trump administration attempts to choke off exports of strategically important computer chips to China, experts say the effort might well backfire, fueling innovation at Chinese firms that could help them seize the world semiconductor market.

"What's actually happening is that the US government right now is handing China a big win as it tries to get their own chip business going," said Jack Gold, principal analyst at J.Gold associates.

"Once they're competitive," he told AFP, "they'll start selling around the world and people will buy their chips."

When that happens, he added, it will be difficult for US chip makers to reclaim lost market share.

Silicon Valley semiconductor star Nvidia and its US rival Advanced Micro Devices (AMD) expect big financial hits from new US licensing requirements for semiconductors exported to China, they notified regulators this week.

Nvidia expects the new rules to cost it $5.5 billion, while AMD forecast it could sap as much as $800 million from the company's bottom line, according to filings with the US Securities and Exchange Commission (SEC).

Administration officials told Nvidia it must obtain licenses to export its H20 chips to China because of concerns they may be used in supercomputers there, the company said.

The United States had already restricted exports to China, the world's biggest buyer of chips, of Nvidia's most sophisticated graphics processing units (GPUs), designed to power top-end artificial intelligence models.

Nvidia essentially developed the H20 chip for the Chinese market, aiming to maximize performance while meeting previous US export rules, but the new licensing requirements pose a roadblock, according to Gold.

For AMD, the new US export control measure applies to its MI308 GPUs, which are designed for high-performance applications like gaming and artificial intelligence, it said in a filing.

It noted that there are no guarantee licenses for sales to China will be granted.

- Opportunity for China? -

Independent tech analyst Rob Enderle predicted Chinese chip makers -- likely led by the huge Huawei corporation -- will ramp up efforts to snatch the lead in the market.

"It's going to be a godsend for China as they spin up their own microprocessor business," Enderle said of the tightened US export rules.

"This will be a really quick way to hand over US leadership in microprocessors and GPUs."

The Chinese government has ample resources and motivation to bolster its chip industry, according to Gold.

He said while US President Donald Trump might think he can "bully people" to achieve his objectives, "the worldwide economy is not like that."

Instead, Trump's tariffs have alienated allies, increasing their incentive to turn to China for chips, the analyst said.

"Across the board, this is going to create real problems for US companies competitively," Enderle said.

"Companies located overseas are suddenly going to be in much better shape to compete."

Nvidia chief executive Jensen Huang has said publicly that the AI chip powerhouse can comply with the new US requirements without sacrificing technological progress, adding that nothing will stop the global advancement of artificial intelligence.

"Nvidia is one of the most important pieces in this (US) chess game with China," Wedbush analyst Dan Ives said in a note to investors.

"The Trump administration knows there is one chip and company fueling the AI Revolution and it's Nvidia," he said, and so it placed "a 'Do Not Enter' sign in front of China" to slow its progress.

Ives warned, however, that the chip wars are not over. He expects "more punches to be thrown by both sides."