AI No Better Than Other Methods for Patients Seeking Medical Advice, Study Shows

AI (Artificial Intelligence) letters and a robot hand are placed on a computer motherboard in this illustration created on June 23, 2023. (Reuters)
AI (Artificial Intelligence) letters and a robot hand are placed on a computer motherboard in this illustration created on June 23, 2023. (Reuters)
TT

AI No Better Than Other Methods for Patients Seeking Medical Advice, Study Shows

AI (Artificial Intelligence) letters and a robot hand are placed on a computer motherboard in this illustration created on June 23, 2023. (Reuters)
AI (Artificial Intelligence) letters and a robot hand are placed on a computer motherboard in this illustration created on June 23, 2023. (Reuters)

Asking AI about medical symptoms does not help patients make better decisions about their health than other methods, such as a standard internet search, according to a new study published in Nature Medicine.

The authors said the study was important as people were increasingly turning to AI and chatbots for advice on their health, but without evidence that this was necessarily the best and safest approach.

Researchers led by the University of Oxford’s Internet Institute worked alongside a group of doctors to draw up 10 different medical scenarios, ranging from a common cold to a life-threatening hemorrhage causing bleeding on the brain.

When tested without human participants, three large-language models – Open AI's Chat GPT-4o, ‌Meta's Llama ‌3 and Cohere's Command R+ – identified the conditions in ‌94.9% ⁠of cases, ‌and chose the correct course of action, like calling an ambulance or going to the doctor, in an average of 56.3% of cases. The companies did not respond to requests for comment.

'HUGE GAP' BETWEEN AI'S POTENTIAL AND ACTUAL PERFORMANCE

The researchers then recruited 1,298 participants in Britain to either use AI, or their usual resources like an internet search, or their experience, or the National Health Service website to ⁠investigate the symptoms and decide their next step.

When the participants did this, relevant conditions were identified in ‌less than 34.5% of cases, and the right ‍course of action was given in ‍less than 44.2%, no better than the control group using more traditional ‍tools.

Adam Mahdi, co-author of the paper and associate professor at Oxford, said the study showed the “huge gap” between the potential of AI and the pitfalls when it was used by people.

“The knowledge may be in those bots; however, this knowledge doesn’t always translate when interacting with humans,” he said, meaning that more work was needed to identify why this was happening.

HUMANS OFTEN GIVING INCOMPLETE INFORMATION

The ⁠team studied around 30 of the interactions in detail, and concluded that often humans were providing incomplete or wrong information, but the LLMs were also sometimes generating misleading or incorrect responses.

For example, one patient reporting the symptoms of a subarachnoid hemorrhage – a life-threatening condition causing bleeding on the brain – was correctly told by AI to go to hospital after describing a stiff neck, light sensitivity and the "worst headache ever". The other described the same symptoms but a "terrible" headache, and was told to lie down in a darkened room.

The team now plans a similar study in different countries and languages, and over time, to test if that impacts AI’s performance.

The ‌study was supported by the data company Prolific, the German non-profit Dieter Schwarz Stiftung, and the UK and US governments.



US Seeks Answers on Nvidia’s Sale of Chips to China, Bessent Says

US Treasury Secretary Scott Bessent testifies during a House Financial Services Committee hearing on the state of the international financial system on Capitol Hill in Washington, DC, on September 15, 2026. (AFP)
US Treasury Secretary Scott Bessent testifies during a House Financial Services Committee hearing on the state of the international financial system on Capitol Hill in Washington, DC, on September 15, 2026. (AFP)
TT

US Seeks Answers on Nvidia’s Sale of Chips to China, Bessent Says

US Treasury Secretary Scott Bessent testifies during a House Financial Services Committee hearing on the state of the international financial system on Capitol Hill in Washington, DC, on September 15, 2026. (AFP)
US Treasury Secretary Scott Bessent testifies during a House Financial Services Committee hearing on the state of the international financial system on Capitol Hill in Washington, DC, on September 15, 2026. (AFP)

US Treasury Secretary Scott Bessent said on Sunday that the Trump administration still needs information on Nvidia's chip sales and ‌will find ‌out who led ‌compliance ⁠at the company ⁠formerly led by Jensen Huang, who resigned following an affair with a ⁠suspected Chinese spy.

"We've ‌been ‌in touch ‌with the temporary ‌management, with the lead directors, with their lawyers, and we ‌do need answers... it behooves Nvidia ⁠to ⁠move quickly on this because we want to know what the culture was," Bessent told CBS' "Face the Nation" program.


Defense, AI, High Tech: A Delicate Balance Between Armies and Industry

Activists from the Campaign to Stop Killer Robots, a coalition of non-governmental organizations opposing lethal autonomous weapons or so-called "killer robots", stage a protest at Brandenburg Gate in Berlin, Germany, March, 21, 2019. (Reuters)
Activists from the Campaign to Stop Killer Robots, a coalition of non-governmental organizations opposing lethal autonomous weapons or so-called "killer robots", stage a protest at Brandenburg Gate in Berlin, Germany, March, 21, 2019. (Reuters)
TT

Defense, AI, High Tech: A Delicate Balance Between Armies and Industry

Activists from the Campaign to Stop Killer Robots, a coalition of non-governmental organizations opposing lethal autonomous weapons or so-called "killer robots", stage a protest at Brandenburg Gate in Berlin, Germany, March, 21, 2019. (Reuters)
Activists from the Campaign to Stop Killer Robots, a coalition of non-governmental organizations opposing lethal autonomous weapons or so-called "killer robots", stage a protest at Brandenburg Gate in Berlin, Germany, March, 21, 2019. (Reuters)

The rapid integration of high tech and artificial intelligence into the armed forces presents a tricky dilemma: entrusting part of their future to private companies while risking their sovereignty.

On one side are digital and mission-critical technology specialists driven by market forces and controlled by private capital demanding profits, independent from any political control.

On the other are military leaders who answer only to political authority and are obsessed with strategy, hierarchy and the sacrosanct nature of defense secrecy.

Between them is the race to connect the battlefield, from troop coordination to real-time terrain analysis, generating terabits of data which can decide a war's outcome and the fate of many lives.

Beyond the even more complex issue of so-called killer robots, one example sums up the defense challenge: the civilian Starlink satellite network and its military counterpart, Starshield, which Ukraine desperately needs.

Since Russia's invasion in 2022, Kyiv has faced restrictions on access to Starshield, owned by Elon Musk's SpaceX, leaving a Sword of Damocles hanging over Ukraine's armed forces.

Musk has shifted his stance on Ukraine many times, insisting any disruption was the responsibility of Washington, not SpaceX.

- 'A fine line' -

The issue loomed over NATO Edge this week, a three-day conference on critical technologies and digital warfare where military chiefs, government officials and defense experts from NATO's 32 member states and Ukraine gathered in Izmir, Türkiye.

"This is a difficult issue, one many ministries of defense are grappling with," analyst Tom Barton with intelligence firm Janes told AFP.

For companies "to deliver the so-called 'networked battlefield', some access ideally needs to be given" to confidential data, he explained.

"From space to land-based sensors and military communications, defense establishments are experimenting with standalone exercises and varying levels of trust and access."

But militaries -- without safeguards -- cannot entrust their fate to developers, who are often focused primarily on civilian needs.

"There is a lot of push or advocacy for military and government to have a closer relationship with industry," a US company representative told AFP on condition of anonymity.

"But there's a fine line. You turn on the news and you see Elon Musk doing shit in Ukraine like slowing down the internet," he fumed.

With boundaries constantly shifting, military leaders have little choice but to compromise.

"You don't need to be 100 percent sovereign, but sovereign enough," he explained.

- Trust -

For Major General Rainer Beeck, one of NATO's top cyberspace commanders, it is "a hard nut to crack".

"You have to make choices about which classification you make, for which data... The problem is the trust," he said.

Admiral Pierre Vandier, NATO's Supreme Allied Commander Transformation (SACT), likewise insisted that "trust ... is the most important thing".

"Trust in architecture, in data sharing, in AI agents, in decision-making tools," he said.

"We need to close the fighter-factory gap. Ukraine did it."

Nearly five years of war have given Kyiv more experience than anyone else in NATO.

The dynamics also vary according to the size of national defense budgets.

For large powers, "data collection is not the problem... If war would start, we would get (it). The problem then is it's too late to organize," Beeck said, calling for a more proactive approach.

Smaller governments need "to build up their capacity", said Mitch Free, vice president of international government at Vantor, which provides satellite imagery for defense and intelligence agencies.

Many may only own a handful of satellites and must weigh their intelligence value against the cost of building and operating them.

"This is where commercial... helps fill the gap," he said.

Ultimately, the real debate is about the best way to use AI.

"The bottleneck is often not technology, but permission: classification boundaries, national rules and trust decisions," said Jean-Charles Ellermann-Kingombe, NATO's cyber and digital transformation chief.

The alliance must make "AI adoption possible at scale", with these capabilities "secure, interoperable and deployable within NATO's infrastructure... by personnel who understand their value and their limitations", he added.


Nvidia Faces US Accounting Probe amid Deepening Turmoil

FILE PHOTO: A silhouette of Jensen Huang, NVIDIA logo and decreasing stock graph are seen in this vertical illustration created on November 12, 2026. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: A silhouette of Jensen Huang, NVIDIA logo and decreasing stock graph are seen in this vertical illustration created on November 12, 2026. REUTERS/Dado Ruvic/Illustration/File Photo
TT

Nvidia Faces US Accounting Probe amid Deepening Turmoil

FILE PHOTO: A silhouette of Jensen Huang, NVIDIA logo and decreasing stock graph are seen in this vertical illustration created on November 12, 2026. REUTERS/Dado Ruvic/Illustration/File Photo
FILE PHOTO: A silhouette of Jensen Huang, NVIDIA logo and decreasing stock graph are seen in this vertical illustration created on November 12, 2026. REUTERS/Dado Ruvic/Illustration/File Photo

US securities regulators are investigating the accounting practices of Nvidia, according to US media, adding to the turmoil engulfing the artificial intelligence chip giant following the resignation of its chief executive.

The Securities and Exchange Commission (SEC) inquiry is in its early stages, The New York Times reported Saturday, citing people briefed on the confidential investigation.

The Wall Street Journal reported on the investigation earlier this week, although it was unable to establish its precise focus. The probe could end without any charges being brought against the company.

Questions about Nvidia's financial disclosures have intensified amid scrutiny of its dealings with Megaspeed, a Singapore-based company investigated by American authorities over suspected shipments of restricted AI chips to China.

Nvidia last year changed how it reported sales by geographical location, switching from customers' billing addresses to the countries where they are headquartered, US media reported.

The change removed Singapore from its geographical breakdown, despite the company's significant business there.

It remains unclear whether the SEC investigation is connected to those accounting changes or to the scandal surrounding former chief executive Jensen Huang.

Huang resigned earlier this month following revelations of extramarital affairs, including with Alice Huang, a former Megaspeed executive suspected by US intelligence of working for Beijing.

China has denied the espionage allegations, while Megaspeed has maintained that it operates lawfully.

Nvidia's board has appointed former chief financial officer Colette Kress as interim CEO and launched an investigation into the circumstances surrounding Huang's departure.

The upheaval has shaken investor confidence in one of the world's most valuable companies, whose advanced semiconductors have been central to the global AI boom.

Nvidia shares plunged 14 percent on Friday, bringing their losses for the week to more than 20 percent.

US President Donald Trump nevertheless called Friday for Huang to be reinstated.

"I think that I would love to see Jensen be given a second chance," Trump told reporters.

But Nvidia Chairman Harvey Jones has ruled out his return, saying board directors unanimously accepted his resignation.