Can AI Make Video Games More Immersive? Some Studios Turn to AI-Fueled NPCs for More Interaction

The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
TT

Can AI Make Video Games More Immersive? Some Studios Turn to AI-Fueled NPCs for More Interaction

The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)

For decades, video games have relied on scripted, stilted interactions with non-player characters to help shepherd gamers in their journeys. But as artificial intelligence technology improves, game studios are experimenting with generative AI to help build environments, assist game writers in crafting NPC dialogue and lend video games the improvisational spontaneity once reserved for table-top role-playing games.

In the multiplayer game “Retail Mage,” players help run a magical furniture store and assist customers in hopes of earning a five-star review. As a salesperson — and wizard — they can pick up and examine items or tell the system what they'd like to do with a product, such as deconstruct chairs for parts or tear a page from a book to write a note to a shopper.

A player’s interactions with the shop and NPCs around them — from gameplay mechanics to content and dialogue creation — are fueled by AI rather than a predetermined script to create more options for chatting and using objects in the shop.

“We believe generative AI can unlock a new kind of gameplay where the world is more responsive and more able to meet players at their creativity and the things that they come up with and the stories they want to tell inside a fantasy setting that we create for them,” said Michael Yichao, cofounder of Jam & Tea Studios, which created “Retail Mage.”

The typical NPC experience often leaves something to be desired. Pre-scripted interactions with someone meant to pass along a quest typically come with a handful of chatting options that lead to the same conclusion: players get the information they need and continue on. Game developers and AI companies say that by using generative AI tech, they aim to create a richer experience that allows for more nuanced relationships with the people and worlds that designers build.

Generative AI could also provide more opportunities for players to go off-script and create their own stories if designers can craft environments that feel more alive and can react to players' choices in real-time.

Tech companies continue to develop AI for games, even as developers debate how, and whether, they’ll use AI in their products. Nvidia created its ACE technologies to bring so-called “digital humans” to life with generative AI. Inworld AI provides developers with a platform for generative NPC behavior and dialogue. Gaming company Ubisoft said last year that it uses Ghostwriter, an in-house AI tool, to help write some NPC dialogue without replacing the video game writer.

A report released by the Game Developers Conference in January found that nearly half of developers surveyed said generative AI tools are currently being used in their workplace, with 31% saying they personally use those tools. Developers at indie studios were most likely to use generative AI, with 37% reporting using the tech.

Still, roughly four out of five developers said they worry about the ethical use of AI. Carl Kwoh, Jam & Tea's CEO, said AI should be used responsibly alongside creators to elevate stories — not to replace them.

“That’s always been the goal: How can we use this tool to create an experience that makes players more connected to each other?” said Kwoh, who is also one of the company’s founders. “They can tell stories that they couldn’t tell before.”

Using AI to provide NPCs with endless things to say is “definitely a perk,” Yichao said, but "content without meaning is just endless noise." That's why Jam & Tea uses AI — through Google's Gemma 2 and their own servers in Amazon — to give NPCs the ability to do more than respond, he said. They can look for objects as they’re shopping or respond to other NPCs to add “more life and reactivity than a typically scripted encounter.”

“I’ve watched players turn our shopping experience into a bit of a dating sim as they flirt with customers and then NPCs come up with very realistic responses,” he said. “It’s been really fun to see the game react dynamically to what players bring to the table.”

Demonstrating a conversation with an NPC in the game “Mecha BREAK,” in which players battle war machines, Ike Nnole said that Nvidia has made its AI “humans” respond faster than they previously could by using small language models. Using Nvidia's AI, players can interact with the mechanic, Martel, by asking her to do things like customize the color of a mech machine.

“Typically, a gamer would go through menus to do all this,” Nnole, a senior product marketing manager at Nvidia said. “Now it could be a much more interactive, much quicker experience.”

Artificial Agency, a Canadian AI company, built an engine that allows developers to bring AI into any part of their game — not only NPCs, but also companions and “overseer agents” that can steer a player towards content they’re missing. The AI can also create tutorials to teach players a skill that they are missing so they can have more fun in-game, the company said.

“One way we like to put it is putting a game designer on the shoulder of everyone as they’re playing the game,” said Alex Kearney, cofounder of Artificial Agency. The company’s AI engine can be integrated at any stage of the game development cycle, she said.

Brian Tanner, Artificial Agency's CEO, said scripting every possible outcome of a game can be tedious and difficult to test. Their system allows designers to act more like directors, he said, by telling characters more about their motivation and background.

"These characters can improvise on the spot depending on what’s actually happening in the game,” Tanner said.

It's easy to run into a game's guardrails, Tanner said, where NPCs keep repeating the same phrase regardless of how players interact with them. But as AI continues to evolve, that will change, he added.

“It is truly going to feel like the world’s alive and like everything really reacts to exactly what’s happening," he said. “That’s going to add tremendous realism.”



KAUST Scientists Develop AI-Generated Data to Improve Environmental Disaster Tracking

King Abdullah University of Science and Technology (KAUST) logo
King Abdullah University of Science and Technology (KAUST) logo
TT

KAUST Scientists Develop AI-Generated Data to Improve Environmental Disaster Tracking

King Abdullah University of Science and Technology (KAUST) logo
King Abdullah University of Science and Technology (KAUST) logo

King Abdullah University of Science and Technology (KAUST) and SARsatX, a Saudi company specializing in Earth observation technologies, have developed computer-generated data to train deep learning models to predict oil spills.

According to KAUST, validating the use of synthetic data is crucial for monitoring environmental disasters, as early detection and rapid response can significantly reduce the risks of environmental damage.

Dean of the Biological and Environmental Science and Engineering Division at KAUST Dr. Matthew McCabe noted that one of the biggest challenges in environmental applications of artificial intelligence is the shortage of high-quality training data.

He explained that this challenge can be addressed by using deep learning to generate synthetic data from a very small sample of real data and then training predictive AI models on it.

This approach can significantly enhance efforts to protect the marine environment by enabling faster and more reliable monitoring of oil spills while reducing the logistical and environmental challenges associated with data collection.


Uber, Lyft to Test Baidu Robotaxis in UK from Next Year 

A sign of Baidu is pictured at the company's headquarters in Beijing, China March 16, 2023. (Reuters)
A sign of Baidu is pictured at the company's headquarters in Beijing, China March 16, 2023. (Reuters)
TT

Uber, Lyft to Test Baidu Robotaxis in UK from Next Year 

A sign of Baidu is pictured at the company's headquarters in Beijing, China March 16, 2023. (Reuters)
A sign of Baidu is pictured at the company's headquarters in Beijing, China March 16, 2023. (Reuters)

Uber Technologies and Lyft are teaming up with Chinese tech giant Baidu to try out driverless taxis in the UK next year, marking a major step in the global race to commercialize robotaxis.

It highlights how ride-hailing platforms are accelerating autonomous rollout through partnerships, positioning London as an early proving ground for large-scale robotaxi services ‌in Europe.

Lyft, meanwhile, plans ‌to deploy Baidu's ‌autonomous ⁠vehicles in Germany ‌and the UK under its platform, pending regulatory approval. Both companies have abandoned in-house development of autonomous vehicles and now rely on alliances to accelerate adoption.

The partnerships underscore how global robotaxi rollouts are gaining momentum. ⁠Alphabet's Waymo said in October it would start ‌tests in London this ‍month, while Baidu ‍and WeRide have launched operations in the ‍Middle East and Switzerland.

Robotaxis promise safer, greener and more cost-efficient rides, but profitability remains uncertain. Public companies like Pony.ai and WeRide are still loss-making, and analysts warn the economics of expensive fleets could pressure margins ⁠for platforms such as Uber and Lyft.

Analysts have said hybrid networks, mixing robotaxis with human drivers, may be the most viable model to manage demand peaks and pricing.

Lyft completed its $200 million acquisition of European taxi app FreeNow from BMW and Mercedes-Benz in July, marking its first major expansion beyond North America and ‌giving the US ride-hailing firm access to nine countries across Europe.


Italy Fines Apple Nearly 100m Euros over App Privacy Feature

An Apple logo hangs above the entrance to the Apple store on 5th Avenue in the Manhattan borough of New York City, July 21, 2015. REUTERS/Mike Segar/File Photo Purchase Licensing Rights
An Apple logo hangs above the entrance to the Apple store on 5th Avenue in the Manhattan borough of New York City, July 21, 2015. REUTERS/Mike Segar/File Photo Purchase Licensing Rights
TT

Italy Fines Apple Nearly 100m Euros over App Privacy Feature

An Apple logo hangs above the entrance to the Apple store on 5th Avenue in the Manhattan borough of New York City, July 21, 2015. REUTERS/Mike Segar/File Photo Purchase Licensing Rights
An Apple logo hangs above the entrance to the Apple store on 5th Avenue in the Manhattan borough of New York City, July 21, 2015. REUTERS/Mike Segar/File Photo Purchase Licensing Rights

Italy's competition authority said Monday it had fined US tech giant Apple 98 million euros ($115 million) for allegedly abusing its dominant position in the mobile app market.

According to AFP, the AGCM said in a statement that Apple had violated privacy regulations for third-party developers in a market where it "holds a super-dominant position through its App Store".

The body said its investigation had established the "restrictive nature" of the "privacy rules imposed by Apple... on third-party developers of apps distributed through the App Store".

The rules of Apple's App Tracking Transparency (ATT) "are imposed unilaterally and harm the interests of Apple's commercial partners", according to the AGCM statement.

French antitrust authorities earlier this year handed Apple a 150-million euro fine over its app tracking privacy feature.

Authorities elsewhere in Europe have also opened similar probes over ATT, which Apple promotes as a privacy safeguard.

The feature, introduced by Apple in 2021, requires apps to obtain user consent through a pop-up window before tracking their activity across other apps and websites.

If they decline, the app loses access to information on that user which enables ad targeting.

Critics have accused Apple of using the system to promote its own advertising services while restricting competitors.