Can AI Make Video Games More Immersive? Some Studios Turn to AI-Fueled NPCs for More Interaction

The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
TT
20

Can AI Make Video Games More Immersive? Some Studios Turn to AI-Fueled NPCs for More Interaction

The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)
The AI (Artificial Intelligence) letters and robot hand are placed on computer motherboard in this illustration taken, June 23, 2023. (Reuters)

For decades, video games have relied on scripted, stilted interactions with non-player characters to help shepherd gamers in their journeys. But as artificial intelligence technology improves, game studios are experimenting with generative AI to help build environments, assist game writers in crafting NPC dialogue and lend video games the improvisational spontaneity once reserved for table-top role-playing games.

In the multiplayer game “Retail Mage,” players help run a magical furniture store and assist customers in hopes of earning a five-star review. As a salesperson — and wizard — they can pick up and examine items or tell the system what they'd like to do with a product, such as deconstruct chairs for parts or tear a page from a book to write a note to a shopper.

A player’s interactions with the shop and NPCs around them — from gameplay mechanics to content and dialogue creation — are fueled by AI rather than a predetermined script to create more options for chatting and using objects in the shop.

“We believe generative AI can unlock a new kind of gameplay where the world is more responsive and more able to meet players at their creativity and the things that they come up with and the stories they want to tell inside a fantasy setting that we create for them,” said Michael Yichao, cofounder of Jam & Tea Studios, which created “Retail Mage.”

The typical NPC experience often leaves something to be desired. Pre-scripted interactions with someone meant to pass along a quest typically come with a handful of chatting options that lead to the same conclusion: players get the information they need and continue on. Game developers and AI companies say that by using generative AI tech, they aim to create a richer experience that allows for more nuanced relationships with the people and worlds that designers build.

Generative AI could also provide more opportunities for players to go off-script and create their own stories if designers can craft environments that feel more alive and can react to players' choices in real-time.

Tech companies continue to develop AI for games, even as developers debate how, and whether, they’ll use AI in their products. Nvidia created its ACE technologies to bring so-called “digital humans” to life with generative AI. Inworld AI provides developers with a platform for generative NPC behavior and dialogue. Gaming company Ubisoft said last year that it uses Ghostwriter, an in-house AI tool, to help write some NPC dialogue without replacing the video game writer.

A report released by the Game Developers Conference in January found that nearly half of developers surveyed said generative AI tools are currently being used in their workplace, with 31% saying they personally use those tools. Developers at indie studios were most likely to use generative AI, with 37% reporting using the tech.

Still, roughly four out of five developers said they worry about the ethical use of AI. Carl Kwoh, Jam & Tea's CEO, said AI should be used responsibly alongside creators to elevate stories — not to replace them.

“That’s always been the goal: How can we use this tool to create an experience that makes players more connected to each other?” said Kwoh, who is also one of the company’s founders. “They can tell stories that they couldn’t tell before.”

Using AI to provide NPCs with endless things to say is “definitely a perk,” Yichao said, but "content without meaning is just endless noise." That's why Jam & Tea uses AI — through Google's Gemma 2 and their own servers in Amazon — to give NPCs the ability to do more than respond, he said. They can look for objects as they’re shopping or respond to other NPCs to add “more life and reactivity than a typically scripted encounter.”

“I’ve watched players turn our shopping experience into a bit of a dating sim as they flirt with customers and then NPCs come up with very realistic responses,” he said. “It’s been really fun to see the game react dynamically to what players bring to the table.”

Demonstrating a conversation with an NPC in the game “Mecha BREAK,” in which players battle war machines, Ike Nnole said that Nvidia has made its AI “humans” respond faster than they previously could by using small language models. Using Nvidia's AI, players can interact with the mechanic, Martel, by asking her to do things like customize the color of a mech machine.

“Typically, a gamer would go through menus to do all this,” Nnole, a senior product marketing manager at Nvidia said. “Now it could be a much more interactive, much quicker experience.”

Artificial Agency, a Canadian AI company, built an engine that allows developers to bring AI into any part of their game — not only NPCs, but also companions and “overseer agents” that can steer a player towards content they’re missing. The AI can also create tutorials to teach players a skill that they are missing so they can have more fun in-game, the company said.

“One way we like to put it is putting a game designer on the shoulder of everyone as they’re playing the game,” said Alex Kearney, cofounder of Artificial Agency. The company’s AI engine can be integrated at any stage of the game development cycle, she said.

Brian Tanner, Artificial Agency's CEO, said scripting every possible outcome of a game can be tedious and difficult to test. Their system allows designers to act more like directors, he said, by telling characters more about their motivation and background.

"These characters can improvise on the spot depending on what’s actually happening in the game,” Tanner said.

It's easy to run into a game's guardrails, Tanner said, where NPCs keep repeating the same phrase regardless of how players interact with them. But as AI continues to evolve, that will change, he added.

“It is truly going to feel like the world’s alive and like everything really reacts to exactly what’s happening," he said. “That’s going to add tremendous realism.”



How Safe Is Signal Messaging App Used by Trump Aides to Share War Plans?

The Signal messaging app logo is seen on a smartphone, in front of the same displayed same logo, in this illustration taken, January 13, 2021. (Reuters)
The Signal messaging app logo is seen on a smartphone, in front of the same displayed same logo, in this illustration taken, January 13, 2021. (Reuters)
TT
20

How Safe Is Signal Messaging App Used by Trump Aides to Share War Plans?

The Signal messaging app logo is seen on a smartphone, in front of the same displayed same logo, in this illustration taken, January 13, 2021. (Reuters)
The Signal messaging app logo is seen on a smartphone, in front of the same displayed same logo, in this illustration taken, January 13, 2021. (Reuters)

Top Trump administration officials used messaging app Signal to share war plans and mistakenly included a journalist in the encrypted chat, spurring calls by Democratic lawmakers for a congressional investigation into the security breach.

Under US law, it can be a crime to mishandle, misuse or abuse classified information, though it is unclear whether those provisions might have been violated in this case.

Below are some of the main facts about Signal:

HOW SAFE IS IT?

Signal is an open-source and fully encrypted messaging service that runs on centralized servers maintained by Signal Messenger.

The only user data it stores on its servers are phone numbers, the date a user joined the service, and the last login information.

Users' contacts, chats and other communications are instead stored on the user's phone, with the possibility of setting the option to automatically delete conversations after a certain amount of time.

The company uses no ads or affiliate marketers, and doesn't track users' data, as stated on its website.

Signal also gives users the possibility to hide their phone number from others and use an additional safety number to verify the safety of their messages, it adds.

Signal does not use US government encryption or that of any other governments, and is not hosted on government servers.

The messaging app has a "stellar reputation and is widely used and trusted in the security community", said Rocky Cole, whose cybersecurity firm iVerify helps protect smartphone users from hackers.

"The risk of discussing highly sensitive national security information on Signal isn't so much that Signal itself is insecure," Cole added.

Actors who pose threats to nation states, he said, "have a demonstrated ability to remotely compromise the entire mobile phone itself. If the phone itself isn't secure, all the Signal messages on that device can be read."

HOW DOES SIGNAL WORK?

Signal is a secure messaging service that uses end-to-end encryption, meaning the service provider cannot access and read private conversations and calls from users on its app, therefore guaranteeing its users' privacy.

Signal's software is available across platforms, both on smartphones and computers, and enables messaging, voice and video calls. A telephone number is necessary to register and create an account.

Unlike other messaging apps, Signal does not track or store user data, and its code is publicly available, so security experts can verify how it works and ensure it remains safe.

Signal President Meredith Whittaker on Tuesday defended the app's security: "Signal is the gold standard in private comms."

She added in a post on X: "WhatsApp licenses Signal’s cryptography to protect message contents for consumer WhatsApp."

WHO FOUNDED SIGNAL?

Signal was founded in 2012 by entrepreneur Moxie Marlinspike and Whittaker, according to the company's website.

In February 2018, Marlinspike alongside WhatsApp co-founder Brian Acton started the non-profit Signal Foundation, which currently oversees the app.

Acton provided an initial funding of $50 million. Acton left WhatsApp in 2017 due to differences around the use of customer data and targeted advertising.

Signal is not tied to any major tech companies and will never be acquired by one, it says on its website.

WHO USES SIGNAL?

Widely used by privacy advocates and political activists, Signal has gone from an exotic messaging app used by dissidents to a whisper network for journalists and media, to a messaging tool for government agencies and organizations.

Signal saw "unprecedented" growth in 2021 after a disputed change in rival WhatsApp's privacy terms, as privacy advocates jumped off WhatsApp on fears users would have to share their data with both Facebook and Instagram.

Reuters lists Signal as one of the tools tipsters can use to share confidential news tips with its journalists, while noting that "no system is 100 percent secure".

Signal's community forum, an unofficial group which states that its administration is composed of Signal employees, also lists the European Commission as a user of the tool. In 2017, the US Senate Sergeant at Arms approved the use of Signal for Senate staff.

"Although Signal is widely regarded as offering very secure communications for consumers due to its end-to-end encryption and because it collects very little user data, it is hard to believe it is suitable for exchanging messages related to national security," said Ben Wood, chief analyst at CCS Insight - alluding to the breach involving top Trump aides discussing plans for military strikes on Yemeni Houthi militants.

Google's message services Google Messages and Google Allo, as well as Meta's Facebook Messenger and WhatsApp, use the Signal Protocol, according to Signal's website.