Japanese Robot to Clock in at a Convenience Store in Test of Retail Automation

Telexistence's shelf-stacking avatar robot, designed to resemble a kangaroo, is seen during a photo opportunity ahead of its unveiling in Tokyo, Japan July 3, 2020. (Reuters)
Telexistence's shelf-stacking avatar robot, designed to resemble a kangaroo, is seen during a photo opportunity ahead of its unveiling in Tokyo, Japan July 3, 2020. (Reuters)
TT
20

Japanese Robot to Clock in at a Convenience Store in Test of Retail Automation

Telexistence's shelf-stacking avatar robot, designed to resemble a kangaroo, is seen during a photo opportunity ahead of its unveiling in Tokyo, Japan July 3, 2020. (Reuters)
Telexistence's shelf-stacking avatar robot, designed to resemble a kangaroo, is seen during a photo opportunity ahead of its unveiling in Tokyo, Japan July 3, 2020. (Reuters)

In August, a robot vaguely resembling a kangaroo will begin stacking sandwiches, drinks and ready meals on shelves at a Japanese convenience store in a test its maker, Telexistence, hopes will help trigger a wave of retail automation.

Following that trial, store operator FamilyMart says it plans to use robot workers at 20 stores around Tokyo by 2022. At first, people will operate them remotely - until the machines’ artificial intelligence (AI) can learn to mimic human movements. Rival convenience store chain Lawson is deploying its first robot in September, according to Telexistence.

“It advances the scope and scale of human existence,” the robot maker’s chief executive, Jin Tomioka, said as he explained how its technology lets people sense and experience places other than where they are.

The idea, dubbed telexistence, was first proposed by the start up’s co-founder, University of Tokyo professor Susumu Tachi, four decades ago.

Their company has received funding from technology investment company Softbank Group and cell phone service operator KDDI in Japan, with overseas investors including European passenger aircraft maker Airbus SE. It dubbed its robot the Model T, a nod to the Ford Motor car that began the era of mass motoring a century ago.

Its quirky design is meant to help shoppers feel at ease because people can feel uncomfortable around robots that look too human.

Escaping factories
Robots are still a rare sight in public. Although they can outperform humans in manufacturing plants built around them, they struggle with simple tasks in more unpredictable urban settings.

Solving that performance problem could help businesses in industrialized nations, particularly those in rapidly ageing Japan, cope with fewer workers. Firms hit by the coronavirus outbreak may also need to operate with fewer people.

Since the outbreak started, hotels, restaurants and even gas and oil companies have contacted Telexistence, Tomioka said.

“It’s difficult to tell now what impact robots might have in restaurants - it could mean fewer people, but it could also create new jobs,” said Niki Harada, an official at Japan’s Restaurant Workers Union.

Using human operators with virtual reality goggles and motion-sensor controls to train its machines slashes the cost of retail robotics compared with complex programming that can cost 10 times more than as the hardware and take months to complete, Telexistence says.

Although FamilyMart will still need humans to control its robots, operators can be anywhere and include people who would not normally work in stores, said Tomohiro Kano, a general manager in charge of franchise development.

“There are about 1.6 million people in Japan, who for various reasons are not active in the workforce,” he said.

Future telexistence robots could also be used in hospitals so doctors could perform operations from remote locations, predicted Professor Takeo Kanade, an AI and robotics scientist at Carnegie Mellon University in the United States, who joined Telexistence in February as an adviser.

It might take another 20 years before robots can work in people’s homes, however, he said.

“In order for robots to be really usable at home we really have to be able to communicate. The fundamental thing that is lacking is knowing how humans behave.”



Video Game Actors Are Voting on a New Contract. Here’s What It Means for AI in Gaming

A picketer holds a sign for the SAG-AFTRA video game strike at Warner Bros. Games headquarters on Aug. 1, 2024, in Burbank, Calif. (AP)
A picketer holds a sign for the SAG-AFTRA video game strike at Warner Bros. Games headquarters on Aug. 1, 2024, in Burbank, Calif. (AP)
TT
20

Video Game Actors Are Voting on a New Contract. Here’s What It Means for AI in Gaming

A picketer holds a sign for the SAG-AFTRA video game strike at Warner Bros. Games headquarters on Aug. 1, 2024, in Burbank, Calif. (AP)
A picketer holds a sign for the SAG-AFTRA video game strike at Warner Bros. Games headquarters on Aug. 1, 2024, in Burbank, Calif. (AP)

An 11-month strike by video game performers could formally end this week if members ratify a deal that delivers pay raises, control over their likenesses and artificial intelligence protections.

The agreement feels "like diamond amounts of pressure suddenly lifted," said Sarah Elmaleh, a voice actor and chair of the Screen Actors Guild-American Federation of Television and Radio Artists' interactive branch negotiating committee.

Union members have until Wednesday at 5 p.m. Pacific to vote on ratifying the tentative agreement.

Voice and body performers for video games raised concerns that unregulated use of AI could displace them and threaten their artistic autonomy.

"It’s obviously far from resolved," Elmaleh said. "But the idea that that we’re in a zone where we might have concluded this feels like a lightening and a relief."

AI concerns are especially dire in the video game industry, where human performers infuse characters with distinctive movements, shrieks, falls and plot-twisting dialogue.

"I hope and I believe that our members, when they look back on this, will say all of the sacrifices and difficulty we put ourselves through to achieve this agreement will ultimately be worth it because we do have the key elements that we need to feel confident and moving forward in this business," said Duncan Crabtree-Ireland, the SAG-AFTRA national executive director and chief negotiator.

Here’s a look at the contract currently up for vote, and what it means for the future of the video game industry.

How did the current strike play out? Video game performers went on strike last July following nearly two years of failed negotiations with major game studios, as both sides remained split over generative AI regulations.

More than 160 games signed interim agreements accepting AI provisions SAG-AFTRA was seeking, the union said, which allowed some work to continue.

The video game industry is a massive global industry, generating an estimated $187 billion in 2024, according to game market forecaster Newzoo.

"OD," and "Physint" were two games delayed due to the strike during the filming and casting stage, video game developer Hideo Kojima wrote in December. Riot Games, a video game developer, announced that same month that some new skins in "League of Legends" would have to use existing voice-overs, since new content couldn't be recorded by striking actors. Skins are cosmetic items that can change the visual appearance of a player and is sometimes equipped with new voice-overs and unique recorded lines.

The proposed contract "builds on three decades of successful partnership between the interactive entertainment industry and the union" to deliver "historic wage increases" and "industry-leading AI provisions," wrote Audrey Cooling, a spokesperson for the video game producers involved in the deal.

"We look forward to continuing to work with performers to create new and engaging entertainment experiences for billions of players throughout the world," Cooling wrote.

Video game performers had previously gone on strike in October 2016, with a tentative deal reached 11 months later. That strike helped secure a bonus compensation structure for voice actors and performance capture artists. The agreement was ratified with 90% support, with 10% of members voting.

The proposed contract secures an increase in performer compensation of just over 15% upon ratification and an additional 3% increase each year of the three-year contract.

How would AI use change in video games? AI concerns have taken center stage as industries across various sectors attempt to keep up with the fast-evolving technology. It’s a fight that Hollywood writers and actors undertook during the historic film and TV strikes that forced the industry to a stop in 2023.

"In the last few years, it’s become obvious that we are at an inflection point where rules of the road have to be set for AI, and if they aren’t, the consequences are potentially very serious," Crabtree-Ireland said. "I think that really made this negotiation extra important for all of us."

SAG-AFTRA leaders have billed the issues behind the labor dispute — and AI in particular — as an existential crisis for performers. Game voice actors and motion capture artists’ likenesses, they say, could be replicated by AI and used without their consent and without fair compensation.

The proposed contract delineates clear restrictions on when and how video game companies can create digital replicas, which use AI to generate new performances that weren't recorded by an actor.

Employers must obtain written permission from a performer to create a digital replica — consent which must be granted during the performer’s lifetime and is valid after death unless otherwise limited, the contract states. The time spent creating a digital replica will be compensated as the same amount of work time it would have required for a new performance.

The agreement also requires the employer to provide the performer with a usage report that details how the replica was used and calculates the expected compensation.

Elmaleh, who has been voice acting since 2010 and had to turn down projects throughout the strike, said securing these gains required voice actors bring vulnerability and openness to the bargaining table.

"We talked a lot about the personal, the way it affects our displacement as workers and just the sustainability of our careers," Elmaleh said. "Our work involves your inner child. It’s being very vulnerable, it’s being playful."

What’s next for the video game industry? The tentative agreement centers on consent, compensation and transparency, which union leaders say are key elements needed for the industry to keep progressing.

As the contract is considered by union members, Elmaleh and Crabtree-Ireland said further work needs to be done to ensure the provisions are as broad as necessary.

"Even though there’s a deal that’s been made now, and we’ve locked in a lot of really crucial protections and guardrails, the things that we haven’t been able to achieve yet, we’re going to be continuing to fight for them," Crabtree-Ireland said. "Every time these contracts expire is our chance to improve upon them."

Elmaleh said she hopes both the video game companies and performers can soon work collaboratively to develop guidelines on AI as the technology evolves — a process she said should start well the proposed contract would expire in October 2028.

Leading negotiations has felt like a full-time job for Elmaleh, who took on the role in a volunteer capacity. As the efforts die down, she said she anxiously anticipates returning to video game acting in a landscape that is safer for performers.

Voice acting "is core to who I am. It’s why I fought so hard for this. I wouldn’t do this if I didn’t love what I do so much. I think it’s so special and worthy of protection," she said.