Less Lost in Translation: Foreigners Get High-Tech Help in Tokyo’s Baffling Shinjuku Rail Hub 

French tourists Marc and Isabelle Rigaud use an automated translation window at the Seibu-Shinjuku station in Tokyo, Japan, July 26, 2023. (Reuters)
French tourists Marc and Isabelle Rigaud use an automated translation window at the Seibu-Shinjuku station in Tokyo, Japan, July 26, 2023. (Reuters)
TT

Less Lost in Translation: Foreigners Get High-Tech Help in Tokyo’s Baffling Shinjuku Rail Hub 

French tourists Marc and Isabelle Rigaud use an automated translation window at the Seibu-Shinjuku station in Tokyo, Japan, July 26, 2023. (Reuters)
French tourists Marc and Isabelle Rigaud use an automated translation window at the Seibu-Shinjuku station in Tokyo, Japan, July 26, 2023. (Reuters)

As Japan enjoys a post-pandemic resurgence in tourism from around the globe, Seibu Railway is testing out an automated translation window to help confused foreigners navigate one of Tokyo's most complex transportation hubs.

The device, developed by printing company Toppan and called VoiceBiz, lets customers speak to a station attendant over microphones while the semi-transparent screen between them spells out their words in Japanese and one of 11 other languages.

More than 2 million visitors arrived in Japan last month, the most since the pandemic kicked off in 2019, and travelers from the United States and Europe exceeded pre-outbreak levels as the weak yen makes the trip the cheapest in decades.

Kevin Khani was among foreign travelers who got turned around in the Seibu-Shinjuku station recently and found the VoiceBiz window helpful.

"The translations were spot on," said the 30-year-old German, who works at Alibaba. "It might sound a bit weird, but you feel safe immediately because you know there's a human on the other side. So you take your time to explain what you need and you will know that they will understand what you need."

Seibu Railway, a unit of the Seibu Holdings conglomerate, installed the translation window this month at its Seibu-Shinjuku station, the terminus of one of its central Tokyo lines, for a three-month trial before considering a wider rollout.

About 135,000 passengers pass through the station daily, including many foreigners shuttling between tourist hot spots, such as Tokyo's new Harry Potter theme park.

"Our goal in introducing this was to improve the smoothness of communication by letting people look at each other's face," said Ayano Yajima, a sales and marketing supervisor at Seibu Railway.

The device was also tested out at Kansai International Airport earlier this year, and Toppan has aims to sell it to businesses and government offices in Japan to contend with both foreign travelers and an ever-growing number of immigrants.

With its many rail lines - some connected, some not - and gigantic bus station, Shinjuku district is the ultimate testing ground for way-finding tech.

Across the road from the Seibu station is Shinjuku's central Japan Railway (JR) station, which is the busiest in the world, with some 3.6 million people passing through daily. A rabbit warren of tunnels connects the JR station to multiple train and subway lines run by other companies.

Weary from a 1 a.m. flight arrival, French tourists Isabelle and Marc Rigaud used the translation window to try to find their way from the Seibu station to the JR station. They still needed help from a bystander to get there.

"It's very Japan," Isabelle, 47, said.



OpenAI Unveils 'Operator' Agent that Handles Web Tasks

OpenAI says its new artificial intelligence agent capable of tending to online tasks is trained to check with users when it encounters CAPTCHA puzzles intended to distinguish people from software. Kirill KUDRYAVTSEV / AFP
OpenAI says its new artificial intelligence agent capable of tending to online tasks is trained to check with users when it encounters CAPTCHA puzzles intended to distinguish people from software. Kirill KUDRYAVTSEV / AFP
TT

OpenAI Unveils 'Operator' Agent that Handles Web Tasks

OpenAI says its new artificial intelligence agent capable of tending to online tasks is trained to check with users when it encounters CAPTCHA puzzles intended to distinguish people from software. Kirill KUDRYAVTSEV / AFP
OpenAI says its new artificial intelligence agent capable of tending to online tasks is trained to check with users when it encounters CAPTCHA puzzles intended to distinguish people from software. Kirill KUDRYAVTSEV / AFP

OpenAI on Thursday introduced an artificial intelligence program called "Operator" that can tend to online tasks such as ordering items or filling out forms.

Operator can look up web pages and interact with them by typing, clicking, or scrolling the way a person might, according to OpenAI, said AFP.

"Operator can be asked to handle a wide variety of repetitive browser tasks such as filling out forms, ordering groceries, and even creating memes," OpenAI said in an online post.

"The ability to use the same interfaces and tools that humans interact with on a daily basis broadens the utility of AI, helping people save time on everyday tasks while opening up new engagement opportunities for businesses."

An AI "agent," the latest Silicon Valley trend, is a digital helper that is supposed to sense surroundings, make decisions, and take actions to achieve specific goals.

Google in December announced agent capabilities with the launch of Gemini 2.0, its most advanced artificial intelligence model to date.

AI race rival Anthropic two months earlier added a "computer use" feature to its Claude frontier AI model in an experimental public beta phase.

"Developers can direct Claude to use computers the way people do—by looking at a screen, moving a cursor, clicking buttons, and typing text," Anthropic said in a post at the time, cautioning that it was a work in progress.

OpenAI described Operator as one of its first AI agents capable of doing work for people independently, designed to complete tasks it is given.

Operator is available only to US users who pay for Pro subscriptions to the OpenAI service "to ensure a safe and iterative rollout," OpenAI said.

"If it encounters challenges or makes mistakes, Operator can leverage its reasoning capabilities to self-correct," OpenAI said.

"When it gets stuck and needs assistance, it simply hands control back to the user."

Operator is trained to ask the user to take over for tasks that require login, payment details, or when solving "CAPTCHA" security challenges intended to distinguish between people and software online, according to OpenAI.

"Users can have Operator run multiple tasks simultaneously by creating new conversations, like ordering a personalized enamel mug on Etsy while booking a campsite on Hipcamp," OpenAI said.