Microsoft Revamps AI Copilot with New Voice, Reasoning Capabilities

Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
TT

Microsoft Revamps AI Copilot with New Voice, Reasoning Capabilities

Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)

Microsoft has given its consumer Copilot, an artificial intelligence assistant, a more amiable voice in its latest update, with the chatbot also capable of analyzing web pages for interested users as they browse.

The US software maker now has "an entire army" of creative directors - among them psychologists, novelists and comedians - finessing the tone and style of Copilot to distinguish it, Mustafa Suleyman, chief executive of Microsoft AI, told Reuters in an interview.

In one demonstration of the updated Copilot, a consumer asked what housewarming gift to buy at a grocery store for a friend who did not drink wine. After some back-and-forth, Copilot said aloud: "Italian (olive) oils are the hot stuff right now. Tuscan's my go-to. Super peppery."

The feature rollout, starting Tuesday, is one of the first that Suleyman has overseen since Microsoft created his division in March to focus on consumer products and technology research.

Long identified with business software, Microsoft has had a much harder road in the consumer realm. Its Bing search engine, for instance, is still dwarfed by Google.

Suleyman is hoping for a bigger splash with Copilot, which launched last year in a crowded field of AI chatbots, including OpenAI's ChatGPT and Google's Gemini.

Copilot's newly fashioned voice capabilities make it seem much more of an active listener, giving verbal cues like "cool" and "huh," Suleyman said.

Underlying the product are Microsoft AI, or "MAI," models, plus a technology suite from partner OpenAI, Suleyman said.

Suleyman added that consumers who spend $20 monthly for Copilot Pro can start testing a "Think Deeper" feature that reasons through choices, like whether to move to one city or another.

He said an additional test feature for paying subscribers, Copilot Vision, amounts to "digital pointing" - the ability for users to talk to AI about what they see in a Microsoft Edge browser. Consumers have to opt in, and the content they view will not be saved or used to train AI, Microsoft said.

These updates represent "glimmers" of AI that can be an "ever-present confidant, in your corner," Suleyman said. It's a vision he articulated as CEO of Inflection AI, whose top talent Microsoft poached in a closely watched deal this year.

Suleyman said that eventually, Copilot will learn context from consumers' Word documents, Windows desktops, even their gaming consoles if they grant permission.

Asked what Bill Gates, Microsoft's co-founder, thinks of the company's AI efforts, Suleyman said Gates was excited.

"He's always asking me about when Copilot can read and parse his emails. It's one of his favorite ones," Suleyman said. "We're on the case."



Meta Unveils Cheaper VR Headset, AI Updates and Shows off Prototype for Holographic AR Glasses

Meta CEO Mark Zuckerberg wearing glasses (Reuters).
Meta CEO Mark Zuckerberg wearing glasses (Reuters).
TT

Meta Unveils Cheaper VR Headset, AI Updates and Shows off Prototype for Holographic AR Glasses

Meta CEO Mark Zuckerberg wearing glasses (Reuters).
Meta CEO Mark Zuckerberg wearing glasses (Reuters).

Meta unveiled updates to the company's virtual reality headset and Ray Ban smart glasses on Wednesday as it tries to demonstrate its artificial intelligence prowess and the next generation of computing platforms beyond smartphones and computers.
CEO Mark Zuckerberg also showed off Orion, a prototype he called “the most advanced glasses the world has ever seen.”
“The technical challenges to make them are insane,” Zuckerberg told a crowd of developers and journalists at Meta's Menlo Park, California, headquarters. The holographic augmented reality glasses, for one, needed to be glasses — not a bulky headset. There are no wires and they have to weigh less than 100 grams (3.5 ounces), among other things. And beyond interacting with your voice, typing or hand gestures, Orion has a “wrist-based neural interface” — it lets you send a signal from your brain to the device, using a wristband that translates nerve signals into digital commands.
There is no release date for Orion — Zuckerberg called it a “glimpse of the future.”
Seemingly in his element speaking to a cheering crowd, Zuckerberg said Meta is working to “bring the future to everyone” with its headsets, glasses and AI system. As part of an update to its Llama model, people will now be able to interact with Meta AI by speaking, with voices from celebrities such as John Cena, Judi Dench and Awkwafina.
“We are trying to build a future that is more open, more accessible, more natural, and more about human connection," Zuckerberg said. ”This is the continuation of the values and ideas that we have brought to the apps and technology that we have built over Meta’s first 20 years.”
An AI update aimed at influencers allows them to craft AI versions of themselves — for interacting with fans. On the keynote stage, an AI version of creator Don Allen Stevenson III appeared on the screen and answered a few questions just as the actual creator would. When Zuckerberg asked the AI creator about cattle ranching, it responded “my expertise lies in technology and design, not agriculture.” An earlier version of this tool was text only.
Other AI updates include live translation, which Zuckerberg demonstrated on stage. While wearing the smart glasses, Zuckerberg spoke in English to Mexican mixed martial artist Brandon Moreno replying in Spanish — the conversation was translated in real time. People can also dub their videos in another language so that it looks like they are speaking natively — even going so far as changing their lips movements to match.
Meta AI now has 500 million users, the company said. Jeremy Goldman of the research firm Emarketer called the number “jaw-dropping.”
“Meta has transformed from just a social media company into an AI powerhouse. Zuckerberg’s move to celebrity voices is not just for fun — it’s a direct challenge to OpenAI, with an emphasis on real-world utility," Goldman said.
Meta, which introduced the Quest 3 last year, also showed off a cheaper version of the VR goggles — the 3S — that will cost $299. The regular Quest 3 costs $499. The S3 will start shipping on Oct. 15.
“Meta is aggressively undercutting Apple’s Vision Pro to dominate the middle-tier AR/VR market,” Goldman said. Those VR goggles, which came out earlier this year after much anticipation, cost $3,500.
While VR goggles have grabbed more headlines, the augmented reality Ray Bans turned out to be a sleeper hit for Meta. The company hasn't disclosed sales numbers, but Zuckerberg said during Meta's July earnings call that the glasses “continue to be a bigger hit sooner than we expected — thanks in part to AI.” Zuckerberg said on Wednesday that Meta seems to have gotten past the supply issues that plagued the Ray Bans a few months ago due to high demand.
“They are kind of the perfect form factor for AI,” Zuckerberg said. The glasses, he added, let an AI assistant “see what you see, hear what you hear” and help you go about your day.
For instance, you can ask the glasses to remind you where you parked or to pick up groceries, look at a pile of fruit and come up with a smoothie recipe, or help you pick out a party outfit.
Meta — which renamed itself from Facebook in 2021, still makes nearly all of its money from advertising. In its most recent quarter, 98% of its more than $39 billion in revenue came from ads. At the same time, the company is investing heavily in AI and what Zuckerberg sees as the next generation of computing platforms such as VR headsets and AR glasses.
“VR headsets, despite Meta’s assertion, will not go mainstream," said Forrester research director Mike Proulx. “They’re too cumbersome, and people can only tolerate them in short bursts.”
Glasses, on the other hand “put computing power directly into a common and familiar form factor. As the smart tech behind these glasses matures, they have the potential to disrupt everyday consumers’ interactions with brands.”
Proulx said the Orion prototype "sets the stage for a future where a revolutionary 3D computing platform is within reach and can actually be useful to the everyday consumer.”