Beyond Nvidia: the Search for AI's Next Breakthrough

Vinod Khosla, founder of Khosla Ventures, speaks on a panel on the main stage during the 2024 Collision tech conference in Toronto, Canada. Cole BURSTON / AFP
Vinod Khosla, founder of Khosla Ventures, speaks on a panel on the main stage during the 2024 Collision tech conference in Toronto, Canada. Cole BURSTON / AFP
TT

Beyond Nvidia: the Search for AI's Next Breakthrough

Vinod Khosla, founder of Khosla Ventures, speaks on a panel on the main stage during the 2024 Collision tech conference in Toronto, Canada. Cole BURSTON / AFP
Vinod Khosla, founder of Khosla Ventures, speaks on a panel on the main stage during the 2024 Collision tech conference in Toronto, Canada. Cole BURSTON / AFP

For a few days, AI chip juggernaut Nvidia sat on the throne as the world's biggest company, but behind the staggering success are questions on whether new entrants can stake a claim to the artificial intelligence bonanza.
Nvidia, which makes the processors that are the only option to train generative AI's large language models, is now Big Tech's newest member and its stock market takeoff has lifted the whole sector, said AFP.
Even tech's second rung on Wall Street has ridden on Nvidia's coattails with Oracle, Broadcom, HP and a spate of others seeing their stock valuations surge, despite sometimes shaky earnings.
Amid the champagne popping, startups seeking the attention of Silicon Valley venture capitalists are being asked to innovate -- but without a clear indication of where the next chapter of AI will be written.
When it comes to generative AI, doubts persist on what exactly will be left for companies that are not existing model makers, a field dominated by Microsoft-backed OpenAI, Google and Anthropic.
Most agree that competing with them head-on could be a fool's errand.
"I don't think that there's a great opportunity to start a foundational AI company at this point in time," said Mike Myer, founder and CEO of tech firm Quiq, at the Collision technology conference in Toronto.
Some have tried to build applications that use or mimic the powers of the existing big models, but this is being slapped down by Silicon Valley's biggest players.
“What I find disturbing is that people are not differentiating between those applications which are roadkill for the models as they progress in their capabilities, and those that are really adding value and will be here 10 years from now," said venture capital veteran Vinod Khosla.
'Won't keep up'
The tough-talking Khosla is one of OpenAI's earliest investors.
"Grammarly won't keep up," Khosla predicted of the spelling and grammar checking app, and others similar to it.
He said these companies, which put only a "thin wrapper" around what the AI models can offer, are doomed.
One of the fields ripe for the taking is chip design, Khosla said, with AI demanding ever more specialized processors that provide highly specific powers.
"If you look across the chip history, we really have for the most part focused on more general chips," Rebecca Parsons, CTO at tech consultancy Thoughtworks, told AFP.
Providing more specialized processing for the many demands of AI is an opportunity seized by Groq, a hot startup that has built chips for the deployment of AI as opposed to its training, or inference -- the specialty of Nvidia’s world-dominating GPUs.
Groq CEO Jonathan Ross told AFP that Nvidia won't be the best at everything, even if they are uncontested for generative AI training.
"Nvidia and (its CEO) Jensen Huang are like Michael Jordan... the greatest of all time in basketball. But inference is baseball, and we try and forget the time where Michael Jordan tried to play baseball and wasn't very good at it," he said.
Another opportunity will come from highly specialized AI that will provide expertise and know-how based on proprietary data which won’t be co-opted by voracious big tech.
"Open AI and Google aren't going to build a structural engineer. They're not going to build products like a primary care doctor or a mental health therapist," said Khosla.
Profiting from highly specialized data is the basis of Cohere, another of Silicon Valley's hottest startups that pitches specifically-made models to businesses that are skittish about AI veering out of their control.
"Enterprises are skeptical of technology, and they're risk-averse, and so we need to win their trust and to prove to them that there's a way to adopt this technology that's reliable, trustworthy and secure," Cohere CEO Aidan Gomez told AFP.
When he was just 20 and working at Google, Gomez co-authored the seminal paper "Attention Is All You Need," which introduced Transformer, the architecture behind popular large language models like OpenAI's GPT-4.
The company has received funding from Nvidia and Salesforce Ventures and is valued in the billions of dollars.



Microsoft Revamps AI Copilot with New Voice, Reasoning Capabilities

Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
TT

Microsoft Revamps AI Copilot with New Voice, Reasoning Capabilities

Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)
Copilot logo is seen in this illustration taken May 20, 2024. (Reuters)

Microsoft has given its consumer Copilot, an artificial intelligence assistant, a more amiable voice in its latest update, with the chatbot also capable of analyzing web pages for interested users as they browse.

The US software maker now has "an entire army" of creative directors - among them psychologists, novelists and comedians - finessing the tone and style of Copilot to distinguish it, Mustafa Suleyman, chief executive of Microsoft AI, told Reuters in an interview.

In one demonstration of the updated Copilot, a consumer asked what housewarming gift to buy at a grocery store for a friend who did not drink wine. After some back-and-forth, Copilot said aloud: "Italian (olive) oils are the hot stuff right now. Tuscan's my go-to. Super peppery."

The feature rollout, starting Tuesday, is one of the first that Suleyman has overseen since Microsoft created his division in March to focus on consumer products and technology research.

Long identified with business software, Microsoft has had a much harder road in the consumer realm. Its Bing search engine, for instance, is still dwarfed by Google.

Suleyman is hoping for a bigger splash with Copilot, which launched last year in a crowded field of AI chatbots, including OpenAI's ChatGPT and Google's Gemini.

Copilot's newly fashioned voice capabilities make it seem much more of an active listener, giving verbal cues like "cool" and "huh," Suleyman said.

Underlying the product are Microsoft AI, or "MAI," models, plus a technology suite from partner OpenAI, Suleyman said.

Suleyman added that consumers who spend $20 monthly for Copilot Pro can start testing a "Think Deeper" feature that reasons through choices, like whether to move to one city or another.

He said an additional test feature for paying subscribers, Copilot Vision, amounts to "digital pointing" - the ability for users to talk to AI about what they see in a Microsoft Edge browser. Consumers have to opt in, and the content they view will not be saved or used to train AI, Microsoft said.

These updates represent "glimmers" of AI that can be an "ever-present confidant, in your corner," Suleyman said. It's a vision he articulated as CEO of Inflection AI, whose top talent Microsoft poached in a closely watched deal this year.

Suleyman said that eventually, Copilot will learn context from consumers' Word documents, Windows desktops, even their gaming consoles if they grant permission.

Asked what Bill Gates, Microsoft's co-founder, thinks of the company's AI efforts, Suleyman said Gates was excited.

"He's always asking me about when Copilot can read and parse his emails. It's one of his favorite ones," Suleyman said. "We're on the case."