Intel Battles AMD with New Data Center Chips 

Intel CEO Patrick Gelsinger delivers his keynote speech during the COMPUTEX show in Taipei, Taiwan, 04 June 2024. (EPA)
Intel CEO Patrick Gelsinger delivers his keynote speech during the COMPUTEX show in Taipei, Taiwan, 04 June 2024. (EPA)
TT

Intel Battles AMD with New Data Center Chips 

Intel CEO Patrick Gelsinger delivers his keynote speech during the COMPUTEX show in Taipei, Taiwan, 04 June 2024. (EPA)
Intel CEO Patrick Gelsinger delivers his keynote speech during the COMPUTEX show in Taipei, Taiwan, 04 June 2024. (EPA)

Intel launched its next generation Xeon server processors on Tuesday, as it looks to claw back data center market share and revealed that its Gaudi 3 artificial intelligence accelerator chips would be priced much lower than its rivals' chips.

The sixth generation Xeon chips are crucial for Intel, which has been steadily losing data center market share to Advanced Micro Devices (AMD).

Intel's share of the data center market for x86 chips has declined 5.6 percentage points over the past year to 76.4%, with AMD now holding 23.6%, according to data from Mercury Research.

Stumbles with Intel's manufacturing process have allowed AMD to take business as it uses Taiwan Semiconductor Manufacturing Co to fabricate its chips.

The Xeon 6 server processors come in two main flavors, a larger, more powerful version, and an "efficiency" model that Intel pitched as a replacement for older-generation chips.

To achieve the same level of computing power as its second generation chips, they will now require about 67% fewer server racks with the efficiency model, which is designed to serve media, websites and perform database calculations.

"Simply put, performance up, power down," Intel Chief Executive Pat Gelsinger said at the Computex trade fair in Taipei, where he gave a presentation of the server.

The more powerful performance model is designed to run the computations necessary to generate responses from complex AI models and other tasks that need the increased horsepower.

The "efficiency" Xeon chip is available on Tuesday, with the "performance" model arriving in the third quarter. Intel plans to launch additional variations next year. The sixth generation chip was delayed a year because the company wanted to use a different manufacturing process.

On a briefing call with reporters, Intel said that a Gaudi 3 accelerator kit, which includes eight of the AI chips, sells for about $125,000, and the earlier generation Gaudi 2 has a list price of $65,000.

Speaking in Taipei, Gelsinger said the prices looked "pretty compelling", especially compared with competitors.

"In other words, it crushes the competition."

AMD and Nvidia do not discuss pricing of their chips. A comparable HGX server system with eight Nvidia H100 AI chips can cost more than $300,000, according to custom server vendor Thinkmate.

Intel revealed the details of the Gaudi 3 AI chip in April and has positioned it as a considerably cheaper and viable alternative to Nvidia's H100 chips.

Also on Tuesday, Intel said its next generation laptop chip, called Lunar Lake, uses 40% less power and has more a powerful AI processor in it. Intel said it will ship the chip in the third quarter.



AI Chatbots Must Learn to Say 'Help!' Says Microsoft Exec

A Microsoft logo is seen in Los Angeles, California US November 7, 2017. (Reuters)
A Microsoft logo is seen in Los Angeles, California US November 7, 2017. (Reuters)
TT

AI Chatbots Must Learn to Say 'Help!' Says Microsoft Exec

A Microsoft logo is seen in Los Angeles, California US November 7, 2017. (Reuters)
A Microsoft logo is seen in Los Angeles, California US November 7, 2017. (Reuters)

Generative AI tools will save companies lots of time and money, promises Vik Singh, a Microsoft vice president, even if the models must learn to admit when they just don't know what to do.
"Just to be really frank, the thing that's really missing today is that a model doesn't raise its hands and say 'Hey, I'm not sure, I need help,'" Singh told AFP in an interview.
Since last year, Microsoft, Google and their competitors have been rapidly deploying generative AI applications like ChatGPT, which produce all kinds of content on demand and give users the illusion of omniscience.
But despite progress, they still "hallucinate," or invent answers.
This is an important problem for the Copilot executive to solve: Singh's corporate customers can't afford for their AI systems to go off the rails, even occasionally.
Marc Benioff, CEO of Salesforce, this week said he saw many of his customers increasingly frustrated with the meanderings of Microsoft's Copilot.
Singh insisted that "really smart people" were trying to find ways for a chatbot to admit "when it doesn't know the right answer and to ask for help."
'Real savings'
A more humble model would be no less useful, in Singh's opinion. Even if the model has to turn to a human in 50 percent of cases, that still saves "tons of money."
At one Microsoft client, "every time a new request comes in, they spend $8 to have a customer service rep answer it, so there are real savings to be had, and it's also a better experience for the customer because they get a faster response."
Singh arrived at Microsoft in January and this summer took over as head of the teams developing "Copilot," Microsoft's AI assistant that specializes in sales, accounting and online services.
These applications have the gargantuan task of bringing in revenue and justifying the massive investments in generative AI.
At the height of the AI frenzy, start-ups driving the technology were promising systems so advanced that they would "uplift humanity," in the words of Sam Altman, head of OpenAI, which is mainly funded by Microsoft.
But for the time being, the new technology is mainly used to boost productivity, and hopefully profits.
According to Microsoft, Copilot can do research for salespeople, freeing up time to call customers. Lumen, a telecom company, "saves around $50 million a year" doing this, said Singh.
Singh's teams are working on integrating Copilot directly into the tech giant's software and making it more autonomous.
"Let's say I'm a sales rep and I have a customer call," suggested the executive. Two weeks later, the model can "nudge the rep to go follow up, or better, just go and automatically send the email on the rep's behalf because it's been approved to do so."
'First inning'
In other words, before finding a solution to global warming, AI is expected to rid humanity of boring, repetitive chores.
"We're in the first inning," Singh said. "A lot of these things are productivity based, but they obviously have huge benefits."
Will all these productivity gains translate into job losses?
Leaders of large firms, such as K Krithivasan, boss of Indian IT giant TCS, have declared that generative AI will all but wipe out call centers.
But Singh, like many Silicon Valley executives, is counting on technology to make humans more creative and even create new jobs.
He pointed to his experience at Yahoo in 2008, when a dozen editors chose the articles for the home page.
"We came up with the idea of using AI to optimize this process, and some people asked 'Oh my God, what's going to happen to the employees?'" said Singh.
The automated system made it possible to renew content more quickly, thereby increasing the number of clicks on links but also the need for new articles.
"In the end," said the executive, "we had to recruit more editors."