Anthropic has made bold claims about its new Claude 3 chatbot family, and the AI startup insists it can outperform OpenAI's ChatGPT. The US-based firm unveiled three new benchmark models earlier this week, including the Claude 3 Haiku, Claude 3 Sonnet and Claude 3 Opus.
The new models differ in speed and power levels, with 'Haiku' being the smallest in terms of computing capacity and 'Opus' being the largest.
Anthropic revealed that its 'Opus' model “outperforms its peers on most common assessment benchmarks,” including Undergraduate Level Expert Knowledge (MMLU) and Graduate Level Expert Reasoning (GPQA).
Among the rival models it surpassed in these parameters were OpenAI's GPT-4 and GPT-3.5, as well as the Gemini 1.0 Ultra and Gemini 1.0 Pro.
All new Claude 3 models also show “increased capabilities” in areas of nuanced content generation, code generation, and non-English languages such as Spanish, Japanese, and French.
While OpenAI's chatbot offerings are often the ones that grab the headlines, these new models reinforce the fact that the Microsoft-backed startup now faces increasingly tough competition, according to Arun Chandrasekaran, vice president analyst at Gartner.
speaking to ITProChandrasekaran said the latest announcement shows that 2024 could be a breakneck year for the development of generative AI as competition between major industry players intensifies.
“This promises to be another crazy year in terms of [the] incredible pace of innovation, and [the amount of] new developments in this space,” he said.
One notable aspect of this announcement, Chandrasekaran said, was the enhanced context window that Anthropic wanted to highlight. Claude 3 will feature a “200K context window at launch,” the company said.
Anthropic also said that all three new models are capable of accepting inputs exceeding one million tokens, a feature they can make accessible to select customers who need “enhanced processing power.”
Anthropic is optimistic about “constitutional AI”
Chandrasekaran said an interesting aspect of this announcement is Anthropic's much-publicized commitment to “constitutional AI.”
In recent months, the company has wanted to present itself as a more responsible and ethical player in the generative AI space than some industry counterparts.
“One of the things Anthropic has talked about constantly since its founding is this notion of constitutional AI,” Chandrasekaran said.
“This whole view that they want to align AI models very closely with human intent and human alignment,” he added. “I think that's something that makes Anthropic a little different”
Google and AWS have also pledged significant support to Anthropic in recent months, investing more than $5 billion in the company, in a clear sign that both hyperscalers see it as a leading contender for OpenAI.
Anthropic is not the only one gaining ground on OpenAI
It's not just about Anthropic announcing new models and putting pressure on reigning champion OpenAI.
Google, despite playing catch-up with Microsoft and OpenAI over the last year, appears to be gaining ground on the duo's dominance in the generative AI space.
It recently brought chatbot Duet AI under the united roof of Gemini, which now looks poised to make a considerable impact on the AI landscape through multimodality.
“Google, with the Gemini 1.5 model in particular, announced some very impressive capabilities,” Chandrasekaran said.
“Most impressive [sic] It is the million-dollar context window for the model,” he added.
This, Chandrasekaran explained, means that users can work with large amounts of text, voice and video on the platform. He also mentioned Meta and the impressive capabilities of its own open source model offerings.
Analysts said ITPro Last month, Gemini's rebrand marked a significant moment in the rise of generative AI, and one that will set the stage for an imminent race between Microsoft and Google.
Chirag Dekate, vice president analyst at Gartner, said the tech giant's new range of models could boost Google's attempts to catch Microsoft in the battle for AI dominance.
