On June 20th, Anthropic, an AI company built by former OpenAI employees, released their new LLM (Large Language Model): Claude 3.5 Sonnet.

In this study, we evaluate the impact of this release on the popularity of the best LLMs (Claude, Gemini, GPT, Mistral & Llama).

We compared the data from Mammouth AI of the ten days before Anthropic’s new release, under the previous version of Claude 3 Opus, with the ten days after the release of Claude 3.5 Sonnet.

Claude’s popularity rises from 9.3% to 19.4% of total requests

LLM popularity BEFORE the release of Claude 3.5

LLM popularity before the release of Claude 3.5 Sonnet

LLM popularity before the release of Claude 3.5 Sonnet

LLM popularity AFTER the release of Claude 3.5

LLM popularity after the release of Claude 3.5 Sonnet

LLM popularity after the release of Claude 3.5 Sonnet

Other top LLMs benefit from Claude’s release except for GPT

How should we interpret Llama 3's score?

Will this popularity remain constant or evolve in the future?

To keep in touch with our next study, follow Mammouth on LinkedIn or X.