Mistral AI dropped Mistral Medium 3.5 on April 29. The Paris-based lab announced a dense 128-billion-parameter model, a set of agentic features—and walked straight into a wall of online “meh” reactions.
Big ambitions, but a messy benchmark reality.
Medium 3.5 scores 77.6% on SWE-Bench Verified—a coding benchmark that tests whether a model can fix real GitHub issues by generating working patches. It also hits 91.4% on τ³-Telecom, which measures agentic tool use in specialized environments. Mistral also merged three previously separate models (Medium 3.1, Magistral, and Devstral 2) into one set of weights with configurable reasoning effort per request.
Unified model replacing three is a real engineering win. The problem is what it costs and who it's up against.
Mistral charges $1.50 per million input tokens and $7.50 per million output tokens. Alibaba's Qwen 3.6 at 27 billion parameters—less than a quarter of Medium 3.5's parameter count—scores 72.4% on the same SWE-Bench Verified benchmark and ships under Apache 2.0, meaning you can download and run it for free.
Scroll through the open-source leaderboards and the picture is stark. The top spots belong to Alibaba’s Qwen, GLM from China's Zhipu AI, and MiMo-V2 from Xiaomi, all of them cheaper, more powerful and competitive than Mistral’s new release. Medium 3.5 hasn't even ranked on major independent leaderboards yet—third-party evaluations are still pending.
The only good thing though, as some argue, is that Mistral is, at this point, the lone non-Chinese model with any serious presence in the open-source conversation.
I think Mistral has the 10th highest valuation in the whole AI scene (something like that).
All while they consistently release some of the worst models.
They have survived through European bureaucracy, lobbying and politics.
The Internet reactsPedro Domingos, a machine learning professor at the University of Washington, wasn't gentle:
"Regular AI companies brag about how much better their model is on benchmarks. Only Mistral brags about how much worse its one is."
He followed up with a sharper question: "I don't know what's worse, for Europe to not be in the AI race or for it to be represented by a laughingstock like Mistral."
“If it wasn’t for their political skill they would have been bankrupt by now,” he said.
Not everyone was purely dismissive. AI developer Michal Langmajer captured the ambivalence:
"I'm genuinely glad there's still a non-US, non-Chinese lab trying to build frontier LLMs but boy we have to level up the game in Europe. Their new flagship model is basically 'not the best' on any benchmark, yet costs multiple times more than most competitors."
Some developers argued open weights are a durability play, not a leaderboard play. A model anyone can download, fine-tune, and self-host doesn't need to win rankings today to stay relevant. Others pointed to Mistral's real enterprise deployments across Europe as evidence the moat isn't purely technical.
The Geopolitical safety netThis is where Mistral's actual pitch lives.
Not the best at coding, and not the cheapest. But it is: not American, not Chinese, auditable, self-hostable, and legally safe for European enterprise.
