SWE-Bench Multilingual
Real bug fixes across multilingual open-source repos. Higher is better. Source: public SWE-Bench Multilingual leaderboard and vendor reports.
BoongleBench
How models
actually code.
Public scores for models available in Boongle IDE — first-party, catalog, and API tiers. We combine published industry benchmarks, independent evals, and BoongleBench runs in our agent harness.
18models tracked
Auto, Boongle 1.8 Flash, Grok 4.7, Claude, Gemini, GLM, GPT-6 Astra / Sol / Luna, Mimo, DeepSeek V4.1 Flash, Gemini 3.8 Flash, and more.
5benchmark axes
SWE-Bench Multilingual, Terminal-Bench 2.1, agent coding evals, speed, and cost efficiency.
Flagship spotlight
Boongle 1.8 Flash
Our latest first-party model for agentic coding in Boongle IDE — tuned for multi-file edits, fast tool loops, and everyday refactors inside the editor. Read the release
- 78.6 SWE-Bench Multilingual
- 71.5 Terminal-Bench 2.1
- 61.9 Agent bench v3.1
78.4BoongleBench composite
Strong all-round scores with high speed and cost efficiency on Boongle IDE plans. Pick it when you want flagship quality without switching models.
Methodology
What we measure
Terminal-Bench 2.1
Agentic terminal workflows — install deps, run tests, debug CLI output. DeepSeek V4.1 Flash and Gemini 3.8 Flash lead here.
Agent coding
Public agent-coding evals where available (e.g. agent bench v3.1, DeepSWE v1.1). The exact benchmark is labeled on each model row.
BoongleBench composite
Weighted blend of available axes (coding 45%, terminal 25%, speed 15%, cost 15%). Missing axes are skipped — never guessed.
Full leaderboard
Every model.
One table.
| # | Model | Composite | SWE Multi | TB 2.1 | Agent | Speed | Cost |
|---|
Scores combine publicly reported vendor benchmarks, independent evals (e.g. Vals AI, Artificial Analysis), and BoongleBench internal runs in the Boongle IDE agent harness (March 2026). Third-party benchmark names belong to their respective publishers. Different models are often evaluated with different harnesses — compare within the same column, not across unrelated evals. We update this page when new catalog models ship.