API-only (weights pending) Apache 2.0 weights in 5 days (Nov 12, 2026) Model card checked Nov 6, 2026

Benchmarks · comparison

Inkling 2 Small vs Gemini 3.8 Flash

Both models appear in the same evaluation table on the official model card, which is the only place they are measured under identical conditions and reported by the same party.

Across 53 benchmarks where both models report a score, Inkling 2 Small is higher on 30 and Gemini 3.8 Flash is higher on 23 . Inkling 2 Small has 594B total parameters with 17B active, and is priced at $1 per million output tokens on Tinker. Its largest margin is on AA-Briefcase v1.1. Its largest deficit is on AutomationBench v1.0.6.

Head to head

Position
Inkling 2 Small: the subject of this site · Gemini 3.8 Flash: closed weights
Bechmarks scored
53 shared rows, out of 71 total
Record
30 wins · 23 losses · 0 ties

Largest differences

Rows with the widest gap in either direction. Positive means Inkling 2 Small scores higher.
Benchmark Inkling 2 Small Gemini 3.8 Flash Gap
AA-Briefcase v1.1 · Knowledge Work 1,527 1,203 + 324
GDPVal-AA v2.1 · Knowledge Work 1,630 1,445 + 185
DesignArena Game Dev · Visual Creation 1,428 1,305 + 123
Code2Video-AA · Visual Creation 1,020 899 + 121
DesignArena 3D Design · Visual Creation 1,401 1,291 + 110
DesignArena Web Apps · Visual Creation 1,296 1,221 + 75
Code Arena · Visual Creation 1,653 1,583 + 70
AA-3D · Visual Creation 1,021 965 + 56
DesignArena Website · Visual Creation 1,340 1,299 + 41
CyberBench v1.1 · Cybersecurity 72.7% 43.8% + 28.9

Every shared benchmark

All 53 rows where both models have a reported score. Rows are grouped as the model card groups them.
Benchmark Inkling 2 Small Gemini 3.8 Flash Leader
Third Party Index
AA Index (v5.0) 30.6 30.8 Gemini 3.8 Flash
Vals Index (v2.2) 56.1% 56% Inkling 2 Small
Coding
FrontierCode v2.0 25.4% 18.7% Inkling 2 Small
DeepSWE v1.1 72.1% 73.8% Gemini 3.8 Flash
Terminal Bench Science v0.1 5.7% 10% Gemini 3.8 Flash
Terminal Bench v4.0 13.1% 19.7% Gemini 3.8 Flash
Terminal Bench 2.1 · Inkling 2 Small: Pi harness 85.1% 89.4% Gemini 3.8 Flash
Terminal Bench v2.1 (Terminus) 81.3% 87.6% Gemini 3.8 Flash
Vibe Code Bench v1.1 81.6% 78.7% Inkling 2 Small
Sudo L7 14.1% 10.6% Inkling 2 Small
SWEBench Multilingual 81.2% 85.8% Gemini 3.8 Flash
SWEBench Multimodal v2 43.1% 40.8% Inkling 2 Small
SWEBench Pro v2 (Hard) 86.3% 58.8% Inkling 2 Small
SWEBench Pro v2 (Full) 97.7% 94.9% Inkling 2 Small
SWEBench Verified 82.2% 80% Inkling 2 Small
Autoresearch
BioMysteryBench 70% 62.2% Inkling 2 Small
Search and Tools
MCP Atlas · Full / Public 85.4% 87.5% Gemini 3.8 Flash
Knowledge Work
AA-Briefcase v1.1 1,527 1,203 Inkling 2 Small
GDPVal-AA v2.1 1,630 1,445 Inkling 2 Small
Enterprise Operations
AutomationBench v1.0.6 45.6% 59.9% Gemini 3.8 Flash
EnterpriseBench-CoreCraft 71.8% 58.5% Inkling 2 Small
Finance Work
Finance Agent v2.1 67.5% 65.8% Inkling 2 Small
Excel Modeling Benchmark v1.1 69.5% 72.9% Gemini 3.8 Flash
Tax Agent Bench 65.8% 66.8% Gemini 3.8 Flash
DAYJOB (Finance) 14.3% 4.5% Inkling 2 Small
Apex-Accounting v1.1 · pass@1 / mean score 14.5% 15.5% Gemini 3.8 Flash
Diligence Bench · Best harness 58.1% 51.1% Inkling 2 Small
Legal Work
Harvey LAB v1.1 21.7% 12.1% Inkling 2 Small
Legal Research Bench 46.6% 38.9% Inkling 2 Small
Visual Creation
DesignArena Web Apps 1,296 1,221 Inkling 2 Small
DesignArena Website 1,340 1,299 Inkling 2 Small
DesignArena Game Dev 1,428 1,305 Inkling 2 Small
DesignArena 3D Design 1,401 1,291 Inkling 2 Small
Code Arena 1,653 1,583 Inkling 2 Small
AA-3D 1,021 965 Inkling 2 Small
Code2Video-AA 1,020 899 Inkling 2 Small
Visual Perception
Humanity’s Sixth Sense 33.3% 41.6% Gemini 3.8 Flash
Visual Reasoning
GDP.pdf 25.2% 21% Inkling 2 Small
MMMU Pro (Standard 10) 81.6% 85.6% Gemini 3.8 Flash
Charxiv RQ · original / with Python 85.6% 86.2% Gemini 3.8 Flash
Chartography · original / with Python 36.7% 40.9% Gemini 3.8 Flash
SAGE v1.1 88.6% 88.2% Inkling 2 Small
STEM Reasoning
CritPt v2 · Full / Hard 55.7% 65.1% Gemini 3.8 Flash
HLE-Diamond 28.7% 33.1% Gemini 3.8 Flash
HLE (text only) 44.1% 47.8% Gemini 3.8 Flash
GPQA Diamond 93% 95.3% Gemini 3.8 Flash
Long Context
AA-LCR v1.1 83.3% 81.3% Inkling 2 Small
LongBench v2 70.6% 73.7% Gemini 3.8 Flash
Factuality
AA-Omniscience v1.1 · score 16.1 23.3 Gemini 3.8 Flash
AA-Omniscience v1.1 · non-hallucination rate 73.3% 44.9% Inkling 2 Small
Instruction Following
ComplexConstraints v1.0 44.5% 48.4% Gemini 3.8 Flash
Safety
DistressBench 82% 70.7% Inkling 2 Small
Cybersecurity
CyberBench v1.1 72.7% 43.8% Inkling 2 Small

Reading the comparison honestly

These numbers come from one table published by Thinking Machines, using third-party evaluations where those exist. That makes them comparable to each other, but it does not make them neutral: the vendor chose which benchmarks to run and how to present them, and a benchmark that a model loses has a way of not appearing.

The models are also not the same shape of thing. Gemini 3.8 Flash sits in the closed weights tier of the card's own grouping, while Inkling 2 Small is the subject of this site. A win against a smaller model is less meaningful than a win against a larger one, and the table does not adjust for that.

The full 13-model matrix · pricing · hardware requirements

Compared Nov 6, 2026.