What the steps mean
Cost mode:

Conciseness, platform-native conventions, engagement under tight character limits.

5 capabilities in this category.

Task-by-task breakdown

Bench Hypothesis Post Generation

Write the short social messages that argue one hypothesis, using only the approved evidence behind it.

ModelQuality (% of best)ConfidenceOverpay
GPT-6 Luna ★96%RANKEDbest value
Claude Haiku 5.599%HIGH1.1x
Gemini 3.5 Flash Lite96%RANKED1.3x
DeepSeek V4.1 Flash95%HIGH6x
Tencent Hy394%MEDIUM8.8x
Qwen 3.8 Flash92%HIGH9.1x
Gemini 3.8 Flash99%RANKED10x
GPT-6 Sol98%RANKED11x
Thinking Machines Inkling Small93%MEDIUM12x
MiniMax M398%HIGH12x
NVIDIA Nemotron-3 Ultra 550B93%HIGH12x
Claude Sonnet 5.599%RANKED12x
Qwen 3.7 Plus96%RANKED21x
Meta Muse Spark 1.398%RANKED34x
Claude Opus 5.599%RANKED37x
Thinking Machines Inkling94%HIGH42x
Moonshot Kimi K3 best100%HIGH111x
Tencent Hy4 Preview95%HIGH132x
Qwen 3.8 Max99%RANKED135x
Grok 4.794%RANKED250x
GLM-5.399%RANKED472x

Task detail →

Public Response Generation

Drafts a concise public response to an input message using a supplied angle, evidence boundaries, channel profile, policy profile, and operator instructions. Illustrative uses include drafting a …

ModelQuality (% of best)ConfidenceOverpay
Xiaomi MiMo V2.6 Flash ★93%MEDIUMbest value
Claude Haiku 5.590%MEDIUM1.9x
Xiaomi MiMo V2.6 Pro best100%MEDIUM3.9x
DeepSeek V4.1 Flash92%MEDIUM4.1x
Tencent Hy392%HIGH9x
GPT-6 Sol90%MEDIUM17x
Thinking Machines Inkling Small95%MEDIUM31x
Claude Sonnet 5.593%MEDIUM32x
Claude Opus 5.592%MEDIUM65x
Thinking Machines Inkling93%MEDIUM114x
Moonshot Kimi K399%RANKED192x
Grok 4.793%MEDIUM208x
GLM-5.392%MEDIUM754x

Task detail →

Promotional Message Generation

Generates one grounded promotional message for a content item using caller-supplied channel, audience, voice, length, link, and formatting rules. Illustrative uses include promoting a software …

ModelQuality (% of best)ConfidenceOverpay
GPT-6 Luna ★90%HIGHbest value
Claude Haiku 5.592%HIGH1.3x
Xiaomi MiMo V2.6 Flash90%MEDIUM1.6x
Xiaomi MiMo V2.6 Pro93%HIGH1.7x
DeepSeek V4.1 Flash90%MEDIUM3x
NVIDIA Nemotron-3 Super 120B90%HIGH4x
Gemini 3.8 Flash92%RANKED11x
Claude Sonnet 5.5100%HIGH14x
Thinking Machines Inkling Small94%MEDIUM16x
GPT-6 Sol94%HIGH16x
GLM-5.3 Flash97%MEDIUM19x
Claude Opus 5.5 best100%HIGH28x
Meta Muse Spark 1.392%MEDIUM41x
Thinking Machines Inkling97%RANKED59x
Moonshot Kimi K398%RANKED95x
Tencent Hy4 Preview95%HIGH136x
Grok 4.794%MEDIUM158x
GLM-5.398%HIGH372x

Task detail →

Confidence — how sure we are about the quality score (more judgments + more agreement = higher confidence): RANKED many independent judges scored this model's outputs and their agreement is very high (most confident) — HIGH many judges have scored it and they mostly agree (well-pinned) — MEDIUM enough judges have weighed in to publish, but they disagree more than we'd like (treat with a small grain of salt). LOW-confidence cells are hidden everywhere on the site. See the methodology for the exact thresholds.