LLM Evaluation & Benchmarks
Leaderboards, eval harnesses, and benchmark platforms.
ClientCoded
ClientCoded runs adversarial multi-turn conversations against your agent, scores every exchange across 10 published dimensions, and fires a…
oqoqo
Oqoqo runs agent evaluation experiments on managed cloud infrastructure, spinning up sandboxed machines per task so runs don't bleed into…
AgiRanker
The tool lets you rank frontier models on a 0–100 AGI Score, explore per-domain breakdowns across Thinking, Doing, and Communicating, and…
AgentsProof
AgentsProof is an evaluation SDK that wraps your LLM and tool calls with a decorator, grades each run against rules you define in plain…
LangDrift
Langdrift runs your agent prompts across multiple locales and compares behavior — checking whether tool calls, response structure, and…
SOCBench
The published detection module runs three frontier LLMs across four analyst personas against 1,205 labeled NetFlow units, scoring each…
Arena AI
The core loop is simple: you submit a prompt, two models respond anonymously, you vote for the better answer, and Arena logs the result…
EvalQA
The platform combines trained human evaluators with automated metrics across three surfaces: multi-step agent workflows, SaaS AI features…
Proctor
Proctor wraps each agent execution in a Linux sandbox that cuts off access to hidden tests, fix history, and network egress, so the agent…