Trojan Horse Benchmark

Detection rate for planted false premises across frontier models, graded by a random panel of judge models with majority vote.

Detection rate by model

Share of graded answers where the model caught and corrected the planted false premise, averaged across all prompts and runs.

Performance vs. cost, tokens, and latency

Each dot is one model, colored by provider. The dashed line traces the efficiency frontier: models no other model beats on both axes at once.