Calibration Proof

We tested our AI against real UPSC examiners. Here are the results.

Every AI evaluator claims “UPSC-standard grading.” We are the only one that publishes the evidence: our evaluator scored 61 real answers that human examiners had already marked — without seeing their marks — and we publish the full comparison below.

61

Real examiner-scored answers tested

0 marks

Median AI−examiner difference

38.3%

AI mean score (examiners: 46.3%)

50.8%

Agree within ±1 mark (10-marker scale)

Each dot = one real answer · dashed line = perfect agreement

0%0%25%25%50%50%75%75%100%100%GS2 · examiner 4/10 · AI 4/10GS2 · examiner 15/200 · AI 75/200GS1 · examiner 9/15 · AI 5.5/15GS2 · examiner 5/10 · AI 5/10GS2 · examiner 9/10 · AI 2/10GS1 · examiner 13/15 · AI 7.5/15GS3 · examiner 2.5/10 · AI 3.5/10GS1 · examiner 5/10 · AI 3.5/10GS3 · examiner 3/10 · AI 3/10GS4 · examiner 2/10 · AI 3.5/10Optional-History · examiner 31.5/50 · AI 22/50GS3 · examiner 4/10 · AI 3.5/10Essay · examiner 110/250 · AI 125/250Essay · examiner 55/125 · AI 48/125GS2 · examiner 2/10 · AI 4.5/10GS3 · examiner 4/10 · AI 4/10GS2 · examiner 4.5/10 · AI 4.5/10GS2 · examiner 4/15 · AI 5.5/15GS1 · examiner 5.5/10 · AI 5.5/10GS2 · examiner 20/250 · AI 0/250GS3 · examiner 6.5/10 · AI 6/10GS3 · examiner 4.5/15 · AI 5.5/15GS2 · examiner 5/10 · AI 5/10GS3 · examiner 4/10 · AI 2.5/10GS4 · examiner 5/10 · AI 3.5/10GS2 · examiner 4/10 · AI 4/10GS2 · examiner 3.5/10 · AI 3.5/10GS1 · examiner 7.5/10 · AI 3.5/10GS2 · examiner 6/15 · AI 6.5/15GS2 · examiner 7/15 · AI 7.5/15GS2 · examiner 12/15 · AI 8.5/15GS3 · examiner 5/10 · AI 3.5/10Essay · examiner 60/125 · AI 42.5/125GS2 · examiner 5.5/15 · AI 5.5/15GS3 · examiner 5/15 · AI 5.5/15GS2 · examiner 3/15 · AI 3.5/15GS1 · examiner 12/20 · AI 6.5/20GS3 · examiner 6.5/10 · AI 4/10GS2 · examiner 5/10 · AI 4/10GS3 · examiner 7/10 · AI 3.5/10GS3 · examiner 2.5/10 · AI 2/10GS3 · examiner 8.5/10 · AI 4.5/10GS3 · examiner 3.5/15 · AI 3.5/15GS2 · examiner 4/10 · AI 4/10GS2 · examiner 4.5/10 · AI 4.5/10GS1 · examiner 6/15 · AI 6/15GS1 · examiner 6.5/15 · AI 6.5/15GS1 · examiner 11/20 · AI 8/20GS1 · examiner 13/15 · AI 7.5/15GS2 · examiner 5/10 · AI 3.5/10GS1 · examiner 6/10 · AI 4/10GS3 · examiner 7/10 · AI 3.5/10GS2 · examiner 4/10 · AI 4/10GS3 · examiner 7/10 · AI 4/10GS3 · examiner 7.5/10 · AI 3.5/10GS3 · examiner 5/15 · AI 5.5/15GS2 · examiner 4.5/10 · AI 4/10GS2 · examiner 15/200 · AI 70/200GS2 · examiner 7/20 · AI 5.5/20GS2 · examiner 4.5/10 · AI 4.5/10GS1 · examiner 9/50 · AI 22/50Human examiner score (% of max)Dream To Rank AI score (% of max)

What this shows — honestly

  • Our AI never inflates. Across the test set the AI averaged 38.3% vs the human examiners’ 46.3% — when it errs, it errs strict. The score you see is a floor to build from, not flattery.
  • The median difference is zero. For the typical answer, the AI lands on the same mark the human examiner gave.
  • Human examiners disagree too. Studies of UPSC-style essay marking show human-to-human variance of several marks on the same copy. Our published spread (50.8% within ±1 mark, 54.1% within 10 percentage points) is measured against a single examiner’s judgment — the hardest possible test.
  • This page will keep updating. As our evaluated-copy corpus grows, we re-run this benchmark and publish the new numbers — good or bad.

Methodology

  1. We collected 61 handwritten mains answers that were already evaluated and scored by experienced human examiners (mock-test copies of real aspirants, including future toppers).
  2. Our AI evaluator scored the same handwritten pages with its standard 9-parameter UPSC rubric, instructed to ignore any visible examiner markings.
  3. We compared the two scores per answer. No answers were excluded for scoring badly; the full set is plotted above.
  4. Benchmark last run: 2026-07-13. Model and rubric identical to what evaluates your answers.
Get your answer evaluated — 3 free / month →

English + हिंदी · calibrated on real examiner-scored copies