Building our vision

Case study · Method comparison · one list, two passes

The same list, scored 1–10 and then forced-ranked

One list of ten priorities, run twice: once with a rating scale, once with pairwise comparison. The two results disagree in a way worth seeing.

A deliberate side-by-side test on a single real list. It demonstrates a mechanism; it is not a controlled study and no statistical claim is made.

Two passes, one list

Ten items. Pass one: rate each out of ten on importance, the way most planning apps ask you to. Pass two: pairwise comparison, no ties allowed, until an order falls out.

The rating pass took under two minutes and felt easy. The comparison pass took closer to nine minutes and felt like work. The easy one produced a tie for first place between four items.

Where the two disagreed

The item rated highest on the scale finished fourth once it had to win actual head-to-head comparisons. It was important in the abstract and consistently lost to anything with a deadline attached.

That gap between abstract importance and revealed preference is the whole reason this tool exists. A rating captures how you feel about a task. A comparison captures what you would actually do.

The rest of this case study

Where should I send it?

Enter your email and the full case study opens on this page immediately — no confirmation step, no download.

  • Both rankings side by side, item for item
  • The four-way tie the rating scale produced
  • The three comparisons that reordered the top of the list
  • How to spot an item that only survives on ratings
  • A repeatable way to re-run this on your own list

One email address, kept for occasional notes about new tools. No sequences, no sharing, unsubscribe whenever. Already signed in? Your account email unlocks this automatically.

Now run it on your own list

This is the exact tool used in the session above. Ten things you're carrying, eight minutes, three left standing.

Run The Forced Choice freeSee the full version

The note this came from

Ranking beats rating: why comparing two tasks works better than scoring ten

Scoring tasks out of ten feels precise and produces ties. Comparing two at a time feels crude and produces a decision. Here's why the crude method wins.

Keep going