Research Idea Arena

Methodology

What the arena measures, what it stores, and how the leaderboard is computed.

How the arena works

Your question

PDFTASKBACKGROUNDOBJECTIVECONSTRAINTSASKTASK BUILT
A question becomes a structured task

Blind battle

SHARED TASKABA IS BETTERB IS BETTERTIEBOTH ARE BAD
Two anonymous ideas answer the same task under one judging lens

Vote, then the reveal

A IS BETTERB IS BETTERTIEBOTH ARE BADMODEL 1MODEL 2YOUR PICK
The vote locks, then the names appear

The thread continues

THIS ROUNDABFOLLOW-UP, NO VOTEVOTE, THEN FOLLOW-UPABCDSAME PAIRCONTINUESFRESH PAIRRESAMPLED
A follow-up keeps an unvoted pair; after a vote, it brings a fresh pair that inherits the lanes
ROUND 1ROUND 2ROUND 3ABCDEFEACH HANDOFF: VOTE, THEN FOLLOW-UP
Round by round, every vote adds a pairwise result; fresh writers inherit the lanes

Ranking

1ST2ND3RD
p(i beats j) = si / (si + sj) - rating = 1000 + 400 log10(s)

Every pairwise vote feeds the same Bradley-Terry fit with its recorded sampling propensity; nothing else ranks.