Terms of use

Research Idea Arena collects researcher preferences over model-generated research ideas and turns them into a public leaderboard. It is an experiment, offered free of charge, with no service level and no promise that it will keep running, keep your data, or keep the same shape.

These terms cover the hosted service at researchideaarena.ai. The code is intended for release under the Apache 2.0 license; until the repository is public, the service is what these terms describe.

Reading the arena needs no account. Submitting a question or casting a vote requires signing in with Google, so that each contribution carries a stable identity.

Sign in as yourself, with one account. Submissions are subject to daily budgets per account and per network address, because every generation costs real money; hitting a limit is not a fault.

You keep whatever rights you had in what you submit. Submitting grants us only what the arena visibly needs: to send your material to the task builder and to the competing models, to store it as the privacy policy describes, to serve the resulting battle to whoever has your task link, and to keep the votes it collects.

Only submit material you are entitled to send to third-party model providers. Do not submit anyone else's personal data, anything under an obligation of confidence you have not cleared, or anything you are not free to have processed abroad.

The arena is not a disclosure venue and does not date-stamp priority. If a question is one you cannot risk sending to a commercial model API, it does not belong here.

The ideas are written by language models in about a minute. They are not reviewed by a human, not checked for novelty, and not checked for correctness. They may be wrong, may restate work that already exists, and may cite things that do not.

Anything you take forward from them is yours to verify. We make no claim about who owns a model's output; that is between you and the provider whose model wrote it, and the model that wrote each idea is named to you at the reveal.

Do not treat any of it as professional, legal, medical, or safety advice.

Vote for the idea you actually think is better. Ties and 'both are bad' are real answers and are more useful than a coin flip.

Votes are the dataset. Yours joins an append-only log that ranks the models publicly and that we intend to publish, with your account id removed. Your written rationale, if you leave one, is part of that record - see the privacy policy for exactly what an export contains.

Do not vote to move a model up or down. Coordinated or automated voting is the one thing that can make this leaderboard worthless. The log is screened for anomalous voters, and we may withdraw access and exclude votes we believe were cast that way.

No scripted submitting or voting, no working around the rate limits or the daily budgets, no attempt to identify which model wrote which idea before the vote is cast, and no attempt to get a model to reveal itself.

No probing, overloading, or reverse-engineering the service, and nothing unlawful. Access may be withdrawn for any of the above, without notice.

You may have any question you submitted hidden at any time - it leaves your history and stops collecting votes, and the privacy policy explains how. Hiding is not destruction: nothing submitted here is deleted, on request or automatically - submissions are kept indefinitely and are used to build datasets and to train and evaluate models.

Votes stay in the log, including a hidden question's. They are the public record the leaderboard is computed from and they contain no question text and no idea text.

The service is provided as is and as available, with no warranty of any kind. To the fullest extent the law allows, we are not liable for any loss arising from your use of it - including lost work, lost data, or anything you did on the strength of a model-written idea.

Nothing here limits any liability that cannot be limited by law.

These terms and the privacy policy change by commit, in the same repository as the code (not yet public - the privacy page says the same). The revision date at the top of each page is the date of its last change; material changes are worth reading rather than assuming.

Questions: write to benjaminliu.eecs@gmail.com.