ImagePuzzle is open to new contributors

The human data frontier AI is measured against.

Animai Tech builds and runs data platforms for AI evaluation. Contributors around the world submit original photographs and the reasoning behind them; a person reviews every one, and accepted work is paid weekly.

Building model evals? Talk to us →
  • 3,000 px minimum, original and unpublished
  • Every task reviewed by a person
  • Paid weekly — USDT, USDC or BTC
Photograph of two pressure dials on a pipe manifold, each framed by a locator box. The left dial reads 4.2 bar, the right dial 3.6 bar. 0123456bar 0123456bar step 1 · left dial step 2 · right dial 4288 × 3216
Example · annotated task4 steps Which of the two dials reads higher, and by how much? Golden answer left · 0.6 bar ± 0.1 Reviewed by a personaccepted · +$5.00

How it works

From photograph to payout in four steps.

One account, one review process, one weekly payout — whichever project you work on.

  1. Create an account

    Sign up and join a project. Each project you join gives you a member ID; the account stays the same.

  2. Photograph and write it up

    Submit an original photograph at full resolution with the idea behind it — or build a fully annotated task on it.

  3. A person reviews it

    Accepted, sent back for revision, or declined — always with a written reason.

  4. Get paid weekly

    Accepted work is paid weekly in crypto, to your own wallet, on the network you choose.

Two ways to contribute

Choose how much of the work you take on.

Both start from a photograph you took yourself, at least 3,000 px on the long edge and never published.

Image and idea

A photograph and the idea behind it

$2per accepted submission

  • Your own original photograph, never published
  • Full resolution — at least 3,000 px on the long edge
  • The idea behind the picture, in your own words

Annotated task

A complete task, ready to grade

$5per accepted submission

  • A prompt a frontier model should fail
  • One machine-checkable golden answer — an exact string, a number with units ± tolerance, or a closed set
  • 2–12 numbered steps — perception steps with boxes drawn on the image, and reasoning steps
  • A classification for the task

Referral bonus: $1 per accepted submission by someone you invited.These are ImagePuzzle’s rates; each project sets its own.

Projects

One account, every project.

Your account is shared across the platform. Each project you join gives you its own member ID.

Live

ImagePuzzle

Images and reasoning the best models get wrong.

  • Image and idea — $2 per accepted submission
  • Annotated task — $5 per accepted submission
  • Annotation workspace with locator boxes

More projects join the same account

When a new project opens, you join it from the account you already have and get a member ID for it. No second sign-up, no second payout address.

For AI teams

Evaluation data you can audit.

We collect, review and keep the record for the images and tasks frontier models are measured against.

  • Original, unpublished, high-resolution imagery

    Photographs taken by contributors and never published before, at full resolution with at least 3,000 px on the long edge.

  • Kept only when frontier models fail

    A task stays in the set only if frontier models get it wrong, and every task has one machine-checkable golden answer.

  • Full provenance on every item

    Who reviewed it, what they decided and the written reason — recorded for each item.

Provenance recordaccepted
Item
animai_005_0003
Type
annotated task · 4 steps
Image
4288 × 3216 px, original
Golden answer
left · 0.6 bar ± 0.1
Reviewer
rev_0142
Decision
accepted
Reason
Both needles legible at full size; steps match the boxes.

Illustrative. Every delivered item carries these fields.

Quality and trust

A person reads every submission.

Each decision is made by a reviewer and comes with a reason you can read.

  1. Submitted

    Your photograph or task enters the project’s review queue.

  2. Reviewed by a person

    A reviewer checks it against the project’s contributor guide.

  3. Decision, with a written reason

    AcceptedSent back for revisionDeclined

    Sent back means you can fix it and resubmit.

  4. Paid weekly

    Accepted work is paid in the weekly payout, to your own wallet.

  • Every submission is reviewed by a person.
  • Every decision comes with a written reason.
  • Paid to your own wallet, on the network you choose: USDT (TRC20), USDT (ERC20), USDC (Polygon), USDC (Solana) or BTC.
  • We never ask you for payment or wallet seed phrases.
  • You submit only your own original work.

Talk to a person

Careers

Work on the review side.

We hire reviewers, annotators and project leads. Being hired enrols you in the role’s project.

Reviewers

Decide what is accepted

Read submissions and accept, send back for revision, or decline — with a written reason every time.

Annotators

Build complete tasks

Write the prompt, the golden answer and the numbered steps, with boxes drawn on the image.

Project leads

Run a project

Lead a project on the platform and the people who contribute to it.

FAQ

Questions, answered plainly.

Who can contribute?

Anyone, anywhere — no invitation needed. Create an account, join a project, and you get a member ID for that project.

You need a camera that takes photographs of at least 3,000 px on the long edge; most current phones do.

What counts as an original photograph?

A photograph you took yourself that has never been published anywhere, submitted at its full original resolution with at least 3,000 px on the long edge. Downloaded, generated or someone else’s images do not qualify.

How and when am I paid?

Weekly, in crypto, to your own wallet. Each accepted submission is paid at the project’s rate — on ImagePuzzle, $2 for an image and idea and $5 for an annotated task.

Which networks are supported?

USDT (TRC20), USDT (ERC20), USDC (Polygon), USDC (Solana) and BTC. You choose the network and give us your own wallet address. We never ask you for payment or for a wallet seed phrase.

What happens if my submission is declined?

Every decision comes with a written reason from the reviewer. A declined submission is not paid, but the reason tells you what to change next time. If a submission is sent back for revision instead, you can fix it and resubmit.

How does the referral bonus work?

When someone you invited has a submission accepted, you earn $1 for it, on top of their own payment. That is ImagePuzzle’s rate; each project sets its own.

Do I need prior experience?

No. The contributor guide explains what a strong submission looks like, and anything that falls short comes back with a written reason, so you learn the standard as you go.

Who sees my photos?

The reviewers on the project see your submission while it is reviewed. Accepted submissions become part of the AI evaluation datasets Animai Tech builds; by submitting, you grant us the right to use accepted work for that. The privacy notice explains what we store.

Your judgement is the benchmark.

Photograph what a model would misread, write down why, and get paid weekly when a person accepts it.