Score Normalization and Results

The Results tab (Admin → Jurying, then open your call) is where the panel's scoring becomes a ranking you can act on. It holds the score summaries for a round, a switch that adjusts for jurors who score high or low as a habit, the full results table, and the controls that turn the ranking into decisions. This guide covers reading the results and deciding whether to normalize.

Pick a round first

Everything on this tab is scoped to one round. Use the round selector at the top before you read any number. A summary that looks wrong is often the right summary for the wrong round.

The score summaries

Three cards sit side by side, and which one carries your data depends on how the round was scored:

Triage Summary, for rounds where jurors voted Yes, Maybe or No.
Ranking Summary, for rounds where jurors put entries in order.
Rubric Summary, for rounds scored against criteria.

Score normalization

Jurors do not share a scale. One panelist treats 3 out of 5 as solid work, another never gives below a 4. Averaging them raw lets the generous juror carry more weight than the strict one, purely as an artefact of habit.

Normalization corrects for that. Each juror's scores are adjusted against their own scoring pattern, so what counts is where a juror placed an entry relative to everything else they scored, not the absolute number they wrote down.

The switch is on the Rubric Summary card. It reads Raw Scores when off and Normalized Scores when on, and it starts off. Flipping it recalculates immediately, and you can flip back.

Normalize when your panel has three or more jurors and the Analytics page shows their averages diverging. See Monitoring Jury Progress.

Stay on raw scores when the panel is one or two people, when your rubric has an absolute meaning you want preserved, such as a minimum technical standard, or when you have promised artists a published scoring scale. Normalized numbers are comparable to each other but no longer read as marks out of five.

Decide before you finalize, not after. The ranking you accept from should be the ranking you looked at.

The results table

Below the summaries, four counts show the state of the call: Total Reviewed, Accepted, Rejected and Undecided. Filter the table by status with All Status, Accepted, Rejected or Undecided.

Sort by clicking the Submission, Votes or Status column headings. The headings are buttons, so you can also reach them with the Tab key and sort with Enter or Space without using a mouse.

The Source column says where each decision came from. Auto-applied means a round's advancement rule set it, Admin means a person did, and Pending means the entry is still undecided. Use it when someone asks why a piece was cut: it separates the entries the cutoff handled from the ones a curator chose.

Switch between the table and a gallery view of the same results when you want to see the work rather than the numbers. Both respect the filter and the round you selected.

Export CSV downloads the results for your own analysis or your records. Use it before you finalize, so you keep the ranking as it stood at the moment of decision. Send Decision Notifications takes you into the email step once decisions are made.

Entries with few reviews

A high average from two jurors is a weaker signal than a slightly lower average from six. Check the Votes column before you trust a ranking near your cutoff, and sort by it to find entries the panel under-covered. Those are worth a look by eye rather than an automatic accept or reject.

Turning results into decisions

The finalize controls sit on this same tab, directly under the results table, and so does the switch that shares scores back with artists. Both are covered in Finalizing Jury Decisions.