Setting Up a Jury

The Jury page is where you invite jurors, decide how they score, and run the review in one or more rounds. Open it from Admin → Jury and pick your call, or from your call's page. This guide walks through setup in the order the page's step list follows: a rubric if you need one, a round, then your jurors. When setup is done, Running Your Jury covers the days jurors are scoring.

Turn jurying on or off

Jurying is on for every new call. The switch lives on the call, not on the Jury page: open the call, choose Edit, go to the Jury tab, and set Jurying to Enabled or Disabled.

Turn it off for a show where you accept work directly with no panel. The Jury page then shows a short notice, and you make decisions from the Submissions page. See Accepting, Rejecting and Waitlisting Submissions.

The Jury page

The page has nine tabs: Members, Rounds, Results, Awards, Waitlist, Categories, Rubrics, Conflicts and Audit. The box under the title shows which of four steps you are on and what to do next.

Rolling calls have no rounds, so Rounds and Results are replaced by a Pending Applicants tab where you admit one applicant at a time. See Rolling Calls.

Build a rubric (optional)

Skip this if jurors will vote Yes, Maybe or No on each work. Build a rubric when you want a score out of 5, or several scores such as Concept and Craft.

On the Rubrics tab, click Create Rubric, give it a Rubric Name, and add criteria with Add Criterion. Each criterion has:

Name, which jurors see.
Description (optional), the guidance jurors read while scoring. Say what a 1 and a 5 mean here.
Weight, how much the criterion counts. A criterion weighted 3 counts three times as much as one weighted 1. Weights don't need to add up to anything.
Minimum Score and Maximum Score, up to 5.

A rubric locks once a round has scores against it, so settle the criteria before scoring starts.

Create a round

A new call has no rounds. On the Rounds tab, click Create New Round. The form asks:

Round Name and an optional Description.
Scoring mode: Triage votes (Yes, Maybe or No) or Rubric criteria. For a rubric, pick it under Scoring Rubric.
Who reviews what: Every juror reviews every work, or Split the pool across jurors. A split round also asks for Minimum reviews per work.
Start Date and End Date, on your gallery's clock. The round finishes on its own at the end date. Jurors can't score after it, and a finished round can't be reopened, so leave a day of slack after the date you give your jurors.
Advancement Settings: how works go on to the next round. The sentence under the fields says exactly what will happen, for example "The top 4 works of 7 go on to Round 2. The other 3 are marked Declined." Works marked Declined get no email until you send letters. A single-round show can leave these alone: nothing advances when no round follows.
Changing Scores: whether jurors can change a score after saving it.
Blind Review: hide artist names and prices from jurors in this round. Each round has its own switch, so check it on every round of a blind show.
Scoring Reminders: tick when jurors who still have works to score get a reminder email, from 7 days to 1 hour before the end date.

Invite your jurors

On the Members tab, use the Invite Juror card.

Choose an Invitation Type. Existing Juror lists people who have juried for you before. New Juror takes a Juror Email and an optional Juror Name.
Click Send Invitation.

The invitation email carries a link. A juror without a Crafted Call account creates one from it; a juror who already has one signs in and accepts.

Invitations wait under Invitations on the Members tab, each with a status:

Pending: sent, not yet answered.
Not delivered: the email didn't go through. Check the address and click Resend.
Expired or Declined: invite again with the row's button.

When a juror accepts, they move to Current Jury Members. If you invite someone who entered work in this call, a conflict-of-interest dialog warns that they can't score their own work. See Managing Conflict of Interest Declarations.

Check the juror's view

Once a juror has accepted, View as on their row opens their review screen exactly as they will see it, marked read-only. Nothing you do there saves a score. On a blind round, check that names are hidden. Use it to catch a confusing rubric description or a missing image before your jurors do.

Open the round

On the Rounds tab, click Open Round on the round's card. For a split round, click Assign Entries to Jurors first, then Auto-Assign Submissions, then Open Round.

Before anything changes, a preview shows how many works and jurors the round has, how many works each juror gets, and who will be emailed. Anything that would stop jurors scoring is listed there with how to fix it. Click Open Round to confirm. Each juror gets an email saying scoring has started, and the confirmation tells you how many were emailed.

A paper jury sheet

Some jurors like to mark works on paper as well. Print Jury Sheet on the Jury page prints one row per work with an entry number, a thumbnail, the title, medium and size, and an empty In, Maybe and Out box. On a blind round it shows no artist names and no prices. Jurors can print their own copy from their review page.

Hide artist identities

Blind Jury Review on the call editor's Jury tab sets the starting point for new rounds; each round's own Blind Review switch decides what jurors see. Automatic redaction also strips identifying details from titles, statements and documents. See Blind Jurying and Automatic Redaction.