Setting Up a Jury: Rounds, Rubrics & Blind Review | Jury & Review | Crafted Call | Crafted Call
Setting Up a Jury: Rounds, Rubrics & Blind Review
Gallery OwnersUpdated Apr 17, 2026
Setting Up a Jury: Rounds, Rubrics & Blind Review
A rigorous jury process ensures fair, transparent evaluation of submissions. Crafted Call's jury tools let you invite multiple jurors, define scoring criteria, run multi-round evaluations, and optionally hide artist identity for unbiased review. This guide walks you through setting up a jury from start to finish.
Accessing the Jury Tab
Navigate to Calls → [Your Call] → Jury. This is your jury command center. You'll see tabs for:
Jurors: Manage who's evaluating
Rubric: Define scoring criteria
Rounds: Set up evaluation stages
Scores: View results and decisions
Inviting Jurors
Your jury can be 1 person (you, the curator) or many (professional jurors, peer artists, community members). The process is the same.
Step 1: Add jurors
Click Invite Jurors. You'll see a form to enter juror information.
Step 2: Enter juror details
Name: Full name (visible to other jurors and you)
Email: Where the invitation link is sent
Role (optional): "Lead juror", "Community panelist", etc. Helps organize who's voting
Conflict of Interest note (optional): If you know they have conflicts in advance, note them here. The juror will be prompted to declare conflicts when they start evaluating.
Step 3: Select assignment mode
How will jurors see submissions?
All jurors see all submissions: Every juror evaluates every work. Good for small calls (under 100 submissions) or when you want consensus scoring.
Distributed evaluation: Submissions are divided among jurors. Each juror evaluates a subset. Faster for large calls, but you don't get consensus per work.
Manual assignment: You choose which juror evaluates which submission(s). Useful for specialized expertise (e.g., one juror is a photographer who only scores photo submissions).
Step 4: Send invitation
Click Send Invite. Crafted Call emails the juror a unique link. They click it, create a Crafted Call account (or log in if they have one), and gain access to the jury interface for this call.
They don't need a full Crafted Call account; the jury access token is temporary and call-specific.
Was this article helpful?
Tip: Send jury invitations 1–2 weeks before you want evaluation to start. This gives jurors time to accept and prepare. Send a reminder 3 days before the start date.
Defining Your Rubric
A rubric is the scoring framework jurors use. It defines criteria and how each is weighted.
Creating a Rubric
Step 1: Navigate to Rubric
In the jury tab, select Rubric. Click Create Rubric if none exists.
Step 2: Add criteria
Each criterion is a category jurors score. Examples:
Artistic Vision: Does the work show originality and vision?
Technical Skill: Is the work well-executed?
Fit with Gallery: Does it align with the gallery's aesthetic/mission?
Conceptual Depth: Is there meaningful concept behind the work?
Innovation: Does it push boundaries or explore new territory?
For each criterion, set:
Name: Short title (as above)
Description: What jurors should consider. Example:
"Does the artist demonstrate a clear and distinctive voice? Is the work original, or derivative?"
Score range: Typically 1–5 or 1–10
Weight: How much this criterion counts toward the final score
Artistic Vision: 30%
Technical Skill: 20%
Fit with Gallery: 30%
Conceptual Depth: 20%
Weights must sum to 100%. Crafted Call calculates the weighted final score automatically.
Step 3: Set scoring guidance
Optionally, define what each score means:
1 = Poor: Work doesn't meet basic standards
2 = Fair: Competent but not compelling
3 = Good: Strong work, meets criteria well
4 = Excellent: Exceptional, standout work
5 = Outstanding: Best-in-show caliber
Providing definitions reduces scoring variance between jurors.
Standard Rubrics by Call Type
Juried Group Show (art quality focused)
Artistic Vision (30%)
Technical Execution (25%)
Originality (25%)
Alignment with Theme (20%)
Open Studio / Community Show (participation focused)
Diversity of medium/approach (25%)
Community representation (25%)
Technical quality (25%)
Visitor appeal (25%)
Photography Call
Composition & Lighting (30%)
Conceptual Strength (30%)
Technical Quality (20%)
Originality (20%)
Tip: Ask your jury to collaborate on the rubric. They'll feel more ownership and provide better scores if they helped define criteria.
Scoring Modes
Define whether jurors score individual submissions or individual images within submissions.
Per-Submission Scoring
Jurors see all images of a work together and provide one score per submission. This is the standard mode.
Use when: You care about the body of work as a whole, not individual pieces.
Per-Image Scoring
Jurors score each image separately. Use if:
An artist submitted a 5-image series and you might accept 2–3 of the 5
You're showing individual photographs or prints, not sets
Different images have different quality levels
Per-image scoring generates more granular data but takes jurors longer.
Multi-Round Evaluation
For large or competitive calls, run multiple evaluation rounds. Example structure:
Round 1: Initial Screening
All jurors see all submissions (or distributed)
Quick scores on a simple rubric (3 criteria)
Goal: Narrow 500 submissions to 150
Advancement rule: Top 30% by score advance to Round 2
Round 2: Deep Evaluation
150 submissions go to jury
Jurors score with full rubric (5 criteria)
Goal: Rank finalists and identify acceptances
Advancement rule: Top 15 by score advance to Round 3
Round 3: Final Review & Discussion
15 finalists reviewed
Jurors may discuss, provide written feedback
Goal: Make final 10 acceptances + waitlist
Advancement rule: Manual selection (you pick top 10 to accept)
Creating Rounds
Step 1: Click Add Round
In the Jury tab, go to Rounds. Click Add Round.
Step 2: Name the round
"Round 1 - Screening", "Round 2 - Finalists", "Round 3 - Final", etc.
Step 3: Set duration
Start date: When jurors can start evaluating
End date: Deadline for scores to be submitted
Rubric for this round: You can use different rubrics per round (simple for Round 1, detailed for Round 2)
Step 4: Set advancement rule
How many submissions move to the next round?
Top percentage: Top 30% by average score
Top count: Top 50 submissions by score
Score threshold: Any submission scoring 3.5 or higher (if your rubric is 1–5)
Manual selection: You manually choose which submissions advance. Jurors don't need to know the rule.
Step 5: Configure the next round
Create Round 2 with its own duration, rubric, and advancement rule. Repeat for Round 3 if needed.
Tip: First rounds should be quick (1–2 weeks). Final round takes longer as jurors deliberate carefully. Stagger deadlines across 4–6 weeks total for a competitive call.
Running a Round
Once Round 1 starts:
Jurors access the jury interface and see their assigned submissions
They score using your rubric
On the Round 1 end date, scoring closes
Crafted Call auto-calculates scores, applies the advancement rule
Submissions that advanced are compiled into Round 2
Notifications are sent to jurors (if you enabled them)
Round 2 begins
Blind Review
Blind review hides artist identity from jurors. This eliminates reputation bias and ensures fair evaluation based purely on artistic merit.
Enabling Blind Review
Step 1: Toggle on blind review
In the Jury settings, select Enable Blind Review.
Step 2: Choose what's hidden
Hide artist name: ✓
Hide artist bio: ✓
Hide artist website: ✓
Hide custom field data: (optional; depends on your needs)
By default, artist name and contact info are replaced with "Artist [ID]" (e.g., "Artist 1427"). Jurors see only the work.
Step 3: What jurors see
Work title
All images
Dimensions, medium, price (if relevant)
Custom field responses (if you didn't hide them)
Your gallery's notes (if any)
Jurors do not see:
Artist name or email
Artist bio or statement
Artist website or social media
Previous exhibition history
After Blind Review
Once jury scoring is complete, you (the admin) can link scores back to artist identities and send acceptance/rejection notifications. The scoring process was blind, but the outcomes are fully transparent.
Important: Blind review is only as good as your implementation. If a juror recognizes an artist's style or knows the work, disclosure is their responsibility. You might ask jurors in their invitation: "If you recognize a submission from someone with a conflict of interest, please declare it immediately."
Assignment Modes in Detail
All Jurors See All Submissions
Every juror evaluates every submission. Useful for:
Small calls (under 100 submissions)
Important decisions where consensus matters
Jury discussions (jurors can compare notes on works everyone saw)
Drawback: Slow for large calls. 5 jurors × 300 submissions = 1,500 evaluations to complete.
Distributed Evaluation
Crafted Call divides submissions evenly among jurors. Each juror evaluates ~1/5 of the pool.
Example: 500 submissions, 5 jurors. Each juror gets 100 submissions.
Benefits: Faster, manageable workload per juror (100 vs 500)
Drawback: No consensus per submission; single juror decides
Use for: Large calls where speed matters, early screening rounds, or low-stakes decisions.
Manual Assignment
You choose which submissions each juror evaluates. Useful for:
Assigning specialized jurors (photographer juror evaluates all photo submissions)
Balancing workload based on juror expertise or availability
Ensuring key submissions get specific jurors
To manually assign:
Open the Jury tab
Go to Assignments
Click and drag submissions to juror columns, or bulk-assign by topic/medium
Save assignments
Best Practices for Jury Setup
Define criteria collaboratively: Involve your jurors in rubric creation. They'll provide better scores and feel invested in the process.
Test the jury interface: Have a juror do a test evaluation before the official round starts. Catch any clarity issues with scoring instructions.
Provide scoring guidance: Include definitions for each score level (1=Poor, 5=Outstanding). Reduces variance.
Start with a small jury: 3–5 jurors is ideal for consistency. Large juries (8+) are harder to coordinate and can dilute decision-making.
Use blind review for competitive calls: If selecting winners from a large pool, blind review ensures fairness. Skip it for community-focused shows where artist identity matters.
Stagger round deadlines: Avoid back-to-back deadlines. Give jurors 2–3 days between round closure and the next opening.
Communicate expectations: Tell jurors upfront how long scoring should take, what the rubric measures, and when results will be shared.
Next steps: Once your jury is configured, learn how to manage conflicts of interest in "Managing Conflict of Interest Declarations."