Configure Scoring mode

Numerical evaluation of applications in Good Grants is called Scoring.

Scoring allows you to configure a fully customisable scoring rubric. Each reviewing stage requires the following:

• A score set 
• Scoring criteria
• A reviewing round
• Reviewers
• One or more reviewing panels

You can configure Scoring mode manually using the steps below or use the Using the Reviewing fast start.

Create a score set

A score set defines a discrete reviewing stage. You can run multiple score sets at the same time.

1. In the Manage workspace, go to Reviewing > Settings > Score sets
2. Click New score set and choose your form
3. In the 'Details; tab, select Scoring under 'Reviewing mode'
4. Enter a clear Score set name (visible to reviewers)
5. In the 'Display' tab, select from the configurable options:
   • Layout
   • Category quick filter
   • Application order
   • List length
   • Abstention and conflict of interest
   • Commenting options
   • Attachment display and downloads
   • Referee details
   • Image gallery display
   • Share scores from another score set
   • Slideshow options
   • Score matrix
   • Cover image
   • Field visibility
6. Click Save

For more information on score set options, see the Configure a score set guide.

Configure scoring criteria

Scoring criteria are required for Scoring mode.

Each criterion contributes to the total score for the score set. For example,

• Criterion A — max 10 points
• Criterion B — max 30 points
• Maximum total — 40 points

To configure a criterion:

1. In the Manage workspace, go to Reviewing > Settings > Scoring criteria
2. Click New criterion and choose your form
3. Enter a Score title (required, max 32 characters)
4. Enter a Shortcode
5. Add Label, Help text, or Hint text if required
6. Select the relevant Score set
7. Choose a Control type
   • Select score (default dropdown)
   • Slider
   • Keyboard input
   • Recommendation
8. Set the Maximum score
9. Configure the Weight if required
10. Set commenting options
11. Align the score with an application field if required
12. Set the display Order (if not aligned)
13. Select applicable Categories
14. Click Save

For more information on scoring criteria configuration, see the Scoring criteria guide.

Set up a reviewing round

Reviewing rounds control when reviewers can access their assignments.

1. In the Manage workspace, go to Reviewing > Settings > Rounds
2. Click Add round and choose your form
3. Select Reviewing round
4. Set the Start and End date/time
5. Click Save

For more information on round configuration, see the Ultimate guide to rounds.

Add reviewers

Reviewers must exist as users before they can score applications.

1. In the Manage workspace, go to Users
2. Add or import reviewers

See the Adding reviewers guide for detailed instructions.

Create a reviewing panel

Panels determine which reviewers score which applications. You may create multiple panels per score set—for example, one per category.

1. In the Manage workspace, go to Reviewing > Settings > Panels
2. Click New panel and choose your form
3. Select the relevant Score set
4. In the 'Applications' section, select categories, chapters, and/or tags
5. Configure moderation and archived applications options if required
6. In the 'Who' section, select eligible reviewers
7. In the 'When' section, select the reviewing round
8. Click Save

Good to know

• The score set name is visible to reviewers—keep it clear and concise.
• The visual content layout configurable in the score set ignores scoring alignment for media files.
• The score matrix pop-up displays up to 200 applications.
• Images larger than 16,300px square cannot display as thumbnails.
• Weighted scores are calculated as score × weight.
• A weight of 0 may be used when result calculation is set to Mean. If aligning criteria to conditional fields, consider using Mean calculation
• Add yourself to panels to test configuration.
• If setting up reviewing before applications exist, create test applications. Test applications can be deleted or moderation rejected to avoid affecting results.
• Programs with more specific reviewer and application pairing requirements may choose to use manual or random assignments instead.