Score sets control the reviewing mode used in your program and determine what reviewers see when evaluating an application. You can configure multiple score sets to run different stages of reviewing—even at the same time. At least one score set is required to configure reviewing.
While every mode has different settings within the score set, some settings are common across all reviewing modes.
To create a score set:
- In the Manage workspace go to Reviewing > Settings > Score sets
- Click New score set and choose your form
- Enter a Score set name
- Choose a reviewing mode
- In the 'Rules' box, define your specifications—these options vary by reviewing mode
- Click Save
Additional options can be configured to fine tune your setup.
Details tab
The 'Details' tab includes settings that apply across all reviewing modes.
| Setting | Description |
| Confidentiality agreement | Show a confidentiality agreement to reviewers when they first access the score set. Choose the default template or create your own in Settings > Content > Content blocks. |
| Role registration form | Select an additional registration form to capture extra user information when users register for another role. Create the role registration form first and choose it from the drop-down. |
Display tab
The 'Display' tab controls how reviewing information is presented.
| Setting | Description |
| Field visibility | Show or hide fields based on what reviewers need to see. See Configure field and attachment visibility for reviewers for more information. |
| Content block | Choose a content block to provide instructions for reviewers. |
| Layout | Choose between mixed layout or visual content layout. Visual content displays media in sequence and does not follow scoring criteria alignment. |
| Category quick filter | Provide a filtering option for categories assigned to reviewers. |
| Order applications | Control the order in which applications appear for reviewers. Options include randomly for every reviewer, by application ID, category then application ID, application name, category then application name, category then random. |
| Score shown to reviewers | Display raw scores or their weighted values. See Scoring criteria for more information. |
| List length default | Choose how many applications appear per page for reviewers. Options include 10, 25, 50 and 100. |
| Abstention and conflict of interest | Allow reviewers to abstain from reviewing with optional commenting or declare a conflict of interest. |
| Commenting | Allow reviewers to leave comments on applications or specific criteria. Comments can be internal, shared between reviewers or shared with applicants. |
| Attachments | Control whether attachments are displayed for reviewers. |
| Referee | Display the name or email of referees associated with an application. Applies only if referee review is enabled. |
| Images | Choose to display file information and / or a gallery of images from fields. |
| Slideshow | Provide a slideshow view of images and videos in a new browser tab for media-heavy programs. |
| Score matrix | Show reviewers a pop-up list of their assigned applications with score breakdowns for each criterion. |
| Display | Provide reviewers with the application name, applicant name, a reviewing PDF with optional scoring boxes, and duplicate applications count or list. |
| Searchable fields | Add fields to the reviewing search filter. Reviewers can search by category, chapter, status, and any added fields. |
| Download | Allow reviewers to bulk download their assignments. |
| Cover image | Display a cover image or logo for reviewers who have multiple score sets. |
See detailed guides on configuring different reviewing modes:
Video overview
Note: this video does not display the updated abstention, conflict of interest, or commenting options.