Recommendation reviewing

Recommendation reviewing is used when numerical scoring alone is not suitable.

Instead of assigning a score, reviewers select a label such as:

• Gold
• Silver
• Bronze
• Best in show
• Highly commended

Recommendation reviewing is configured using the Scoring mode framework.

Step 1: create a score set

Recommendation reviewing must use Scoring mode.

1. In the Manage workspace, go to Reviewing > Settings > Score sets
2. Click New score set and choose your form
3. Select Scoring under 'Reviewing mode'
4. Enter a clear score set name (for example, Stage 1)
5. Click Save

For detailed explanations of score set settings, see Configure a score set.

Step 2: configure recommendation criteria

Recommendation reviewing uses scoring criteria, but reviewers select a word or phrase instead of a number.

1. In the Manage workspace, go to Reviewing > Settings > Scoring criteria
2. Click New criterion and choose your form
3. Enter a Score title (maximum 32 characters)
4. Enter a Shortcode for exports and summary tables
5. Select your Scoring score set
6. Under 'Control', choose Recommendation
   • Three default options (Gold, Silver, and Bronze) will appear. You can:
     • Edit the labels and associated scores
     • Add additional options using the + icon
     • Reorder options by dragging
7. Enter a Weight value
8. Configure commenting options if required
9. Optionally align the criterion with a specific application field
10. Set an Order value (if not aligned to a field)
11. Select applicable categories
12. Click Save

Recommendation options appear to reviewers similarly to standard scoring criteria as shown below.

Step 3: configure a reviewing round

1. In the Manage workspace, go to Reviewing > Settings > Rounds
2. Click Add round and choose your form
3. Select Reviewing round
4. Set start and end dates and times
5. Click Save

For more information, see the guide: Ultimate guide to rounds.

Step 4: create a reviewing panel

Panels determine which reviewers evaluate which applications.

1. In the Manage workspace, go to Reviewing > Settings > Panels
2. Click New panel and choose your form
3. Choose your score set
4. In 'Applications', select the relevant categories, chapters, and/or tags
5. In 'Who', select the reviewers or roles
6. In 'When', select the reviewing round
7. Click Save

Learn more about panels in the Create a reviewing panel guide.

Good to know

• Recommendation criteria cannot be created via Reviewing fast start.
• Each recommendation option must have a unique score value.
• If recommendations should not impact the overall result, set the Weight to 0.
• If aligning with a conditional field, the criterion may not always appear. In this case, consider using the Mean result calculation for the score set.
• Reviewers can see recommendation selections in their list view.
• The leaderboard can display counts for each recommendation option via the column selector.
• Recommendation results are not included in standard Scoring results exports, but they can be added via a custom export.