Configure Top pick

The Top pick reviewing mode allows reviewers to choose their top application preferences. Out of a field of applications, reviewers pick their favourites and number them in order of preference. As the quantity of ranked picks allowed per reviewer is usually quite low, this reviewing mode requires a large field of reviewers, or a small number of applications, for viable results. Otherwise, the volume of intersecting picks on applications may be too low for conclusive results.

To determine the result, Good Grants uses the single transferable vote method of counting. The single transferable vote (STV) is a voting system designed to achieve proportional representation through ranked voting for multi-winner outcomes. The system is used for elections across much of the English-speaking world. For more details, see: Single transferable voting explained.

To set up top pick, three things need to be configured:

• A reviewing round to control the access period
• A top pick score set to record picks
• Panel(s) to assign who can pick which applications

To configure a Top pick reviewing round, you can follow the steps below or simply utilise the reviewing fast start. 

Set up a reviewing round

1. In the Manage workspace, go to Reviewing > Settings > Rounds
2. Create a new round, setting the type to Reviewing
3. Set Starts and Ends dates for the Top pick period

For more detailed instructions, see: Ultimate guide to rounds.

Create a Top pick score set

1. From the Manage workspace, navigate to Reviewing > Settings > Score sets
2. Create a new score set, choosing your desired form if multiple are configured
3. Set the reviewing mode to Top pick
4. Top pick configuration options include:
   • Order (not currently used)
   • Top pick mode
     Winner calculations can either be by category, or across all categories linked to the score set.
   • Quantity of winners
     The STV calculation relies on a target quantity of winners out of the total pool of applications.
   • Quantity of preferences to allocate
     The quantity of picks that each user can make across the pool of applications. E.g. If quantity of preferences is set to 5, each user can make 5 picks from 1 to 5 (first choice through fifth choice).
5. Once you have all options configured, click Save.

Under the 'Display' tab, you have many other options such as:

• Layout: controls whether application content is displayed in the default mixed style or with an emphasis on visual content.
• Category quick filter: to enable reviewers to filter by a category quickly
• Order applications: choose the order in which you want to display applications for reviewers
• List length default: choose the number of applications your reviewers see in their reviewing list view. This setting makes it easier for reviewers who have a lot of applications view everything at once. Options include 10, 25, 50, and 100 applications per page.
• Commenting options: choose if reviewers can leave a comment on the application and if that comment is mandatory. You can also select if reviewers should be able to see each other's comments.
• Attachment options: choose if attachments should be displayed and/or available for download.
• Share scores: Control whether you display scores from another score set to reviewers on this score set. See more about displaying score matrixes to reviewers.
• Slideshow and Display: choose if you want to create a slideshow for all media in the application and choose to show/hide the application and applicant name. You can also choose to include scoring boxes on the reviewer PDF.

• Cover image: choose to display a logo or image with the score set for judges with concurrent score set assignments. 

  

  Tip: to upload a cover image, save the score set and click back into it.

Create reviewing panels

1. In the Manage workspace, go to Reviewing > Settings > Panels
2. Create a New panel, selecting your desired form if multiple are configured
3. Choose Top pick as the reviewing mode, and select the score set created earlier
4. In the Applications section, check the categories/chapters/tags for applications that can be picked.
5. In the Who section select who will be allowed to pick applications.
6. In the When section choose the appropriate reviewing round
7. Click Save

Wrapping up

Once all the above is done, if you've added yourself to a reviewing panel, you can open the Review workspace and navigate to Applications to begin picking.

This view now includes a progress bar that will show reviewers their progress at a glance. There's also a toggle that toggles between all applications and a reviewer's own picks. This is particularly useful when reviewers have hundreds of applications in their view. They can use the toggle to restrict the view to just the applications they've selected.