Top pick is for users to choose and rank their top application preferences. Out of a field of applications, reviewers pick their favourites and number them in order of preference. As the quantity of ranked picks allowed per reviewer is usually quite low, this reviewing mode really requires a large field of reviewers, or a small number of applications, for viable results. Otherwise, the volume of intersecting picks on applications may be too low for conclusive results.
To determine the result, we use the single transferable vote method of counting. The single transferable vote (STV) is a voting system designed to achieve proportional representation through ranked voting for multi-winner outcomes. The system is used for elections across much of the English-speaking world. For more details, see how Top pick (Single Transferable Voting) works.
To set up top pick requires three things to be configured:
- A reviewing round to control access period
- A top pick score set to record picks
- Panel(s) to assign who can pick which applications
Set up a reviewing round
- Go to Settings > Rounds
- Create a new round, setting the type to Reviewing
- Set start and end dates for top pick period
For more detailed instructions, see Round configuration.
Create a top pick score set
- Go to Reviewing > Score sets
- Create a new score set, setting the reviewing mode to Top pick
- Top pick configuration options include:
Order (not currently used)
Top pick mode
Winner calculations can either be by category, or across all categories linked to the score set.
Quantity of winners
The STV calculation relies on a target quantity of winners out of the total pool of applications.
Quantity of preferences to allocate
The quantity of picks that each user can make across the pool of applications. E.g. If quantity of preferences is set to 5, each user can make 5 picks from 1 to 5 (first choice through fifth choice).
- Once you have all options configured, click Save.
Under the Display tab, you have many other options such as:
- Category quick filter: to enable reviewers to filter by a category quickly
- Order applications: choose the order in which you want to display applications for reviewers
- List length default: choose the number of applications your reviewers see in their reviewing list view. This setting makes it easier for reviewers who have a lot of applications view everything at once. Options include 10, 25, 50, and 100 applications per page.
- Commenting options: choose if reviewers can leave a comment on the overall application or individual scores and if the comments are mandatory. You can also select if reviewers should be able to see each other's comments
- Attachment options: choose if attachments should be displayed and/or available for download
- Share scores: Control whether you display scores from another score set to reviewers on this score set. See more about displaying score matrixes to reviewers.
- Slideshow and Display: choose if you want to create a slideshow for all media in the application and choose to show/hide application and applicant name. You can also choose to include scoring boxes on the reviewer PDF.
Create reviewing panels
- Go to Reviewing > Panels
- Create a New panel
- Choose Top pick as the reviewing mode, and select the score set created earlier
- In the Applications section, check the categories/chapters/tags for applications that can be picked.
- In the Who section select who will be allowed to pick applications.
- In the When section, check the round configured earlier, for when picking applications will be permitted.
- Click Save.
Once all the above is done, refresh the page and if you’re on a top pick panel and the top pick reviewing round is currently open, you will see a Reviewing Pick applications link in the navigation.
This view now includes a progress bar which will show reviewers their progress at a glance. There's also a toggle that toggles between all applications and a reviewer's own picks. This is particularly useful when reviewers have hundreds of applications in their view. They can use the toggle to restrict the view to just the applications they've selected.