Why can't reviewers see or evaluate applications?

 

If you have configured your reviewing and notified reviewers to begin evaluation, but they cannot see or score their assigned applications, review the list of troubleshooting steps below.

Reviewing round

A common issue is that the reviewing round is not open. The round dates may have been set incorrectly or left over from a previous testing period.

You can check and update round dates in the Manage workspace under Reviewing > Settings > Rounds.

If the round is in the future or the past, reviewers will not be able to access their assignments.

Reviewing panel

If a panel does not contain applications, reviewers will see nothing to evaluate. 

You can check panels in the Manage workspace under Reviewing > Settings > Panels.

If the 'Applications' column shows 0, open the panel and ensure that:

  • Only include moderation approved applications is not selected unless moderation is being used
  • One or more categories are selected
  • If a tag is selected, applications have that tag applied
  • One or more reviewers or roles are selected
  • The correct round is selected

Submitted applications

Judges can only see submitted applications. To confirm that submitted applications exist:

  1. Open the Manage workspace and go to Applications
  2. Select your form
  3. Click Advanced in the search bar
  4. Filter by the category (if applicable)
  5. Set the Status filter to Submitted
  6. Click Search

If no results appear, there are no submitted applications for that category.

Aligned scoring criteria

If your program uses the Scoring reviewing mode, scoring criteria may be aligned to specific fields.

If you align scoring criteria with a field, ensure:

  • The field is visible to reviewers in the 'Display' tab of the score set
  • The field applies to the categories being reviewed

If a field is not available in reviewing, any criteria aligned with that field will not appear either.

Reviewer's email

Check that the reviewer is signing in with the correct email address. If a user has multiple accounts, the reviewer role may not be assigned to the account they are using.

Browser cache

If judges still cannot see entries, ask them to perform a hard refresh. A cached page may prevent new information from loading.

For full steps on clearing cache, see: Clearing your browser cache.

How to troubleshoot: preview as a user

You can preview the platform as a reviewer to determine whether the issue is local to the reviewer's device or caused by configuration.

If you can see the applications while previewing as the reviewer, the issue is likely on their side.

If you cannot see applications, the issue lies in the configuration.

See the guide Preview as a user for more details.

Good to know

  • Check that the 'Reviewing view' in the round is set to Scoring, not Viewing only,
  • You can add yourself to a panel to test visibility from the reviewer's perspective.
  • Ensure applications are properly submitted, not in progress.
  • Criteria aligned with hidden or inapplicable fields will not appear
  • Hard refresh: Shift + Refresh in most browsers.
Was this article helpful?
0 out of 0 found this helpful

Articles in this section

See more