Adding/Managing Evaluators for an Assessment Project

Evaluators can be added and managed from the Evaluator Settings area within an assessment project.

The Evaluator Settings area in an assessment project:

1. Displays a list of already added evaluators to the assessment project.
2. Enables project administrators to add new evaluators to the assessment project.
3. Manage additional settings like outcome assignment, evaluator type, and the maximum evaluation cap for new and existing evaluators.

Outcome Assignment for Evaluators

If the Outcome Assignment option (please refer to the screen-shot below) is enabled for the assessment project, evaluators would need to be aligned with relevant outcomes added to the assessment project to be assigned relevant artifacts for evaluations.

NOTE: Evaluators do not need to aligned with outcomes if the Outcome Assignment option is not enabled for the assessment project.

Evaluator Type / Evaluation Queue Type

Evaluators can be designated as being eligible only to be assigned discrepancy evaluations (i.e. the Discrepancy Only option) or can be designated as being eligible to be assigned any kind of evaluations (i.e. the All Evaluations option).

If an evaluator is designated as a Discrepancy Only evaluator, they will only be assigned relevant discrepancy evaluations and will not be assigned any evaluations from the initial / usual evaluation cycle.

NOTE: The Evaluator Type / Evaluation Queue Type selection for an added evaluator can only be modified before the assessment project has been opened for evaluations.

Maximum Evaluations Cap

If project administrators want to set a limit to the number of evaluations that automatically get assigned to an evaluator, a maximum evaluation cap can be set for the evaluator.

NOTE: The Maximum Evaluations field can be left blank for evaluators who do not need to be assigned an evaluation cap. Setting an evaluation cap for evaluators is optional and the evaluation cap can be modified even after a project has been opened for evaluations. However, after a project is open for evaluations, the Maximum Evaluations cap for an evaluator cannot be reduced to a value lower that the count of already assigned evaluations to the evaluator.

Adding evaluators to a Draft project

To add evaluators to a draft assessment project project (i.e. a project that has not yet been opened for evaluations):

1. Access the Evaluator Settings area of the assessment project and click the Add Evaluator button

   

   If Outcome Assignments is enabled for the project, a list of outcome added to the project will be displayed along with any evaluators that have been aligned with those outcomes.

2. At the first step, select the users to be added as evaluators to the assessment project.

   

   You can search for a user from the list by their name.

3. At the second step, choose the outcomes with which you want to align the evaluators selected in the first step.

   

   1. All evaluators selected in the first step will by default be aligned with all outcomes from the assessment project. Remove the evaluators from the outcomes that they should not be aligned with.

   2. If an evaluator is accidentally removed from an outcome, you can go back to the first step, deselect and then reselect the checkbox for the evaluator, and return to the second step to find them added back to all outcomes from the assessment project.

   3. NOTE: The step to align evaluators to outcomes will only be displayed if the Outcome Assignment option is enabled for the assessment project.

4. At the third step, make the required selection for Queue Type and add the required Maximum Evaluation cap value for the required evaluators and click Save.
5. The added evaluators will be listed in the Evaluator Settings area. A specific evaluator can be searched for based on the evaluators name or email or the list of evaluators can be filtered by Queue Type (i.e. the Discrepancy Only or All Evaluations options).

NOTE: Evaluators can be removed from a project until an assessment project has been opened for evaluations. Once a project is Open, evaluators cannot be removed from the project.

Adding evaluators to an Open project

The steps to add evaluators to an Open project are the same as the steps to add evaluators to a Draft project. The only difference is that in case of an Open project, only a single evaluator can be added at a time (please refer to the screen-shot).

Editing details for an evaluator

To edit the settings/selections for a specific evaluator added to an assessment project:

1. Access the Evaluator Settings area of the assessment project and search for the required evaluator.

2. Click the Edit Evaluator option from the More options menu for the evaluator.

   

3. Make the required updates for Evaluation Queue, Maximum Evaluations, or Assigned Outcomes and click Save.

NOTE: Once a project is opened for evaluations, the selections for the Evaluation Queue field for an existing evaluator from the project cannot be changed. Similarly, after is opened for evaluations, the already made outcome selections for an existing evaluator cannot be removed, though the evaluator can be assigned new outcomes from the assessment project.