There are two features available in LAT to assist with measuring inter-rater reliability.
The Multiple Evaluation capability requires multiple evaluations for a single submission. In this case, at least one individual must be given the Reconciler permission. This permission enables you to reconcile multiple evaluations, suspend evaluation and call for additional evaluations of any work submission. By default, the Author can access only the final reconciled evaluation.
The Outside Evaluation capability provides the opportunity for an additional Evaluator to evaluate the submission. The Outside Evaluation is compared to the final evaluation within the Final Evaluation versus Outside Evaluation Report. This outside evaluation is not released to the Author and is kept completely separate from the final evaluation.
