Enabling and Using AI-Assisted Plan Review

Overview

This article explains how institution administrators enable Artificial Intelligence (AI)-Assisted Plan Review in Planning & Self Study (P&SS) and how reviewers use the feature during assessment plan evaluations. Once Watermark grants an institution access to AI Assistance, institution administrators control when AI-assisted review is available and select which plan reviews use it.

Note: If AI Assistance is already turned on at the institution level, the institution administrator still needs to enable the review feature and activate it for individual plan reviews before reviewers can use it.

Prerequisites

Before an institution administrator can enable AI-Assisted Plan Review in P&SS, Watermark must grant the institution access to the AI Assistance product feature. Institution administrators can contact their Client Success Manager (CSM) at Watermark to enable the feature. If an administrator does not know who their CSM is, they can contact Watermark Support by selecting Submit a Request.

Enabling AI-Assisted Plan Review

Once Watermark grants access to AI Assistance, institution administrators complete two steps in P&SS to turn on the feature for specific plan reviews.

Step 1: Turn On the Review Feature

The institution administrator activates the review capability at the system level before applying it to individual reviews.

  • Go to Admin > Configuration Settings > Data Objects.
  • Locate the AI Assistance section, which contains two independent settings:
    • Assessment Catalyst Toolpack - Plan Features: Provides existing AI features for plans.
    • Assessment Catalyst Toolpack - Review Feature: Makes AI-assisted review available when creating a plan review. This setting is off by default.
  • Turn on Assessment Catalyst Toolpack - Review Feature. Administrators can use the Review Feature without enabling Plan Features, or vice versa.

    Screenshot of the AI Assistance settings under Admin, Configuration Settings, and Data Objects showing toggles for Plan Features and Review Feature.

Step 2: Enable AI-Assisted Review for Individual Plan Reviews

With the Review Feature active, administrators control which specific plan reviews generate AI drafts.

  • Open the settings for a new or existing plan review.
  • Locate the AI-assisted review toggle.
  • Switch the toggle on to activate AI drafts for that plan review. The toggle is off by default for all new and existing plan reviews until an administrator opts in.
Screenshot of the plan review settings panel displaying the AI-assisted review toggle switched on.

Table 1: Client Configuration Controls for AI-Assisted Plan Review

ControlLocation in P&SSResponsible Role
Plan Features / Review FeatureAdmin > Configuration Settings > Data Objects > AI AssistanceInstitution administrator
AI-assisted review toggleReview settings, per plan reviewAdministrators

Using AI-Assisted Plan Review as a Reviewer

When a program submits an assessment plan in an enabled review, the AI Assistant drafts a complete review containing a suggested rating and feedback for every rubric criterion, plus overall feedback.

  • Automatic draft generation: The AI drafts a review from the program's submitted plan data (outcomes, measures, results, analyses, and actions) against the aligned rubric. If an administrator launches a review after programs have already submitted, the system generates drafts for all submitted programs at launch. If a program reopens and resubmits, a fresh draft reflects the latest data without overwriting saved reviewer work.
  • Draft status indicators: Programs with a generated draft display a Reviewed by AI indicator with the status Ready for Reviewer. A banner inside the review states that the AI Assistant drafted a starting point.

    Screenshot of a program plan review showing the Reviewed by AI indicator, Ready for Reviewer status, and the AI Assistant starting point banner.
  • One-click feedback insertion: AI feedback appears in a labeled, read-only AI Review panel beside each criterion. Reviewers can insert the draft into their own feedback field with one click and edit the text freely.

    Screenshot of a rubric criterion showing the read-only AI Review panel beside the editable reviewer feedback field.
  • Reviewer editorial control: AI ratings and feedback remain excluded from rubric results, Org Management progress tracking, and official reports until the reviewer saves the review. Once saved, the review belongs to the reviewer and is never replaced by regeneration.

Important Reminders

Institution administrators maintain full control over which plan reviews use AI drafting. Reviewers always retain final editorial authority, as AI-generated ratings and feedback remain private drafts until the reviewer reviews, edits, and saves the official evaluation.

Was this article helpful?
0 out of 0 found this helpful

Articles in this section

How to Contact Support
There are many ways to reach out! Click the icon above for our support options.
Watermark Academy
Click the icon above to access the Watermark Academy for consultation, training, and implementation companion courses.
Customer Community
Can’t find the answer? Ask fellow users how they’re making the most of Watermark in our Community!