Overview
This article explains how institution administrators enable Artificial Intelligence (AI)-Assisted Plan Review in Planning & Self Study (P&SS) and how reviewers use the feature during assessment plan evaluations. Once Watermark grants an institution access to AI Assistance, institution administrators control when AI-assisted review is available and select which plan reviews use it.
Note: If AI Assistance is already turned on at the institution level, the institution administrator still needs to enable the review feature and activate it for individual plan reviews before reviewers can use it.
Prerequisites
Before an institution administrator can enable AI-Assisted Plan Review in P&SS, Watermark must grant the institution access to the AI Assistance product feature. Institution administrators can contact their Client Success Manager (CSM) at Watermark to enable the feature. If an administrator does not know who their CSM is, they can contact Watermark Support by selecting Submit a Request.
Enabling AI-Assisted Plan Review
Once Watermark grants access to AI Assistance, institution administrators complete two steps in P&SS to turn on the feature for specific plan reviews.
Step 1: Turn On the Review Feature
The institution administrator activates the review capability at the system level before applying it to individual reviews.
- Go to Admin > Configuration Settings > Data Objects.
- Locate the AI Assistance section, which contains two independent settings:
- Assessment Catalyst Toolpack - Plan Features: Provides existing AI features for plans.
- Assessment Catalyst Toolpack - Review Feature: Makes AI-assisted review available when creating a plan review. This setting is off by default.
Turn on Assessment Catalyst Toolpack - Review Feature. Administrators can use the Review Feature without enabling Plan Features, or vice versa.
Step 2: Enable AI-Assisted Review for Individual Plan Reviews
With the Review Feature active, administrators control which specific plan reviews generate AI drafts.
- Open the settings for a new or existing plan review.
- Locate the AI-assisted review toggle.
- Switch the toggle on to activate AI drafts for that plan review. The toggle is off by default for all new and existing plan reviews until an administrator opts in.
Table 1: Client Configuration Controls for AI-Assisted Plan Review
| Control | Location in P&SS | Responsible Role |
|---|---|---|
| Plan Features / Review Feature | Admin > Configuration Settings > Data Objects > AI Assistance | Institution administrator |
| AI-assisted review toggle | Review settings, per plan review | Administrators |
Using AI-Assisted Plan Review as a Reviewer
When a program submits an assessment plan in an enabled review, the AI Assistant drafts a complete review containing a suggested rating and feedback for every rubric criterion, plus overall feedback.
- Automatic draft generation: The AI drafts a review from the program's submitted plan data (outcomes, measures, results, analyses, and actions) against the aligned rubric. If an administrator launches a review after programs have already submitted, the system generates drafts for all submitted programs at launch. If a program reopens and resubmits, a fresh draft reflects the latest data without overwriting saved reviewer work.
Draft status indicators: Programs with a generated draft display a Reviewed by AI indicator with the status Ready for Reviewer. A banner inside the review states that the AI Assistant drafted a starting point.
One-click feedback insertion: AI feedback appears in a labeled, read-only AI Review panel beside each criterion. Reviewers can insert the draft into their own feedback field with one click and edit the text freely.
- Reviewer editorial control: AI ratings and feedback remain excluded from rubric results, Org Management progress tracking, and official reports until the reviewer saves the review. Once saved, the review belongs to the reviewer and is never replaced by regeneration.
Important Reminders
Institution administrators maintain full control over which plan reviews use AI drafting. Reviewers always retain final editorial authority, as AI-generated ratings and feedback remain private drafts until the reviewer reviews, edits, and saves the official evaluation.