Overview
This article describes the functionality and workflow of the Artificial Intelligence (AI) analysis tool within Planning & Self-Study (P&SS). This feature assists in synthesizing complex data—including measure results, uploaded documents, and historical context—to generate meaningful interpretations for assessment reports.
Note: This documentation is for Assessment Plan Contributors and Leads who are responsible for analyzing data, documenting findings, and creating action plans.
AI-Powered Analysis Functionality
The AI assistant reviews all relevant data points to create a comprehensive draft. This process ensures that reports are insightful and align with institutional standards set by administrators.
Core Capabilities
- Automated Drafting: The AI reviews outcome details, measure descriptions, targets, and results (including scores) to create a structured analysis.
- Administrative Alignment: Any reporting guidelines established by institutional administrators are automatically included in the AI logic to ensure institutional compliance.
- Historical Context: If previous plans or past results are available in the system, the AI references them to highlight trends, improvements, or areas needing attention. This includes the consideration of previous budget requests for a holistic view.
File Analysis Technical Specifications
The AI can process data directly from uploaded documents to inform the analysis.
- Supported Formats: Portable Document Format (PDF), Excel (.xlsx), and Comma-Separated Values (CSV).
- Quantity: Up to five files may be attached per analysis. If more than five are present, the system prioritizes the most relevant results files.
- Size Limit: Each file must not exceed 4.5 MB.
Generating Measure Analysis
The AI assistant reviews all relevant information—including outcome details, measure descriptions, targets, and results data—to create a structured draft.
Steps to Generate Analysis
- Navigate to the Findings area for a specific measure within a plan.
- Select Complete with AI Assistant.
- Select the Compose a measure analysis link to initiate the draft.
- Monitor Status: Real-time messages such as "Assistant Thinking..." or "Assistant analyzing files..." indicate the progress of the analysis.
- Refine the draft after initial generation by entering specific instructions in the refinement field, such as "add more detail" or "make this more concise."
- Once the analysis is complete, select Insert This Analysis to apply the AI-created text directly into the findings analysis area.
Note: The AI automatically incorporates any guidelines set by administrators to ensure recommendations align with institutional standards.
Reporting Issues and Providing Feedback on AI Responses
Users in P&SS can report issues and provide feedback on AI-generated responses directly within the platform. By capturing relevant context from the conversation, this feature allows users to flag incorrect behavior. This ensures the Watermark team can investigate and improve the accuracy and reliability of AI insights to support institutional assessment and planning workflows.
To report an issue, select Report an Issue within the AI Assistant conversation.
Provide a detailed explanation of the issue and select Submit. Once feedback is submitted, a confirmation message displays on the page.
Note: This action does not submit a ticket to the Watermark Support team.