Instructor Insights

Instructor Insights Overview

AI capabilities in Course Evaluations & Surveys are currently available in English and restricted to institutions in the United States.


By combining the power of artificial intelligence (AI) with direct evidence, Instructor Insights is designed to transform how Instructors interact with student feedback.  Instructor Insights helps you as an Instructor save valuable time, achieve a deeper understanding of your impact, and implement more effective improvements that foster your professional growth.

IMPORTANT NOTES:

  • Instructor Insights is only available to institutions that have the Course Evaluations & Surveys AI Add On feature.
  • Instructor Insights is only available in the Instructor view and is not available in the CES Administrator or Node Administrator view.
  • The Instructor Insights feature will be available for any project where data has been released within a revolving six-month window.
  • We pre-process the majority of course data to promote faster loading times for the Instructor Insights pages. In rare cases, the pre-processing may not be complete for a specific course, and the analysis will need to run live. In those cases, Instructors may need to wait up to three minutes for the page to load, depending on how much data there is to process.
  • If your institution is using cross-listed course functionality in CES (not common), both the parent and child courses will appear in Instructor Insights. The same aggregated data will be displayed regardless of which cross-listed course you select.
  • The Instructor Insights feature follows all restrictions your institution may have in place.  For example, if your institution disallows results for any course with less than three responses then any course with less than three responses will not appear in Instructor Insights.

 

Instructor Insights Instructor View

Instructor Insights can be found at the top of the Results Home page, which can be reached by clicking Results > Results Home.  You will see a list of your recent course evaluation results and can click the Show More Courses button to view additional courses.

 

Screenshot of the Results Home page showing three recent courses.

 

When you click on a specific course, you will be taken to a page showing an AI Summary of Results based on the student feedback and the Response Rate for that course.  You can click the Explore Insights button to explore further feedback and recommendations for the course.

Screenshot of the Results for a Child Psychology course showing the AI summary of results and the Response Rate of the course

 

Navigating the Highlights & Guidance Page

Clicking the Explore Insights button will take you to the Highlights & Guidance page for that course, showing the Takeaways, Sentiment, Categories, and Recommendation sections.  The sections are described in more detail below.
 

Screenshot of the Highlights and Guidance page including the four sections of Takeaways, Sentiment, Categories, and Recommendations.

 

  1. The Takeaways section uses AI to read through student comments and provide an overall view of the comments. This section allows you to quickly understand common feedback.  You can click the eye icon to see a representative list of comments that prompted this takeaway.
    • Each takeaway includes a key theme and an icon, displaying the overall tone of the takeaway.  The tone could be:
      • 👍 Positive: Indicates comments with a positive tone.
      • 👎 Negative:  Indicates comments with a negative tone.
      • 👍👎 Neutral: Indicates comments that are neither positive nor negative.
  2. The Sentiment section provides a visual summary of all student feedback. A donut chart displays the overall percentage of positive, negative, and neutral comments, giving you a high-level overview of student sentiment.
    • Positive: Comments with a favorable tone.
    • Negative: Comments with a non-favorable tone.
    • Neutral: Comments that do not express a strong favorable or non-favorable tone.
    • Mixed: Comments with both a favorable and non-favorable tone.
  3. The Categories section provides a list of specific categories that the comments fall into.  The category button contains an icon to indicate whether the overall feedback for that category was positive 👍, negative 👎, or neutral 👍👎.  Clicking on a category will give a review of the sentiment specific to that category as well as list some specific comments that led to that category being included.

    Below is the list of categories that may appear in the Categories section:

    Approachability Meeting time
    Assignments Motivation
    Availability Pacing
    Communication Participation
    Creativity Peer interaction
    Depth Relevance
    Enthusiasm Rubrics
    Expertise Structure
    Fairness Technology
    Feedback Testing
    Grading expectations Tutoring
    Group work Understandability
    Inclusivity Variety
    Materials Workload
  4. The Recommendations section gives suggestions based on the student feedback.  Some specific suggestions will appear in this section automatically.  Instructors can click the eye icon to see a representative list of comments that prompted this recommendation. 
     
  5. Within the Recommendations section, you can click the Explore Recommendations button to open a prompted AI dialogue box to explore the recommendations further.  In the box that appears, you can click on any of the AI prompts to drill further into the feedback and suggestions.
Screenshot of recommendations section including an AI assistant prompt list for course evaluations as follows: review the top takeaways, expand on the summary of my results, dig into recommendations, and tell me more about the top categories.

 

NOTE: All of the insights and recommendations are powered by AI. If you feel an analysis doesn't accurately reflect the student feedback, you can report the issue by clicking the Report an AI Issue button.

Screenshot of a warning that AI insights are supplementary and that users should use judgement, along with a link to Report an AI Issue.

Was this article helpful?
1 out of 2 found this helpful

Articles in this section

See more
How to Contact Support
There are many ways to reach out! Click the icon above for our support options.
Watermark Academy
Click the icon above to access the Watermark Academy for consultation, training, and implementation companion courses.
Customer Community
Can’t find the answer? Ask fellow users how they’re making the most of Watermark in our Community!