Skip to main content

Administrator: Report Builder 2.0

Updated
Watermark Support
  • This feature allows Administrators to create custom reports across multiple projects based on hierarchy level (area), project criteria, course criteria, instructor, teaching assistant, and/or question criteria.
  • This feature also allows Instructors and Teaching Assistants to create custom reports across multiple projects based on course enrollment and/or question criteria.
  • Reports created in Report Builder 2.0 are saved within the user's Report Builder 2.0 dashboard and can be copied, edited, exported, and/or shared.
  • All of the reporting functionality in Report Builder 2.0 can be used for both Course Evaluation Projects and General Survey Projects.

NOTE

Both Report Builder and Report Builder 2.0 are available in customer accounts created prior to November 4, 2018, while only Report Builder 2.0 is available in customer accounts created on/after November 4, 2018. Please consult with your institution’s CES Administrator for availability.

Report Builder 2.0 requires Instructor enrollments in courses. This requirement does not apply to the other reporting features.

Report Builder 2.0

  1. Click on the Results tab.
  2. Select Report Builder 2.0. After clicking on Report Builder 2.0, you will be dropped off on the My Reports dashboard, your central location for all reports created from Report Builder 2.0.
    1. Here you can view your most recent reports, saved reports and shared reports from other users. Each category will list the most recent five reports, or click View All to view the full list for each category.

To Create a New Report

  1. Select the tab for your desired report type. These report types help the user navigate the data from one of five available perspectives:
    1. Areas report
    2. Projects report
    3. Courses report
    4. Instructors report

    5. Teaching Assistants report

      A Report Builder 2.0 page showing navigation tabs for My Reports, Areas, Projects, Courses, Instructors, and Teaching Assistants. The page displays a Notice section stating that reporting data is updated nightly and project updates will appear the following day, along with a Saved Reports section indicating no saved reports.

  2. Search for and/or select your desired criteria > Apply.
    1. Select multiple criteria for each, or you can apply your selections, then click the plus icon to select and apply additional. To remove criteria, expand the applied selection(s) and deselect.
  3. Click Run after your selections have been applied to generate your report.

  4. Depending on the size of the data in the report you're generating, you may get a message the report is being generated and you'll be notified when it is complete. When complete, an email will be sent to the email address associated with your login. You can also refresh the Report Builder 2 screen until the report is showing as completed. Or you can view the Notifications by clicking on the Bell in the upper right corner of Course Evaluations & Surveys to see that the report has generated.

    A Report Builder 2.0 page showing selected report criteria including Areas, Projects, Questions, Grouping, Question Filters, Benchmarks, and metadata filters such as Course, Respondent, and Instructor, along with a highlighted Run button.

Reporting Types

  1. Areas: With this report type users can compare data from one area or between multiple areas of their account hierarchy. Area data can be compared longitudinally over time, across projects, and across Areas. Data can be aggregated to summarize the area or dis-aggregated to show course or instructor-level detail within the area.

    Note: When selecting an area, all child nodes under a parent are also included in the report.

    A report results table showing responses to the question ‘Course objectives were made clear by Instructor [InstructorName].’ The table displays percentage and response counts for Strongly Disagree, Disagree, Agree, and Strongly Agree across categories including School of Business and School of Liberal Arts & Sciences, with totals shown at the bottom. Summary statistics appear for each group, including number of respondents, mean score, and standard deviation

  2. Projects: With this report type users can compare data from one project or between multiple projects. Data can be aggregated to summarize the project overall or dis-aggregated to show course or instructor-level detail within the project.

    A report results table showing responses to the question ‘Course objectives were made clear by Instructor [InstructorName].’ The table displays percentage and response counts for Strongly Disagree, Disagree, Agree, and Strongly Agree for the 2018 Fall Course Evaluations and the 2018 Summer Course Evaluations. Summary statistics appear for each group, including number of respondents, mean score, and standard deviation.

  3. Courses: With this report type users can compare data from one course or from multiple courses. Course data can be compared longitudinally over time, across projects, or from within the same project. Data can be aggregated to summarize the project overall or dis-aggregated to show course section or instructor-level detail within the project.

    A report results table showing responses to the question ‘Course objectives were made clear by Instructor [InstructorName].’ The table lists multiple courses, including Advanced Biochemistry, International Cultural Diversity, European History, and Environmental Studies, each displaying percentage and response counts for Strongly Disagree, Disagree, Agree, and Strongly Agree. Summary details for each course include number of respondents, mean score, and standard deviation.

  4. Instructors: With this report type users can compare Instructor data from the same instructor or from multiple instructors. Instructor data can be compared longitudinally over time, across projects, or from within the same project. Data can be aggregated to summarize the project overall or dis-aggregated to show course section or instructor-level detail within the project.

    A report results table showing responses to the question ‘Course objectives were made clear by Instructor [InstructorName].’ The table lists multiple instructors with percentage and response counts for Strongly Disagree, Disagree, Agree, and Strongly Agree. Each row includes summary details such as number of respondents, mean score, and standard deviation.

  5. Teaching Assistants: This report type is the same as Instructors, but is segmented to just Teaching Assistant data.

Edit, Save, Export Report

After the report has been generated select:

  1. Filters: To edit the report criteria.
  2. Save: To save the report to your Report Builder 2.0 dashboard.
  3. Delete: To delete the report.
  4. Copy: To make a copy of the report.
  5. Excel: To export a raw data report to Excel that correlates with the filters applied.

  6. PDF: To export results to PDF format that correlates with the filters and view applied.

    A Report Builder 2.0 results page showing an Area Report with details including the number of areas, questions, grouping, and report timestamp. A toolbar shows options for Filters, Save, Delete, Copy, Excel, and PDF. Below the toolbar, a chart displays response distributions for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with bars representing percentages for Strongly Disagree, Disagree, Agree, and Strongly Agree.

Report Views

For each of the report types you can choose to view the data interactively using one of five different report views. All views are available to all user roles. Below are examples of the same data for the same question in the five different views.

Note: The selected hierarchy level and Project (s) are displayed on the left of each question, and a legend for each view is displayed to the right of each question:

  1. Chart

    A report results page showing toolbar options for Filters, Save, Delete, Copy, Excel, and PDF. The results display a chart for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with bars representing percentages for Strongly Disagree, Disagree, Agree, and Strongly Agree, along with percentage and response count values and summary statistics.

  2. Mean

    A report results page showing toolbar options for Filters, Save, Delete, Copy, Excel, and PDF. The results section displays the question ‘Course objectives were made clear by Instructor [InstructorName]’ with summary information for EvaluationKIT University 2018 Fall Course Evaluations, including the number of respondents, response rate, mean score, and standard deviation.

  3. Percent

    A report results page showing toolbar options for Filters, Save, Delete, Copy, Excel, and PDF. The results table displays percentages and response counts for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with values shown for Strongly Disagree, Disagree, Agree, and Strongly Agree, along with summary information including number of respondents, response rate, mean score, and standard deviation.

  4. Box Plot

    A report results page showing toolbar options for Filters, Save, Delete, Copy, Excel, and PDF. The results display a box plot for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with labeled response categories from Strongly Disagree to Strongly Agree. Summary statistics appear beside the plot, including number of respondents, response rate, mean score, standard deviation, minimum and maximum values, and lower and upper quartiles.

  5. All

    A report results page showing toolbar options for Filters, Save, Delete, Copy, Excel, and PDF. The results display both a bar chart and a box plot for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with bars representing response percentages for Strongly Disagree, Disagree, Agree, and Strongly Agree. Summary statistics include response count, response rate, mean score, standard deviation, minimum and maximum values, and lower and upper quartiles.

Report Groupings

  1. This feature allows the user to aggregate and dis-aggregate data based on logical groupings within the five different report types.

Filter Results by Responses to Survey Questions

  1. Using this feature the user can slice and dice the data based on specific responses to one survey question or multiple survey questions. This allows the user to easily view the responses for just a desired segment.

    A Question Filters panel showing filter options for the question ‘Course objectives were made clear by Instructor [InstructorName],’ with selectable response categories including Strongly Agree, Agree, Disagree, and Strongly Disagree. The Disagree and Strongly Disagree options are highlighted as selected. The panel also includes a Surveys section that can be expanded.

Question Results & Aggregated Results

  1. In addition to individual question-level metrics, in Report Builder 2.0 you can easily view data aggregated across multiple questions. Aggregated Results allows you to see a mean score across multiple survey questions, as well as overall percent and frequencies.

    Note: This feature requires questions to have a common scale.

Add Benchmarks to Reports

  1. This feature offers the ability to quickly add up to three selected levels of aggregated data in order to benchmark against. For instance, a user can view course-level data and easily compare that to aggregated data from the department, school, and institutional levels.

Filter Results by Student or Respondent, Course, and Instructor Metadata

  1. Uploading metadata to courses, students/respondents, or instructors allows you to view survey results based on your segmented metadata. You can import external data related to these areas into Course Evaluations & Surveys, then easily segment your data to view the survey results for just the criteria selected related to students/respondents, courses, and/or instructors. External metadata can be brought into Course Evaluations & Surveys via API, FTP to Project, and direct upload options.

Report Sharing

  1. Once you have generated your report you can share it with other users. You can share your reports within Course Evaluations & Surveys with other users, email a secure link to the report for people who do not have an Course Evaluations & Surveys account, or you can generate a link to paste on a web page if you want to share a report publicly.
Was this article helpful?
0 out of 0 found this helpful

Articles in this section

See more
How to Contact Support
There are many ways to reach out! Click the icon above for our support options.
Watermark Academy
Click the icon above to access the Watermark Academy for consultation, training, and implementation companion courses.
Customer Community
Can’t find the answer? Ask fellow users how they’re making the most of Watermark in our Community!