LiveText Analytics - Using the Analyzer Tool

Please note that Analytics will be discontinued on August 31, 2023. For more information please click the link below

https://support.watermarkinsights.com/hc/en-us/articles/8803872042907-End-of-Life-Notice-Watermark-Livetext-C1-Analytics-Module

• Element Assessments: Analytics will search and report on all data, down to the rubric element level, including scores and averages. Because there is significantly more data when reporting at the element level than at the rubric level, reports may take longer to generate.
• Rubric Assessments: Analytics will search and report on data associated with rubrics as a whole, including scores and averages. Individual elements within a rubric will not be reportable. Also, choose this option if the report to be created is not scoring based, such as an assessment completion or diversity report.

To create a new Analyzer report:

1. Click the New Analyzer report icon (Table icon), or click File New Analyzer Report in the Analytics menu.
2. On the Select Data Source popup window, click either Element Assessments or Rubric Assessments, and click the OK button.

The Analyzer Report Tab
After selecting a data source, a new Analyzer report will be opened in a new tab. The Analyzer report tab is divided into three panels: Criteria and Measures, Layout, and Table. Reports are created by dragging filters and measures into the Layout and/or Table panel.

Criteria and Measures Panel
The Criteria and Measures panel is located on the far-left side of the Analyzer tab. The Criteria and Measures tab lists several items designated with either a yellow icon or a blue icon.

Items marked with a yellow icon are criteria. Criteria are used to specify the data that will be reported. Examples of common criteria include Term, Department, Rubric title, Standards, and student ethnicity.

Items marked with a blue icon are measures. Measures are calculations performed by Analytics based on the criteria selected. Measures include counts, scores, and averages.

TIP: The Criteria and Measures section can be sorted in several ways. Click the View button, located at the top of the Criteria and Measures panel, and select a sorting method.

TIP: The Criteria and Measures section can be hidden by clicking the Hide list of available fields button, located above the table section.


Layout and Table Panels
The Layout panel and Table panel are both used to populate a report with the desired criteria and measures. The panels are connected in that placing criteria or measures in one panel will automatically populate the other. As such, both panels may be used interchangeably to create a report.

TIP: The Layout panel can be hidden by clicking the Hide layout panel button, located above the table section.
 

Creating a Report
Reports are created by dragging criteria and measures from the Criteria and Measures Panel to the Layout and/or Table panel. Criteria and measures can be placed in either panel, and will automatically populate to the other.

Adding criteria to a report
To add a criterion to a report, drag the criterion from the list and drop it in the Layout panel or Table panel. After doing so, all values meeting the criterion will be displayed.

IMPORTANT: By default, Analytics will only show criteria values that have assessment data associated with them. For example, in the report shown below, the Term Name criterion has been added to the report. There is an existing term in LiveText named “Fall 2014,” but because no assessment data was gathered during the Fall 2014 term, it does not appear in the list.

This default behavior can be changed. (see the Report Options section below)


To add a criterion to a report:

1. Locate the desired criterion in the Criteria and Measures panel.
2. Click and drag the criterion to either: the Rows or Columns box in the Layout panel. or… the Table panel.

Adding additional criteria can further refine and specify the desired data. When adding additional criteria, the values presented are sorted based on the previous criteria values. For example, adding the College criterion after Term Name shows the colleges for which assessment data has been gathered, sorted by each term listed.

TIP: Once a criterion has been added, the column header name can be changed. To change the name of a criterion header, right click the header and select Edit…. In the popup window that appears, type in a new name, and click OK.

TIP: Don’t forget the Undo and Redo buttons. Use these buttons to move backward or forward in the report creation process, one step at a time.

Changing the order of criteria
Because the values of additional criteria are sorted based on the previous criteria values, the order in which criteria are added to a report appear directly affects how the data is presented. This is especially important when using Measures. (see the Adding Measures to a Report section below)

However, the order of criteria can be changed after they are added. The order can be changed using the Table panel or the Layout panel.

To change the order of criteria in a report:

1. Click and drag a criterion header (Table panel) or a criterion name (Layout panel).
2. When the dragging motion begins, a green line will appear, indicating the location the criterion will be placed when dropped.
3. Drag the criterion to the new location.
4. When the green line appears at the desired location, release the mouse button to drop the criterion.

Removing criteria from a report
A criterion can be removed from the report by dragging the criterion to the trashcan. The trashcan appears in the lower right corner of the Table panel when the dragging motion begins. Criteria can be removed from the Table panel or the Layout panel.

NOTE: If a criterion has filters applied, removing the criterion from the report does NOT remove the filter. (See the Filters List section below)

To remove a criterion from a report:

1. Click and drag a criterion header (Table panel) or a criterion name (Layout panel).
2. When the dragging motion begins, a trash can will appear in the lower right corner of the Table panel.
3. Drag the criterion to the trash can and release the mouse button.

Filtering criteria values
The displayed criterion values can be filtered to include only the values of interest, and removing values unnecessary to the report. When a filter is applied, it also affects the presented values of other criteria in the report.

The Filters List
When a filter is applied to a criterion, the filter appears in the Filters List, at the top of the Table panel. The Filters List shows all the filters used in the current report, and provides easy access to further refining an applied filter. To show or hide the Filters List, click the blue plus/minus icon.

Filtering single values
After a criterion is added, values can be filtered individually in two ways: a selected value can be excluded from the report or a selected value can be kept while every other criterion value is excluded.


To filter criteria values individually:

1. Right click on a criterion value.
2. Select Exclude to remove the value from the report.
3. Select Keep Only to remove all values except for the selected one.

NOTE: For some criteria, right clicking a value presents a third option: Keep Only… and Show…. This option will exclude all values except the selected value, and add the new criterion listed.

In the following examples, note that the Natural Sciences appears only in the Fall 2015 term.

 

Because Natural Sciences is associated only with the Fall 2015 term, all values for Term Name that are not associated with Natural Sciences have also been removed.

Filtering multiple values
When several values of a single criterion will be included or excluded from a report, filtering can be applied to multiple values at one time. Filtering can be applied to a criterion both before and after the criterion has been added to the report, or without adding the criterion to the report at all.

While the filtering process is identical, it is important to note that filtering a criterion without adding it to the report will still apply the filter to the report and place the filter in the Filters List. (See the Filters and the Table panel section.)

To filter multiple values of a criterion already added to a report:

1. Right-click a criterion header (Table panel) or a criterion name (Layout panel).
2. From the popup menu, select Filter.

     3. The Filter On… popup will appear.

The Filter On popup
The Filter On… popup allows selecting multiple values to either be included in or excluded from a report. The popup has a left box and a right box. The left box lists all the values for the selected criterion. The right box is used to build the list of values to be included or excluded. The values placed in the right box are included or excluded based on the selection made in the Currently dropdown menu, located above the right box. 

     4. From the Currently dropdown menu, choose whether the values selected should be included in or excluded from the report.
     5. From the left side Values box, click a value to select it.

TIP: Multiple values can be selected at once by holding CTRL (PC) or COMMAND (MAC) while clicking.

     6. Click the green, right pointing arrow to move the selected value(s) to the right side box.
     7. When finished moving values, click the OK button.
 

Editing existing filters
Criterion filters that have been previously added to a report can be edited or further refined.

To edit an existing filter:

1. Click the blue plus icon to show the Filters List.
2. Click the pencil icon next to the filter to be removed.

      3. The Filter On… popup will appear.
      4. Make the necessary changes.
      5. Click the OK button.

Removing filters from a report
Filters that have been applied to criteria within a report may be removed.

To remove an existing filter from a report:

1. Click the blue plus icon to show the Filters List.
2. Click the red X icon next to the filter to be removed.

Filters and the Table panel
There is an important distinction between the criteria in the Table panel, and the filters in the Filters List. The Table panel represents the visual design of the report. The Filters List shows all filters affecting the content of the report. However, it is not required that all criteria to which filters are applied be present in the table. Every filter in the Filters List is applied to the report, regardless of whether the filtered criterion is in the table.

This distinction is very useful. It allows the Table panel to be used as a visual workspace to select several specific criteria and filter those criteria values until the necessary content is displayed. Once the filters are in place, and so content is determined, the Table panel can be used to establish the aesthetic design of the report by removing criteria that don’t need to be represented visually.

Adding Measures to a report
Adding Measures to a report is accomplished in the same way as adding criteria. To add a measure to a report, drag the measure from the Criteria and Measures panel and drop it in the Layout panel or Table panel. After doing so, Analytics will perform the measure, and display the results.

The measure results will depend on the criteria selected and filters applied to the report, and will be sorted based on the included criteria. However, unlike adding additional criteria to a report, each additional measure added to a report is independent of other measures in the report, and is a stand-alone list.

Remember, by default, the measures are calculated based on data associated with an assessment.
 

Creating custom measures
Analytics includes many pre-made measures, which are listed with blue icons in the Criteria and Measures panel. However, Analytics also provides a tool to create custom measures. Custom measures are built by using two or more pre-made measures to construct an equation. Once created, the custom measure will appear in the report just as any other measure.

In the example below, the custom measure “Assessments per Student” will be created. To create this measure, the pre-made measures Student Count and Rubric Assessment Count are used to build an equation that divides the Rubric Assessment Count by Student Count.

NOTE: At least one measure must be added to the report to access the Custom Measure tool. However, it is not necessary for measures used to create a custom calculation to be added to the report. The Student Count and Rubric Assessment Count measures have been added for illustration purposes.


To create a custom measure:

1. Right-click any measure header (Table panel) or measure name (Layout panel).
2. Hover over User Defined Measure A submenu will appear.
3. From the submenu, click Calculated Measure…

       4. The New Calculated Measure popup will appear.


The New Calculated Measure popup
The New Calculated Measure popup is used to construct a custom measure. The popup has a list of the pre-made measures in the left box. Any measures already added to the report appear at the top of the list. The right box is used to build an equation. An equation is built by moving pre-made measures into the right box and using the mathematical operators to define the equation.

       5. In the Name field, type in a title for the custom measure
       6. In the Format dropdown menu, select the format in which the results should be displayed.
       7. In the left box, click a measure to be added to the equation.
       8. Click the green arrow to move the selected measure into the equation box.
       9. Click the operator buttons to insert a mathematical operation.

NOTE: The measures and operators will be added to the equation box at the location of the blinking cursor. Click in the equation box to insert the cursor where necessary.

      10. When finished, click the OK button.

EXAMPLE 7.a: The New Calculated Measure tool is used to create the custom measure Assessments Per Student by creating the equation: Rubric Assessment Count divided by Student Count.

After clicking OK, the custom measure will be added to the report.


EXAMPLE 7.b: The custom measure Assessments per Student has been added to the report, Analytics has performed the calculations, and the measure results are displayed.

Report Options
Report options allows the default options of Analytics to be changed. To see the report options, click the Report Options button.

After clicking the Report Options button, the Report Options popup window appears. The options include:

• Blank (Empty) Cells: By default, Analytics only displays criteria and measures with which there is data associated. Checking this box causes Analytics to display all values of criteria and measures, even if the value is zero.
• Totals: The grand totals option causes Analytics to add rows and/or columns that display the grand totals for each row and/or column.
• Cell Drillthrough: Selecting this option causes Analytics to make all measure values clickable. Clicking on a measure value opens a popup window displaying more detailed information about the value.
• Freeze Panes in Table: By default, when the Table panel report is larger than the browser window, the scroll bars scroll only the measures portion of the report. Unchecking these boxes allow the scroll bars to scroll the entire Table panel, rather than just the measures portion.