Overview
In Student Success & Engagement, the data integration has two major steps:
- The Connect2/Accelerate process
- The Import process
See the SIS Data Import Process for a visual on each of these steps.
If you are experiencing issues with the SIS Data Integration, check for errors at each step of the process. It is also important to confirm the source data is correct (CSV Files, SIS data, or database views).
This quick guide is not comprehensive but identifies the most common SIS Integration issues. Use this in conjunction with Quick Guide: View JSON Extract and Imported Data and Quick Guide: Data Integration Changes to resolve many of these issues.
Source Data
First, confirm that the source data is correct.
- The data in the SIS is correct
- CSV Method Considerations:
- The data in the CSV is correct
- The extract/report is successfully transferring the file to the Connect Server
- The CSV file is present in the correct directory, named correctly, and formatted correctly. See format requirements here: Data Feed Guide: SIS Integration
- Direct DB Method Considerations:
- The data resulting from the View/SQL query is correct
- The view/query has no errors when it is run directly from the Connect Server as the Database User. It is important the query is run from the Connect Server just in case there are any network issues preventing the query/view from running.
If the data is incorrect or there are errors, update the extract/report/query to resolve the issues.
Connect2/Accelerate
Review the data and errors for the Connect2/Accelerate step.
- Review the JSON data to determine if the data is correct or incorrect at this step. See View JSON Extract for instructions.
-
Confirm Connect2 is running by checking the Connect2/Accelerate logs
- Navigate to SS&E Administration > Advanced > External Logging (https://{yourinstitution}.avisoapp.com/aviso/logMessage/list).
- Search for “SIS IMPORT” to confirm that the Connect2 Task is running on schedule (typically runs 4x per day).
- If it is not running, try Running the Connect2 Job Manually from the Connect Server.
- Confirm that the Connect Server Service Account user has correct credentials and permissions to the C:\Aviso folder and to run the Connect2 task. See Data Stream Out of Date Troubleshooting for more information.
-
Check for Errors in the Connect2/Accelerate logs
- Navigate to SS&E Administration > Advanced > External Logging (https://{yourinstitution}.avisoapp.com/aviso/logMessage/list).
- Search for the feed name or select Log level ERROR and troubleshoot based on the specific error message from the log. Common errors include:
- Files/views missing from the directory/folder or filename/viewname not matching the Accelerate query.
- Permissions errors indicating that the database user that is running the query needs to be granted additional permissions.
- Query syntax or file format errors.
- Confirm that firewall settings are not preventing data transfer
- Confirm required outbound firewall rules from Connect Overview are in place.
- Try Running the Connect2 Job Manually from the Connect Server while monitoring the firewall logs.
- CSV Method: Ensure that the Apache Drill service is running
- Using Chrome on the Connect Server, attempt to visit http://localhost:8047. If the page does NOT load, see Drill Service Troubleshooting for more information.
- Review the Accelerate Queries to determine if the data is being transformed or filtered during this step.
- From SS&E Admin, navigate to SIS Integration > Datafeeds and select View under the Extract Queries query button on the SIS data feeds page.
- The Accelerate queries can be copied from SS&E and run locally on the SIS Database or in Apache Drill for testing. See Run Accelerate Queries Locally on Connect Server for instructions.
- Check for any filters in the query that might exclude certain data (where statements, inner joins, etc.)
- Modify or override queries by editing the Child XML in SIS Integration > Accelerate Configuration. See Accelerate Configuration for more information.
Import
Review the imported data and check for Import Errors.
- Review the Imported Data to confirm that there is an integration/import issue and not a configuration/permissions issue. See View Imported Data for instructions.
- Check for import errors. See “Data Feed File Failure” and “Record Import Failure” in Data Integration Changes: Import.
- Clear the import cache. See “Caching Issue” in Data Integration Changes: Import.
- Confirm the data feed is enabled. SS&E Administration > SIS Integration > Datafeeds
Additional Information
If you are experiencing data integration issues but are still unable to identify the cause or solution to the issue, see these additional resources for more detailed troubleshooting and/or reach out to support@watermarkinsights.com for assistance.
- Quick Guide: View JSON Extract and Imported Data
- Quick Guide: Data Integration Changes
- SIS Data Import Process
- Data Stream Out of Date Troubleshooting
- SIS Integration Troubleshooting Guide
- Run Accelerate Queries Locally on the Connect Server
- Accelerate Configuration
If you are interested in making changes to a feed or would like to add a new feed or set of feeds and you need assistance, please initiate a project with our Technical Consulting team.