Data Feed Guide: All IDs

Overview

In Student Success & Engagement, most data that is imported from the SIS remains in SS&E, even if it is no longer actively importing. Sometimes records can be orphaned or deleted from the SIS, imported by mistake, duplicated, or otherwise undesired in SS&E. Certain data feeds support deletion using a supplementary feed called the “All IDs feed”. There are also additional ways that data may be removed from the UI. This article focuses specifically on the All IDs method.

AllIds feeds are simply a list of ALL valid IDs (including those currently importing as well as historical). 

• If a record is in the allIds feed, it will not be deleted from SS&E. 
• If it is not in the allIds feed, it will be deleted from SS&E. 
• Deleted records must also be removed from the primary data feed, otherwise they will reimport, be deleted, reimport again, etc.

AllIds Feeds

The SIS Import Definitions outlines the import requirements for each of the following allIds feeds. 

• courseSection_allIds*
• courseSectionScheduleElement_allIds
• location_allIds
• personAcademicPlan_allIds
• personAcademicPlanCourse_allIds
• personApplicationLocation_allIds
• personFinancialAidIndicator_allIds
• personHold_allIds
• personHighSchool_allIds
• personPhone_allIds
• testScore_allIds
• transcriptCourse_allIds*
• transcriptDegree_allIds

* Note: All IDs will only check against source system ids associated with courseSection/transcriptCourse records in a current or future term, but not a past term.

Deletion Process

1. The SIS Import Job must first import the latest primary feed and allIds feed. This occurs at 4:30am, 10:30am, 4:30pm, and 10:30pm. 
2. After the records have successfully imported, the SIS Data Deletion Job runs at 2am.
   1. During this process, the system reads the All IDs file to gather a list of all the valid source system IDs from the SIS.
   2. The system compares the list of valid IDs with the IDs that exist in the SS&E database/display on the UI. 
   3. Any records that are not included in the list of All IDs are marked as deleted in SS&E, which removes them from the UI. 

Additional Information

• See the SIS Data Deletion article for more detailed information on how allIds deletion works.
• There are some types of data that may be "deleted" or removed from the UI using other methods like active status or start/end dates. See the Deletion via a Different Method section in Data Feed Actions.
• To view the latest All IDs file, Navigate to SS&E Administration > SIS Integration > Datafeeds (https://{yourinstitution}.avisoapp.com/aviso/datafeed/index). Then, find the datafeed you want to view. Select "All IDs" in the Download Extract column. See View JSON Extract for instructions on viewing the latest All IDs file from the Datafeeds Admin page.