Glossary of Outcomes Assessment Projects Terms
Templates
| Organization Hierarchy | The institution, schools, programs, and departments that will be involved in OAP. |
| Academic Sessions | An institutions academic years and terms. |
| Courses | Courses that will be involved in OAP. |
| Course Sections | Course sections that will be involved in OAP. |
| Users |
Individuals that will be involved in OAP. These individuals can be Assessment Coordinators, Faculty, and/or Evaluators. |
| Section Enrollment | Information about faculty members of record who should either be scoring just their own students or be prevented from scoring their own students. |
User Roles
| Evaluator | Scores work in OAP. |
| Assessment Coordinator | Assessment Coordinators have administrative rights in OAP. They can define the rubrics and learning outcomes to be measured. Create Assignments. Manage artifacts for scoring, and runs reports. Can also be assigned an Evaluator role. |
| Faculty | This role is typically used when faculty will be assisting the Assessment Coordinator with creating assignments or populating student work in the system. They can also create assignments, manage artifacts for scoring, and run reports. Can also be assigned an Evaluator role. |
System
| Project | The Project is where an Assessment Coordinator will establish the timeline, outcomes, and courses that will generate data. In the Project, Assessment Coordinators decide what is being measured and why, as well as how work will be evaluated. The will also decide where the work is being collected from, how the work is being collected, and who will evaluate the work. |
| Assignment | Assignments define what artifacts have been collected from students, which courses the artifacts are coming from, and what outcomes they will be assessed against. |
| Term |
Period in which an artifact was collected. Synonymous with semesters or academic sessions within an institution. |
| Learning Outcomes & Rubrics Library |
A list of all the Outcome Sets that are available to an Assessment Coordinator and the rubrics affiliated with each outcome. Assessment Coordinators can also create and edit Learning Outcomes Sets and rubrics from this area. |
| Outcomes |
Outcomes identify what students will know and be able to do by the end of a course or program. |
| Outcome Set | A set of outcomes that student work will be assessed against. Each outcome is assigned a rubric which is scored by a committee of identified Evaluators. |
| Roster | A CSV template containing a list of students whose work will be uploaded into an Assignment and their respective enrollments in relation to a course and/or course section. |
| Bulk Upload | The Bulk Upload tool allows Assessment Coordinators and Faculty
to upload student work to an Assignment in bulk within a ZIP file. |
| Manual Upload | The Manual Upload tool allows Assessment Coordinators and Faculty to upload student work individually to each student record. |
| Calibration Project | Also referred to as “Norming Projects”, Calibration Projects are created to help Evaluators come to a consensus about how to score student work or measure performance on a rubric. Calibration Projects are often created prior to launching any actual Projects as it is an effective way to introduce Evaluators to the system. |
| Unscorable Submissions | A setting that, when enabled, allows Evaluators to report work submissions as unscorable. This would be used if a submitted file was corrupt or unreadable. Marking a submission as unscorable will remove it from the Scoring Queue. |
| Scoring Queue | A list of student work available for scoring. The queue is shared by all Evaluators in a group. Ten work submissions are displayed at a time in the queue. Once all student work has been evaluated, the queue will be empty. |
| LMS Integration | LMS integration allows students to submit work from within their LMS. Students would submit work directly to OAP for an Assignment by following a link in their LMS course. The integration is based on the LMS LTI standard. |
Reports
| Maximum | Highest score attainable on a rubric. |
| Minimum | Lowest score attainable on a rubric. |
| Median | The middle score on the distribution of scores. |
| Upper Quartile | The median of the upper half of the data |
| Lower Quartile | The median of the lower half of the data. |