OAP Glossary of Terms

Glossary of Outcomes Assessment Projects Terms

 

Templates

Organization Hierarchy The institution, schools, programs, and departments that will be involved in OAP.
Academic Sessions An institutions academic years and terms.
Courses Courses that will be involved in OAP.
Course Sections Course sections that will be involved in OAP.
Users

Individuals that will be involved in OAP. These individuals can be Assessment Coordinators, Faculty, and/or Evaluators.

Section Enrollment Information about faculty members of record who should either be scoring just their own students or be prevented from scoring their own students.

 

User Roles

Evaluator Scores work in OAP.
Assessment Coordinator Assessment Coordinators have administrative rights in OAP. They can define
the rubrics and learning outcomes to be measured. Create Assignments.
Manage artifacts for scoring, and runs reports.
Can also be assigned an Evaluator role.
Faculty This role is typically used when faculty will be assisting the Assessment Coordinator with creating assignments or populating student work in the system. They can also create assignments, manage artifacts for scoring, and
run reports.
Can also be assigned an Evaluator role.

 

 

System

Project The Project is where an Assessment Coordinator will establish the timeline, outcomes, and courses that will generate data. In the Project, Assessment Coordinators decide what is being measured and why, as well as how work will be evaluated. The will also decide where the work is being collected from, how the work is being collected, and who will evaluate the work.
Assignment Assignments define what artifacts have been collected from students, which courses the artifacts are coming from, and what outcomes they will be assessed against.
Term

Period in which an artifact was collected. Synonymous with semesters or academic sessions within an institution.

Learning Outcomes &
Rubrics Library
A list of all the Outcome Sets that are available to an Assessment Coordinator and the rubrics affiliated with each outcome. Assessment Coordinators can also create and edit Learning Outcomes Sets and rubrics from this area.
Outcomes

Outcomes identify what students will know and be able to do by the end of a course or program.

Outcome Set A set of outcomes that student work will be assessed against. Each outcome is assigned a rubric which is scored by a committee of identified Evaluators.
Roster A CSV template containing a list of students whose work will be uploaded into an Assignment and their respective enrollments in relation to a course and/or course section.
Bulk Upload The Bulk Upload tool allows Assessment Coordinators and Faculty

to upload student work to an Assignment in bulk within a ZIP file.

Manual Upload The Manual Upload tool allows Assessment Coordinators and Faculty to upload student work individually to each student record.
Calibration Project Also referred to as “Norming Projects”, Calibration Projects are created to help Evaluators come to a consensus about how to score student work or measure performance on a rubric. Calibration Projects are often created prior to launching any actual Projects as it is an effective way to introduce Evaluators
to the system.
Unscorable Submissions A setting that, when enabled, allows Evaluators to report work submissions as unscorable. This would be used if a submitted file was corrupt or unreadable. Marking a submission as unscorable will remove it from the Scoring Queue.
Scoring Queue A list of student work available for scoring. The queue is shared by all Evaluators in a group. Ten work submissions are displayed at a time in the queue. Once all student work has been evaluated, the queue will be empty.
LMS Integration LMS integration allows students to submit work from within their LMS. Students would submit work directly to OAP for an Assignment by following a link in their LMS course. The integration is based on the LMS LTI standard.

 

Reports

Maximum Highest score attainable on a rubric.
Minimum Lowest score attainable on a rubric.
Median The middle score on the distribution of scores.
Upper Quartile The median of the upper half of the data
Lower Quartile The median of the lower half of the data.
Was this article helpful?
2 out of 2 found this helpful

Articles in this section

How to Contact Support
There are many ways to reach out! Click here for our support options.
Watermark Academy
Click to access the Watermark Academy for consultation, training, and implementation companion courses.