Creating Assessment Project Activities

Creating an Activity

If the instructions in this article do not match what you see in your product, you might be using Watermark's Outcomes Assessment Projects. Please check the articles in the Outcomes Assessment Projects (OAP) section for the correct guidance.

Assessment Project Activities are used to organize your learning outcomes, rubrics, and student artifacts. Multiple learning outcomes, rubrics, and course sections can be added to each activity within a single assessment project. To meet your assessment needs, you have the flexibility to organize your project activities by learning outcomes, course sections, etc. For example, depending on your assessment practices, you may choose to organize your activities by program, selecting only course sections that are associated with your program.

  1. Select Create New Activity and configure your activity settings

    A Project Overview page showing project status with setup tasks, an empty Activities section, and an Evaluator Overview section, with the Create New Activity button highlighted.
  2. Activity Details
    1. Enter an Activity Title
    2. Select the method for collecting artifacts for your activity
      1. Section Bulk Upload - Collect artifacts by bulk uploading files directly into this activity using course sections.
      2. LMS Integration - Collect artifacts directly from students by connecting this activity to an LMS assignment.
      3. Anonymous Bulk Upload - Collect artifacts by bulk uploading files directly into this activity without student or course identifiers
Screenshot showing the "Collection Method" options for a new Assessment Projects activity
  1. Collection Details

    1. Course Sections
      1. Selecting course sections will create a student roster, to which you will add artifacts for each student
      2. Select Add Course Sections

        A Course Sections area showing an option to add course sections with an Add Course Sections button highlighted.

      3. From the Course Sections area, you can select any course to which you have access (Admins will only have the option to add courses from their hierarchy nodes - department/program where they are added as a “Lead”)
      4. Select Save

    NOTE: Course sections need to be selected and added for an assessment project activity only if the artifact collection method selected is either Section Bulk Upload or LMS Integration. The Anonymous Bulk Upload artifact collection method DOES NOT require selecting course sections.

    A Course Sections page showing a searchable list of sections with columns for Section and Term, with one section selected and options for filtering by term, showing selected sections only, and Cancel and Save buttons, with the Save button highlighted.

  2. Learning Outcomes

    1. Select Add Learning Outcome

      A Learning Outcome area showing an option to add course sections with an Add Learning Outcome button highlighted.

      1. Select a learning outcome to be assessed in the activity
      2. Select one or more rubrics to be used for assessment of the selected learning outcome
        1. “Outcome Aligned” indicates if the selected learning outcome is aligned to the rubric listed

    A Learning Outcome section showing dropdown selections for Learning Outcome and Rubric, with Creative Thinking chosen as the learning outcome and Problem Solving Rubric selected as the rubric.

  3. Select Add
    1. You have the option to add multiple learning outcomes to be assessed for the activity
  4. Evaluation Sampling Details

    1. Sampling Rounds: You can add up to 4 sampling rounds for the activity and can set up a separate sample percentage for each evaluation round. The sample percentage set for a sampling round should be less than or equal to the sample percentage value for the previous sampling round; for example, if the percentage defined for Sampling Round #1 is 80%, the percentage for Sampling Round #2 can be either 80% or less than 80%.
      1. Select ADD SAMPLING ROUND to add a new assessment sampling round.
      2. Enter a percentage value for the newly added assessment sampling round.

    A New Activity page showing collection details with selected course sections and learning outcomes, along with evaluation sampling details including sampling percentage and an Add Sampling Round button highlighted, as well as Go Back and Create options.

    A New Activity page showing collection details with selected course sections and learning outcomes, along with evaluation sampling details that include multiple sampling rounds, sampling percentages, and an option to add another sampling round, as well as Go Back and Create buttons.

  5. Score Discrepancy Check: The option to enable the score discrepancy check is available once at least 2 assessment sampling rounds have been added for the activity. The Score Discrepancy Check allows you to indicate if you want the system to detect when two evaluators submit rubrics that have discrepant total rubric scores.
    1. Point Variance: Once Score Discrepancy Check is enabled, you will need to select the difference in total score you’d like the system to use. For example, if you enable this feature and set the Point Difference to 10, and one evaluator’s total rubric score was 30 and the second evaluator’s total rubric score was 40 or higher, the system will flag the artifact and send it to be scored by a third evaluator. The additional evaluation is assigned randomly based on your project and activity settings.

      A New Activity page showing collection details with selected course sections and learning outcomes, along with evaluation sampling details including multiple sampling rounds, a score discrepancy check field, and an Add Another Round option, with the Point Variance highlighted.

    2. Select Create. Newly created activities are displayed in the Activity list on the Project Overview page.

Editing an Activity

  1. To edit an activity, select “Edit Activity”
    a. Only available when a project is in draft. After a project has been opened, you only have the option to add or delete artifacts
    b. Edit Activity is not an option once a project has been opened
  2. Select SAVE - NOTE: If you remove any previously added course sections, any students and their artifacts will be removed from the activity as well.
Was this article helpful?
1 out of 2 found this helpful

Articles in this section

How to Contact Support
There are many ways to reach out! Click the icon above for our support options.
Watermark Academy
Click the icon above to access the Watermark Academy for consultation, training, and implementation companion courses.
Customer Community
Can’t find the answer? Ask fellow users how they’re making the most of Watermark in our Community!