Providing Feedback

In FLOWmulti, there are two views: View and Annotate. In the View tab, you are presented with each item of the assignment in turn to which you have been allocated (item-based marking). Remember: you may not have been allocated to a whole assignment but only individual items(s). If you have been allocated to the whole assignment, you can add inline annotations to any of these items, even if they have been auto-scored. To add an annotation, select Annotate (a PDF version of the assignment); you can then use any of the tools listed below.

The new marking tool offers three different inline annotation options: an annotate tool, a shape tool and an insert tool.

The Annotate Tool

Click Annotate, and choose from the tools available: highlight, underline, strikeout, squiggly underline, note or a text box. Select the area of text you wish to draw attention to and the desired colour. Once the tool and the text has been selected, an annotation box will appear in the right-hand window where you can add your comment. By using the icon to select text first, you can also choose to copy the text or link to a URL. Additional functions include undo, redo and erase.

 

The Shapes Tool

Click Shapes and choose from the shapes available (see screenshot below) including a free hand tool. Once the chosen shape has been inserted, (and a preferred colour chosen, if applicable), an annotation box will appear in the right-hand window where you can add your comment. By using the icon to select text first, you can also choose to copy the text or link to a URL. Additional functions include undo, redo and erase.

 

The Insert Tool

Click Insert and choose to insert a signature, a rubber stamp or today's date. Once the chosen tool has been inserted, (and a preferred colour chosen, if applicable), an annotation box will appear in the right-hand window where you can add your comment. By using the icon to select text first, you can also choose to copy the text or link to a URL. Additional functions include undo, redo and erase.

 

 

The Annotation Editor Window

Within each new annotation window, comments can be added via the text box. Click on the coloured box in the top right corner to change with whom the comment is to be shared: participant, co-assessor, private or all. Then click Save.

Once saved, the icon can be used to edit or delete the annotation. 

At the top of the annotations window there is a search box that allows you to search the annotations for text. It is also possible to sort the annotations by position, created date, modified date, sharing state, author, type or colour.

The icon can be used to filter the annotations using any of the annotations' attributes, such as author, sharing state, annotation type or colour.

The icon can be used select multiple annotations in order to perform bulk actions: (1) update the sharing status, (2) update the format or (3) delete the selected annotations.

Sharing Individual Annotations

There are four possible options for sharing annotations:

1. Private: Comments and annotations are visible only to the assessor (This is unless a reviewer has been given the privilege to access all assessment information which includes all comments made by an assessor, even if they are set to private).
2. Share with participant: Comments and annotations are visible to the assessor and the participant (upon the release of grades and feedback) only.
3. Share with co-assessor: Comments and annotations are visible to the assessor and any co-assessors that are also assigned to the same participant.
4. Share with all: Comments and annotations are available to the assessor, and co-assessors that are also assigned to the same participant and the participant (upon the release of grades and feedback).

These options can be configured per annotation in order to offer maximum flexibility to assessors. To change the setting on a single annotation, click on the coloured box in the top right corner to change with whom the comment is to be shared: participant, co-assessor, private or all.

The default WISEflow behaviour is that comments are private unless the assessor decides to share them. However, it is possible to configure this at an individual licence level or at the flow level to make the default behaviour be any of the four listed options.

For example, if the default behaviour is that annotations are shared with all, assessors would need to deselect the groups with whom they did not want to share the annotation. Please see the article on Licence Settings (licence level) or Managing Assessors, Reviewers and Marking Settings (flow level) for more information.

Submission Feedback

Alongside the annotation tools which allow assessors to make comments linked to a specific position in the submission, WISEflow also makes it possible to provide general comments and feedback at both the submission level as well as to the cohort an assessor has been allocated to. The latter can be useful if assessors, for example, start to notice the same errors appearing in several submissions.

Submission feedback can be added by clicking on the icon and opening the common feedback window from the left-hand navigation pane in the marking tool.

Add your text to the text box and format. Select your preferred sharing option i.e. with participants, co-assessors or any combination thereof. Add a file if you wish and click Submit. Any previously entered feedback is listed below in the same window. The list of feedback can also be filtered and sorted.

1. Open submission feedback window
2. Close submission feedback window
3. Enter feedback comments on the current submission
4. Displays number of feedback comments and with whom they have been shared
5. Filter and sort the list of feedback comments
6. Identifies the assessor and when the comment was last edited
7. Minimise and maximise the comment
8. Identifies the number of files attached by the assessor
9. Edit the feedback text
10. Delete the feedback or amend the sharing options
11. Identifies the name, format and size of the attached file
12. Download the attached file
13. Delete the attached file
14. Feedback text

Common Feedback

Common feedback can be added by clicking on the icon and opening the common feedback window from the left-hand navigation pane in the marking tool.

Add your text to the text box and format. Select your preferred sharing option i.e. with participants, co-assessors or any combination thereof (more information on sharing settings in the annotations article). Add a file if you wish and submit. Any previously entered feedback is listed below in the same window. The list of feedback can also be filtered and sorted.

1. Open the common feedback window
2. Text box for entering feedback to all participants to whom the assessor is allocated
3. Identifies the number of feedback comments submitted and to whom they have been shared
4. Filter and sort the list of feedback
5. Identifies the assessor and when the feedback was last edited
6. Minimise or maximise the window
7. Identifies the number of files attached by the assessor
8. Edit the feedback text
9. Delete the feedback or amend the sharing options
10. Identifies the name, format and size of the attached file
11. Download the attached file
12. Delete the attached file
13. Feedback text
14. Confirms the connection to WISEflow and number of annotations still be updated
15. Return to the flow landing page