New features 2.10.0
Table of contents
- New features 2.10.0
- Point-based assessment
- FLOWlock improvements
- Improved flow creation
- Wiseflow API
Some of the features you can find in the new version:
- Auto assessment of Multiple Choice-questions
- Share assessment of pages/questions between assessors
- Assessment of the same page/question for the next participant
- Monitor the process of assessment
- WISEflow API: Allows student portals or similar to connect to WISEflow
- A spell checker in a chosen language
- Watch your battery status
- Deactivate the lock down browser for participants individually
- Drag and drop appendix material
WISEflow introduces automatic assessment in FLOWmulti. The final grade is automatically converted based on the points achieved in the completed activity. If some pages are not eligible for automatic validation, assessors can be assigned to individual pages and manually score the page. The final total score will then be able to be converted into a final grade.
Below you will find examples of how to use point-based assessment.
Example 1: Auto validation and assessment of all Multiple Choice-questions (MCQ)This example will show you how to set up a FLOWmulti with auto validation on all questions. As a manager, you receive an activity with questions from the author and you need to set up a FLOWmulti. With Point-based Assessment all questions in the MCQ can be auto validated and then assessed without any assessors. To set up an exam with Point-based Assessment, do as follows:
1. Create a new FLOWmulti and add an activity under the pane 'To be handed out'. Make sure that the activity consists of only auto validated questions.
2. Go to 'Associates' and choose 'Select Assessor Distribution';
3. In the matrix you will see that all pages are auto validated and you do not need to add an assessor;
4. Set up the grading graph as desired by dragging the lines;
or entering points manually;
5. Save setup
Addition: In this case it is also possible to add assessors to the questions that cannot be auto validated for example an essay. Does that fit your practice and type of exams better then keep reading to the next example below.
Example 2: Auto validation + essay with two assessorsImaging that you have an MCQ exam with a mix of auto validated questions and essays and with two assessors associated. They need to assess one question each within their subject area and one question where they assess 50% each of the total amount of the question. First, we will go through how a manager can set up a Point-based Assessment.
Manager tasks1. Create a new FLOWmulti and add an activity in 'To be handed out'
2. Go to 'Associates', add associates, and choose 'Point-based assessment';
3. Now you will meet a matrix where you assign the assessors to the different pages. On the left hand, you see a list with all the pages from the activity, in the middle the min. and max. score and to the right a list of the assessors assigned to the flow;
4. Different ways to associate the assessors is now possible; You want to add assessor A for one question;
5. Now you add assessor B for the next question;
6. Now you click in the boxes to assessor A and B to select both. You will see how it shows that both assessors have 50%;
7. You can also put the two assessors in a group together by forming a group;
When the two assessors are in a group, it means that they have to agree on the same assessment for a specific participant. Both manager(s) and assessors will get updates on any occurring conflicts.
7. In the matrix, you can also set the min. and max. point for each non-auto validated question;
In this way, the manager can limit how many points the assessors can add or remove to a participant's score on a page.
Assessment period: Manager and Assessor tasks
In the scenario, the participants have all turned in their answers. Instead of splitting the pages between the assessors 50/50, we have created a group that has to assess the same question jointly.
When the assessment period starts, the point-based assessment page changes. The new page shows an overview of the assessment period to the manager.
From the table you can see that most of the pages have been scored automatically. Page 3 and 5 still need to be assessed by individual assessors and page 8 has yet to be assessed jointly by a group.
- You can hover over "-" in a box (e.g. page 3 by participant 1) to see specifically which assessor needs to score this page.
- You can deactivate a question or, if the question allows it, autovalidate the question score instead by pressing the pencil-button, below a page.
As you can see, no assessment, or grade, has been calculated from the point mapping matrix yet. This is because the assessors still need to assess pages. However, the autovalidated points have already been given to each participant (e.g. 10/17 to participant 1).
We follow the scenario as the first assessor scores his/her pages.
The assessor opens the assessment tool as usual from the assessor flowpage. Instead of being shown the whole exam for each participant, point-based assessment makes it so that the assessor is shown the individual pages that he/she is assigned to, for each participant.
Assessing page 3 for participant "Benjamin Zachariae":
1. Assess how the autovalidation (if the question allows it) has scored the page.
It is currently at a 0 out of 2.
Notice: Question 8 has a score of 2/2 because the system has autovalidated the question to guide the assessor.
2. Add an annotation. Press the "+"-button, add a score and a comment.
Notice: The overall score changes as you edit the annotation and you cannot go beyond the limits of min (-1) and max (2).
3. Overview annotations. The overall score is affected by the accumulated total of all annotations.
4. When the question has been scored, press to approve the page score. This means that you cannot add annotations except if you remove the approval again.
The score is now added to the participants approved score.
The assessor scores and approves all of his/her pages
From here the assessor can choose to score the next assigned question for the same participant or press to go to the same page for the next eligible participant.
*Note: This feature is not exclusive to point-based assessment, but also added to the usual assessment method.
1. The assessor can overview his participants and pages from the top panel (with the flow name).
2. The assessor can overview a participant and shortcut to the score registration page from the right top panel (with participant name).
3. Register the scores for each participant.
The manager can follow the progress of the assessors.
Now all pages has been scored by the assessors. We see that one of the group assessments sends a warning. This is caused by the group having scored Page 8 differently.
As usual, the assessor is warned about the in-congruency by mail. The assessor can see the issue when he/she enters both the Registration page and the Assessment tool.
1. The assessor can access the contact information of the assessor to coordinate a new assessment.
Approve and register new grade to finalise the assessment period for the assessors.
Finally, the manager can overview the calculated grades, make final touches to the point mapping matrix and register the grades.
Smart features and quick guides
If the assessment period is ongoing and one of the assessors is calling in sick you can now replace the present assessor with a new assessor. The new assessor will take over all the activities of the previous assessor automatically. As a manager, you do not need to do anything besides using the tool: Substitute assessor;
Fill out the tool by clicking on those assessors who needs to be swapped;
As a manager you can form a group of assessors if they need to assess the pages together.
A group of assessors
Now you will choose those assessors who will make up a group:
To group assessors means that they have to assess the page together and agree on which assessment the participant deserve. If they do not agree on the same assessment a conflict will appear for both assessors and the manager. The assessors
Monitor the process of assessmentIn the assessment process, the manager can follow the progress of the assessors and at the same time see if any conflicts occur between the assessments of the assessors.
Smart features and quick guides
Remove lock from a single participantAs a manager you now have the possibility to remove the lock in a flow with lock from a single participant. This is advantageously if the participant is allowed to use special material for completing the flow (see the image below).
Spell checkerIt is now possible to activate spell checker in FLOWlock. That means that participant now will be notified if a word is misspelled. The language for the spell checker depends which languages the manager chooses to activate for the participants on the flow. Go to the 'Manage all settings' and the choose the participant you would like to change the settings for.
How to set the individual settings of participants to differ from the general settings of the flow:
2. Remove lock or change the spell checker
8. Afterwards, remember to set up the grading graph (see how in the first example). It is also possible to save temporarily if you need to get more information for completing the setup of Point-based Assessment.
Watch your battery statusEach participant can now see their computer's battery status at the top of their screen in FLOWlock.
Insert your image in the textIt is now possible to insert drawn images and pictures taking with your webcam in the text by using the arrows in the bottom of the image in the appendix material.
Improved flow creation
When you create a new flow, you will now meet a page with a new design. The settings are the same as always, so it is just a matter of getting started.
Create new flow
Our new WISEflow API allows student portals or similar to connect to WISEflow and retrieve data about the users, flows, and notifications. Flow information and notifications can then be displayed, just as the institution prefers it in their systems.
Combined with single-sign-on, this also allows the students and assessors to navigate seamlessly from the student portal into WISEflow.
If you want to hear more about gaining access to the WISEFflow API, please contact email@example.com