AGREE-MENT

• A set of exams can be marked by more than one marker so inter-rater agreement is calculated while marking

• A markers training mode allows marking until everyone reaches a consensus

• Three chat interfaces support collaboration

  • Chat: For free messages​

  • Board: For messages from the supervisors

  • SOS: To ask for help on a specific exam​

• Agreement interface help markers identify their differences easily​

  • Agreement per criterion​​​

  • Agreement per exam

  • Agreement per marker

• Quality Control marking can be added for calculating inter-rater agreement​

• Export marks in Excel format ready to import in R for analysis