Single annotator multiple instance evaluations

Question

Hi

I have a dataset with multiples text to be evaluate by an annotator. I want that each annotator evaluate 5 or more instances of the dataset. I have all the question to evaluate a single instance (text) in a single page. Is there a way to loop 5 or more times the same page and record all the answers.

Regards!

Answer 1

This is what you need:
Multi-Level Structure

You will have to use a random generator in the master questionnaire to randomly select texts, plus randomUse() to allow for a variable number of texts to be evaluated pro respondent, while still making sure that each texten is rated evenly often.