I have a question regarding the feasibility of implementing an upcoming survey project in SoSci Survey. Our current survey provider does not appear to support the required allocation of stimuli and participants. The survey would consist of three parts:
Pre-survey: This section would determine participants’ eligibility and classify them into two groups: participants with and without a speicific trait.
Comment annotation: Each participant would be randomly shown 50 comments from a pool of 1,500 text-only social media comments. Each comment must be evaluated by six participants: three with and three without the specific trait. For every comment, participants would provide continous rating and one binary classification. Thus, each comment should ultimately receive six ratings and six binary labels, evenly distributed across the two participant groups.
Post-survey: This section would include several open-ended questions.
The balanced allocation of comments across the two participant groups, combined with the size of the comment pool, appears to be difficult to implement with our current provider. Would it be possible to implement and host such a project in SoSci Survey?
Thank you very much in advance!