Is it possible to implement an online Stroop Color–Word Test in SoSci Survey with reaction time measurement?

Question

Hello,

I am planning to implement an online version of the Stroop Color–Word Test in SoSci Survey and would like to confirm the technically correct and recommended approach.

My goal is to present color words (e.g. “RED”, “BLUE”) displayed in either congruent or incongruent font colors and record reaction time (latency) and response accuracy, with responses given via predefined keys or on-screen options.

Am I correct that this can be implemented using Selection Sequence (records latency) (or alternatively Assignment – records latency) by:
- randomizing congruent vs. incongruent stimuli,
- assigning each stimulus to a specific response key or option,
- and recording response latency in milliseconds?

Are there any technical limitations, best practices, or recommended settings (e.g. timing precision, device-related constraints, randomization) that I should be aware of when implementing such a reaction-time-based cognitive task in SoSci Survey?

Thank you very much for your guidance.

Kind regards

Answer 1

There are different ways to achive the goal your describe - including your suggested solution, custom JavaScript and using a LabJS experiment.

Are there any technical limitations

Color-blind respondents (which is a technial issue in the broader sense), too small smartphone displays, unexpected colors on "night mode" tablets, the browsers "reading mode", absence of a keyboard ... when you do online research, there are always edge cases. Ssomeone may use an AI agent to read them the questionnaire via in-ear speakers, and answer only by voice.

The timing precision depends on the device, but on a PC with keysboard you usually get a resolution down to 20-30 ms. One of the limits is the screen display rate (60 Hz), another the keyboard scan frequency.