we love when an inside joke for stream accidentally becomes a really cool project and new fixation 😂
the j a r
#rahituber #pngtuber #vtuber #mousetracking
Latest posts tagged with #mousetracking on Bluesky
we love when an inside joke for stream accidentally becomes a really cool project and new fixation 😂
the j a r
#rahituber #pngtuber #vtuber #mousetracking
- Four attention check questions: The classic "please select 'strongly agree' to show you're reading this" type questions. - Two consistency checks: Paired questions where humans should answer in predictable patterns. For example, if the answer to one question was true, the other had to be false (and vice versa) because it indicates consistency. - Two reverse shibboleth items: Questions that your intended sample (i.e., humans) should not know the answer to, but an AI agent likely would. - Three cognitive traps: These are visual illusions designed to exploit fundamental limitations in vision-enabled AI systems. We used a modified Müller-Lyer illusion, a modified cafe wall illusion, and a ‘moving robot task’, all of which have been shown to be highly discriminative between AI agents and human participants. - Comprehensive mouse tracking: Recording every cursor movement and click pattern throughout the survey. - Qualtrics' reCAPTCHA score: The platform's built-in risk scoring system.
We tested five different AI agents, each completing the survey 25 times to match our human sample size: - GPT Agent: OpenAI's GPT configured to complete surveys - Claude: Anthropic's Claude accessed via Cursor - Perplexity: Perplexity AI's search-enhanced agent - Gemini: Google's Gemini via Project Mariner - Custom Agent: Our in-house ‘white hat’ agent, designed by Prolific’s AI research engineers to take surveys and avoid detection The custom agent was crucial to include because it’s specifically designed to take surveys undetected. It’s closer to Westwood’s bot (2025) as an adversarial, customisable agent than the more readily detectable commercial AI agents. To take part in the survey, we provided all agents with an identical prompt that asked them to complete the survey as a human would and exhibit human-like behaviour.
Prolific’s bot authenticity check (100% accurate) Mouse tracking (95.0% accurate) Qualtrics’ reCAPTCHA score (94.2% accurate) Cognitive traps (85.2% accurate) Consistency checks (62.7% accurate) Classic attention checks (59.7% accurate) Reverse shibboleth questions (58.0% accurate)
Can researchers detect #AI bots taking paid surveys?
#Prolific tested humans and #LLM agents with various #dataQuality checks.
- The company says they caught 100% of the non-humans.
- My take-away: #reCAPTCHA and #mouseTracking caught 95%
www.prolific.com/res...
#surveyMethods
Qualtrics Mouse Tracing (QMT) may be the only scalable, code-free way to track mouse activity during experiments, according to Steph Smith (U Chicago).
"If you want complete and total flexibility for your study design, we have a step-by-step version with extensive documentation!" – Steph Smith (U Chicago)
Does the search pattern predict choice? (Yes) • Outcome: Proportion of choices for higher expected-value option • Predictor: Payne Index {option-wise transitions - attribute-wise transitions}
Steph Smith's collaborator is David Dolifka. Find their code, Qualtrics files, etc. on GitHub with the QR code or the URL in the post.
Many cognitive scientists change decisions; few look in the black box to see HOW.
Steph Smith demoed such #processTracing
...in #Qualtrics!
…without any coding!
Find everything you need at github.com/QMT-code/QMT
Follow her work at www.researchgate.net/profile/Step...
#eyeTracking #mouseTracking
Supervising a Psychology student creating an online #mousetracking experiment with #jsPsych - showing videos and asking participants to choose left or right.
If you’ve worked on something similar and are happy to share a code template or know of good resources, we’d really appreciate it! 🙂
Q Open Paper: Validating Mouse Tracking in economic research
Cool methodological, new paper in #mousetracking in #econ research. #QOpen #agecon #DCE
Mouse tracking in a DCE can be a useful and valid tool 🔧 to uncover Hidden decision-processes without interfering with respondents decisionmaking. 💡
🎉 New YouTube tutorial!
Learn to use mouse responses 🖱️ to select a location and end trials when clicking an invisible Region of Interest 🎯. Perfect for beginners & undergrads!
Watch now: youtu.be/iHc2s_6VEqw
#PsychoPy #MouseTracking #Psychology #Teaching #Research
🎯 New tutorial: Learn #MouseTracking in #PsychoPy in 5 minutes! 🖱️💻
✅ Track mouse position frame by frame
✅ Build a fun "Where’s Wally?" task
Perfect for psychology students & researchers!
👉 Watch now: youtu.be/k5hktpat4mo
#Psychology #CognitiveResearch #Tutorial
Workshop outline (with names and affiliations in case that helps you find and cite the experts).
Ian Krajbich and visual examples of online eye-tracking, mouse-tracking, and text one may want to analyze (e.g., online reviews)
Nitisha Desai showing an example of mouse tracking patterns can reveal about decisions and judgments.
Ada Aka explaining how think-aloud protocols and other forms of text process tracing matter: they get us inside the opaque box of people's reasoning! Did you know think-aloud protocols can also be done online? See Byrd et al 2023 below: Byrd, N., Joseph, B., Gongora, G., & Sirota, M. (2023). Tell Us What You Really Think: A Think Aloud Protocol Analysis of the Verbal Cognitive Reflection Test. Journal of Intelligence, 11(4). DOI: 10.3390/jintelligence11040076
My final session at #SJDM 2024: Online #ProcessTracing!
Ian Krajbich gave the rationale.
Xiaozhi Yang demoed webcam #eyeTracking.
Nitisha Desai showed #mouseTracking code.
@adaaka.bsky.social advised on #coding scalable #textAnalysis with #LLMs.
Files on github.com/krajbichlab/...
#python #AI
It is on: Michael Spivey will talk about #mousetracking and #eyetracking in the #ViProc seminar series TOMORROW (April, 29th) ... it will be morally traceable! https://processtracing.wordpress.com #jdmresearch #processtracing
@PascalKieslich talking design effects in #mousetracking #EGPROC2019
@4ester #EGPROC2019 #mousetracking
@PascalKieslich is kicking off #mousetracking workshop at #EADM2018
this looks interesting
http://www.psychonomic.org/page/2018workshop
#mousetracking #mousetrap @PascalKieslich @felixhenninger @dirkuwulff
#mousetracking power forum #teap2018
process modeling #teap2018 #mousetracking
#teap2018 #mousetracking second part
#thedude and @EmmaWatson and #mousetracking
#teap2018 #mousetracking free- and forced-choice
#mousetracking #teap2018 fancy modeling here
#teap2018 #mousetracking daniel heck
#GUI in the house @denisohora on confidence #teap2018 #mousetracking
#teap2018 #mousetracking @dirkuwulff is on