Accessible Augmented Reality in Sheltered Workshops: A Mixed-Methods Evaluation for Users with Mental Disabilities

A prominent application of Augmented Reality (AR) is to provide step-by-step guidance for procedural tasks as it allows information to be displayed in situ by overlaying it directly onto the user’s physical environment. While the potential of AR is well known, the perspectives and requirements of individuals with mental disabilities, who face both cognitive and psychological barriers at work, have yet to be addressed, particularly on Head-Mounted Displays (HMDs). To understand practical limitations of such a system, we conducted a mixed-methods user study with 29 participants, including individuals with mental disabilities, their colleagues, and support professionals. Participants used a commercially available system on an AR HMD to perform a machine setup task. Quantitative results revealed that participants with mental disabilities perceived the system as less usable than those without. Qualitative findings point towards actionable leverage points of improvement such as privacy-aware human support, motivating but lightweight gamification, user-controlled pacing with clear feedback, confidence-building interaction patterns, and clearer task intent of multimodal instructions.