BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation
UIST 2023, Video
Authors:
Chen Liang, Yasha Iravantchi, Thomas Krolikowski, Ruijie Geng, Alanson Sample, Anhong Guo
Abstract:
Touchscreen devices, designed with an assumed range of user abilities and interaction patterns, often present challenges for individuals with diverse abilities to operate independently. Prior efforts to improve accessibility through tools or algorithms necessitated alterations to touchscreen hardware or software, making them inapplicable for the large number of existing legacy devices. In this paper, we introduce BrushLens, a hardware interaction proxy that performs physical interactions on behalf of users while allowing them to continue utilizing accessible interfaces, such as screenreaders and assistive touch on smartphones, for interface exploration and command input. BrushLens maintains an interface model for accurate target localization and utilizes exchangeable actuators for physical actuation across a variety of device types, effectively reducing user workload and minimizing the risk of mistouch. Our evaluations reveal that BrushLens lowers the mistouch rate and empowers visually and motor impaired users to interact with otherwise inaccessible physical touchscreens more effectively.
The 30s video preview is available at: • BrushLens UIST 2023 (30s Preview)
Paper available at: https://guoanhong.com/papers/UIST23-B...
Watch video BrushLens UIST 2023 (Video) online, duration hours minute second in high quality that is uploaded to the channel Anhong Guo 04 September 2023. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 154 times and liked it 2 visitors.