BrushLens UIST 2023 (30s Preview)

Published: 01 September 2023
on channel: Anhong Guo

106

BrushLens: Hardware Interaction Proxies for Accessible Touchscreen Interface Actuation

UIST 2023, 30s Preview

Authors:
Chen Liang, Yasha Iravantchi, Thomas Krolikowski, Ruijie Geng, Alanson Sample, Anhong Guo

Abstract:
Touchscreen devices, designed with an assumed range of user abilities and interaction patterns, often present challenges for individuals with diverse abilities to operate independently. Prior efforts to improve accessibility through tools or algorithms necessitated alterations to touchscreen hardware or software, making them inapplicable for the large number of existing legacy devices. In this paper, we introduce BrushLens, a hardware interaction proxy that performs physical interactions on behalf of users while allowing them to continue utilizing accessible interfaces, such as screenreaders and assistive touch on smartphones, for interface exploration and command input. BrushLens maintains an interface model for accurate target localization and utilizes exchangeable actuators for physical actuation across a variety of device types, effectively reducing user workload and minimizing the risk of mistouch. Our evaluations reveal that BrushLens lowers the mistouch rate and empowers visually and motor impaired users to interact with otherwise inaccessible physical touchscreens more effectively.

The project video is available at: • BrushLens UIST 2023 (Video)
Paper available at: https://guoanhong.com/papers/UIST23-B...

Watch video BrushLens UIST 2023 (30s Preview) online, duration hours minute second in high quality that is uploaded to the channel Anhong Guo 01 September 2023. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 106 times and liked it 2 visitors.

256