X-Ray: Screenshot Accessibility via Embedded Metadata

Published: 04 August 2019
on channel: Anhong Guo

469

X-Ray: Screenshot Accessibility via Embedded Metadata
ASSETS 2019

Authors:
Sujeath Pareddy, Anhong Guo, Jeffrey P. Bigham

Abstract:
Screenshots are frequently shared on social media, via personal communications, and in academic papers. Unfortunately, existing screenshot tools strip away semantics useful for making the content accessible, leaving only pixels. For example, a screenshot of a table removes the structural information useful for conveying it. We quantify the scale of the problem via a study of academic papers, showing that a large number of images included in academic papers are screenshots, and validate this via qualitative interviews with researchers about their figure generation process. We then introduce X-Ray, a system that captures and embeds the semantics of the underlying content into images. Using the X-Ray screenshot tool, semantic information is captured and stored in the Exif data of the resulting image, allowing it to "tag along" as the image is shared and reposted. We demonstrate that our approach retains accessibility for screen reader users via a study with five blind participants. More generally, our approach suggests a method for embedding accessibility metadata into otherwise inaccessible formats, enabling them to retain the more accessible representations that are present at capture time.

Paper available at: https://guoanhong.com/papers/ASSETS19...

Watch video X-Ray: Screenshot Accessibility via Embedded Metadata online, duration hours minute second in high quality that is uploaded to the channel Anhong Guo 04 August 2019. Share the link to the video on social media so that your subscribers and friends will also watch this video. This video clip has been viewed 469 times and liked it 2 visitors.

2,311