ImageExplorer CHI 2022 (Talk)

Опубликовано: 05 Февраль 2022
на канале: Anhong Guo

149

ImageExplorer: Multi-Layered Touch Exploration to Encourage Skepticism Towards Imperfect AI-Generated Image Captions

CHI 2022, Talk

Authors:
Jaewook Lee, Jaylin Herskovitz, Yi-Hao Peng, Anhong Guo

Abstract:
Blind users rely on alternative text (alt-text) to understand an image; however, alt-text is often missing. AI-generated captions are a more scalable alternative, but they often miss crucial details or are completely incorrect, which users may still falsely trust. In this work, we sought to determine how additional information could help users better judge the correctness of AI-generated captions. We developed ImageExplorer, a touch-based multi-layered image exploration system that allows users to explore the spatial layout and information hierarchies of images, and compared it with popular text-based (Facebook) and touch-based (Seeing AI) image exploration systems in a study with 12 blind participants. We found that exploration was generally successful in encouraging skepticism towards imperfect captions. Moreover, many participants preferred ImageExplorer for its multi-layered and spatial information presentation, and Facebook for its summary and ease of use. Finally, we identify design improvements for effective and explainable image exploration systems for blind users.

The 30s video preview is available at: • ImageExplorer CHI 2022 (30s Preview)
The project video is available at: • ImageExplorer CHI 2022 (Video)
Paper available at: https://guoanhong.com/papers/CHI22-Im...

Смотрите видео ImageExplorer CHI 2022 (Talk) онлайн, длительностью часов минут секунд в хорошем качестве, которое загружено на канал Anhong Guo 05 Февраль 2022. Делитесь ссылкой на видео в социальных сетях, чтобы ваши подписчики и друзья так же посмотрели это видео. Данный видеоклип посмотрели 149 раз и оно понравилось 3 посетителям.

5,487