Introducing Google’s Lookout app, an AI-powered tool designed to assist people who are visually impaired in identifying objects and reading documents. The latest update to Lookout includes a new Image Q&A feature that allows users to upload an image and receive more detailed descriptions, even if there are no captions or alt text available. Users can also ask follow-up questions about an image using their voice or by typing them out. Google aims to make visual media more accessible and inclusive with this feature.
The Image Q&A feature can be used on social media photos, pictures in group chats, and images from the camera roll. This helps users get more precise information about the content of these images. It addresses the issue of pervasive visual media that is often inaccessible to individuals who are blind or visually impaired. Lookout Product Manager Scott Adams emphasizes the importance of inclusion and providing another tool for interacting with the visual world.
The update initially launches in the US, UK, and Canada in English, with plans to expand globally and support more languages in the future. Google wants to gather feedback and ensure users from different cultures are satisfied with the model’s handling of photos from their environment before rolling it out worldwide.
In addition to the new features in Lookout, Google is adding support for 11 new languages, including Chinese, Japanese, and Korean. This brings the total number of supported languages to 34, further enhancing accessibility for users around the world.
Google’s Lookout app is part of the company’s initiative to improve digital accessibility. It joins other tools like Project Relate, Live Transcribe, Sound Notifications, and accessibility features for Pixel phones. Tech giants like Apple and Amazon have also made strides in accessibility, with features like People Detection, Live Captions, and streaming audio directly to hearing implants.
By utilizing AI and expanding language support, Google continues to make progress in enabling individuals with visual impairments to access and interact with visual media more effectively. Lookout’s Image Q&A feature is a valuable addition that empowers users to explore and understand a variety of images, ultimately fostering a more inclusive digital experience for everyone.
IntelliPrompt curated this article: Read the full story at the original source by clicking here