Google has introduced a new AI-driven feature in its Lookout app called Assisted Vision. Visually impaired people can use this AI feature to ask several questions about the details of an image.
Google unveiled the “Image Q&A” function in its accessibility application Lookout and gave a brief demonstration of it during some major announcements at Google I/O 2023 recently.
Visually impaired can ask any question to understand what is in the image and the artificial intelligence provides them with a clear answer every time. The purpose of this feature, and of Lookout in general, is to help visually impaired people understand a photo or drawing.
An image needs to be uploaded to the app, before asking the AI to describe it. The latter will execute and explain what can be seen on the screen. This first description is effective and might suffice if one just wants a quick summary. However, those who need to go into more detail can just ask a question, in writing or out loud.
Describing an image is no longer a very complex challenge for a well-trained artificial intelligence. However, Google has successfully taken the concept one step further to make it more practical and beneficial for people with disabilities.