Be My Eyes AI: GPT-4 Aid for Blind Microsoft Users

In collaboration with Be My Eyes, a company that connects visually impaired individuals with sighted volunteers, Microsoft is striving to enhance the customer service experience for its visually impaired users by utilizing OpenAI’s ChatGPT-4 technology.

Be My Eyes Impact of Innovation: Transforming User Experiences

Microsoft has integrated a digital visual assistant tool called Be My AI into its Microsoft Disability Answer Desk. This integration allows visually impaired Microsoft users to independently resolve technical issues and perform tasks such as software updates without the need for assistance from a call center agent. 

Be My Eyes, the creator of Be My AI, conducted tests on Microsoft users and found that the call time with human agents is less than half of the average. Interestingly, only 10 percent of users chose to speak with a human customer service representative after interacting with the AI tool. Be My AI utilizes OpenAI’s GPT-4 vision model to generate descriptions of photos taken by users, providing instructions for tasks like setting up a new computer or reading product labels. Additionally, the tool employs AI-based natural language conversations to offer contextual and advice-based guidance, assisting users with various issues.

A Vision of Empowerment

The collaboration between Be My Eyes AI and GPT-4 represents just the beginning of an evolutionary journey. The potential to expand, refine, and innovate in support services for visually impaired users is limitless. It’s a commitment to an ever-improving, ever-evolving future.

Jenny Lay-Flurrie, Microsoft’s chief accessibility officer, expressed Microsoft’s pride in being the pioneer in incorporating Be My AI into their customer service through the Disability Answer Desk. This integration of Be My AI not only introduces an innovative approach but also ensures a swift and effective means for disabled customers to seek assistance from Microsoft. By merging Microsoft’s proficiency with the inventive solutions offered by Be My AI™, we are enabling individuals with disabilities to embrace independence.

AI Tool Enters Beta Testing Phase

According to a report by Bloomberg, Mike Buckley, the CEO of Be My Eyes, mentioned that the AI tool is currently undergoing beta-testing with various other corporations such as Sony, Procter & Gamble, and Hilton.

OpenAI’s recent announcement follows closely on the heels of its inaugural developer conference. During the event, the company proudly shared that it has surpassed the impressive milestone of 2 million developers, with an overwhelming majority of 92 percent representing Fortune 500 companies. Additionally, OpenAI unveiled several exciting additions, including a user-friendly tool that enables the creation of personalized iterations of ChatGPT without the need for coding expertise.

The COO of OpenAI, Brad Lightcap, expressed his pride in collaborating with Be My Eyes, which has utilized its AI models to improve the daily experiences of individuals with visual impairments greatly. Be My Eyes was briefly acknowledged during this statement. 

Microsoft has taken another step in its commitment to accessibility by partnering with Be My Eyes. This collaboration aims to enhance the accessibility of Microsoft products. During the Microsoft Ability Summit, the company unveiled the “Accessibility Assistant” feature for Microsoft 365. This innovative tool provides real-time notifications to users, ensuring that their content is accessible to all.

The integration of Be My Eyes AI with GPT-4 technology marks a pivotal moment in the quest for accessibility and inclusivity. As these technological marvels converge to empower visually impaired Microsoft customers, they not only revolutionize support services but also redefine how we perceive the possibilities of AI in fostering a more inclusive society.

Related Articles: Discover How AI Tools for Game Creators Will Revolutionize Gaming with Xbox and Inworld AI, Minds of Metal: World’s First AI-Powered Humanoid Robot CEO Takes the Helm