For blind customers, AI is turning into greater than a chatbot; it may be a window into the world round them.
That’s the thought behind ScribeMe, an app created by 20-year-old Egyptian entrepreneur Mark Morad after he struggled with instruments that might learn textual content however couldn’t adequately clarify charts, diagrams, and different visible materials in his schoolwork.
ScribeMe makes use of AI and pc imaginative and prescient to show digicam footage into spoken descriptions by a smartphone or Meta sensible glasses, permitting blind and low-vision customers to establish objects, perceive their environment, and ask questions on what’s in entrance of them.
ScribeMe began with an issue within the classroom
ScribeMe grew out of an issue Mark Morad and his sister encountered after shedding their sight: the accessibility instruments out there to visually challenged folks might learn textual content fairly properly, however they may not all the time clarify the visible info round it.
That grew to become particularly troublesome at school, the place charts, diagrams, and equations have been typically simply as vital because the written materials. In line with Reuters, the necessity to discover a answer prompted him to put in writing to builders, however he obtained no response.
Morad then taught himself the best way to code utilizing YouTube tutorials. He developed a working model of ScribeMe by 2023, fixing his rapid downside with schoolwork.
ScribeMe scores one other utility win for AI
What began as a means for Mark to grasp his schoolwork has since grown into an app that may assist customers interpret the world round them.
ScribeMe makes use of a smartphone digicam to seize visible info, then AI processes what the digicam sees and turns it into spoken descriptions. Customers can ask questions on their environment, establish objects, and be taught what is going on in entrance of them, giving visually challenged customers a solution to entry visible info with out counting on one other individual.
Reuters cited a June 2026 journey to Kenya for instance of how that works in apply.
Mark’s sister Karen used ScribeMe by Meta’s sensible glasses throughout a safari, with the system describing the animals round her, together with what they have been doing and the way far-off they have been.
The Meta glasses integration pushes that utility additional. As an alternative of holding a smartphone as much as no matter they need the AI to look at, customers can use the glasses’ digicam to seize their environment hands-free.
For Meta’s sensible glasses, which have lately confronted privateness scrutiny, ScribeMe illustrates one other facet of camera-equipped wearables: the identical {hardware} that raises considerations about recording and surveillance can even assist accessibility purposes.
On this case, AI interprets that visible info and converts it into audio, giving blind customers entry to components of the bodily world they can not see, simply as reside translation helps customers break language boundaries with ease.
Extra must-read AI protection
Availability and pricing
ScribeMe is on the market at no cost obtain on iPhone and Android and, per Reuters, at the moment has 1000’s of customers in 140 nations.
The free model provides customers entry to the app, whereas extra superior options sit behind a subscription. Reuters experiences that ScribeMe expenses $20 per thirty days or $200 per 12 months, placing the annual plan at roughly $16.67 per thirty days when paid upfront.
ScribeMe is a comparatively small instance of a broader shift in accessibility expertise: multimodal AI can more and more interpret info that conventional display readers have been by no means designed to deal with. For blind and low-vision customers, that might make AI most helpful not as a chatbot, however as an interface to the bodily world.
Different Information: Apple could also be making ready camera-equipped AirPods that use Visible Intelligence to offer Siri higher consciousness of a wearer’s environment, in line with a demo found in a leaked macOS replace.
