App for phone or smart glasses to guide the blind

NEW YORK: A blind man walks into a Walgreens . . .

It sounds like the beginning of a joke, but it’s not. Walgreens, America’s second-largest chain of chemist shops, has struck up a relationship with Aira, a supplier of internet-based services for the blind and vision impaired, that helps customers walk around Walgreens shops and find the things they’re looking for.

And now Aira is looking for Australian business partners, including retailers, universities, airports, employers and even towns and cities, to do the same thing here.

The San Diego, California-based start-up has developed an app that uses either a phone’s video camera, or the video camera mounted in Aira’s “Horizon” smart glasses, to transmit a live video feed of what’s in front of the user, back to a remote, human agent.

The agent, who has been trained in guiding the vision impaired, watches the video feed, and narrates the scene back to the user in near real time, over the phone’s speaker or earphones.

The name Aira (pronounced “EYE-rah”) initially stood for “Artificial Intelligence Remote Access”, and the intention was to have vision-based machine learning platforms do all the narration, Suman Kanuganti, Aira’s founder and CEO, said.

But when Aira was founded in 2014, the AI technology wasn’t quite good enough.

“The whole concept started with AI,” Mr Kanuganti says.

“But we quickly figured out that AI couldn’t solve the problem to the extent that [someone using Aira] could walk all by themselves to the shop, pick up the things they needed, and come back. It turned out the world was much more complex than we imagined,

“So we asked ourselves, can we simulate AI with a human being?”

And it’s turned out that the biggest selling point of Aira hasn’t been the technology, but the person-to-person interaction that the blind and vision impaired have with the remote operator, he says.

AI is still used for some tasks, such as reading out labels that are placed in front of the camera, but the valuable interactions are with actual people on the other end.

And actual people don’t come as cheap as AI.

Aira’s “standard” plan costs $140 a month (or $175 a month including the Horizon smart glasses), which includes unlimited AI narration but just 120 minutes of human narration per month.

That charge also includes the telecommunications costs of the service, which is hosted on AT&T’s global mobile data network.

In the US, Aira has been doing sponsorship deals with airports, universities, and retailers such as Walgreens, where any use of the service while inside the precinct of the sponsor doesn’t come off the monthly quota. It’s paid for by the sponsor.

An Aira user walking past a Walgreens, for instance, will receive a spoken notification on their phone, telling them free narration is available in the nearby store.

A user could walk into the store, call up a remote operator, tell the operator what he or she is looking for, and then have the operator guide them around the store.

It helps bring customers into the store, and it helps the vision impaired shop in ways they’ve not been able to before.

“We did measure this,” says Mr Kanuganti.

“Of all the people who walk into Walgreens with Aira, 60 per cent of them had never been into a Walgreens before. And the average basket size of [Aira users] going into the shop is higher than Walgreens’ average.”

Aira’s goal is to make its service completely free for its blind and vision-impaired user base.

This would work by having every interaction with a remote operator sponsored, be that by the retailer directly, or by the shopping mall or airport, or by the employer when the user is at work or, failing all of those things, the city itself.