BARRIERS ARE BEING LIFTED WITH ARTIFICIAL INTELLIGENCE

HUAWEI has developed an app in which visually impaired people talk using the power of artificial intelligence, allowing them to "see" or feel the emotions on people's faces.

Called , the app uses the phone's powerful camera and artificial intelligence to translate seven universal human emotions into seven unique sounds. This makes it possible for visually impaired people to have a richer experience and understanding when communicating with others.

This artificial intelligence (AI) supported application was achieved by pushing the limits of artificial intelligence technology. After analyzing facial expressions and emotions, a new programming language was created with the support of artificial intelligence to convert them into sound. Using the rear cameras of the phones, the application scans the face of the person speaking to the visually impaired person and identifies the positions of facial elements such as eyes, nose, eyebrows and mouth relative to each other. The artificial intelligence algorithm first converts these definitions into a defined sound on the phone and then transmits them to the headset worn by the visually impaired person. All this happens in real-time and offline mode.

The aim of the development of the project was to find a solution to a problem experienced by the visually impaired in the real world with the help of technology. The "Facing Emotions" application, which brings people and technology together, was developed with the support of visually impaired individuals and charities. Emotional inspiration was an important component of this process, the sounds themselves.

The sounds to be created to represent each of the seven emotions by the visually impaired composer Tomasz Bilecki, who has undertaken important art projects such as the Invisible Exhibition; it should be short, concise, simple for the user and their environment. Thanks to Bilecki's unique perspective on the nature of sound, the app was able to convey emotions to other visually impaired people. The sound samples were then tested and finalized by a team of visually impaired consultants.

A short documentary film was made to show how much difference Facing Emotions can make in people's lives. The film, which tells the stories of Mustafa from Turkey, Mirjana from Sweden and Robert from Poland, presents sections from the lives of three visually impaired people. Their stories and reactions were incredibly motivating, and this powerful short touches on themes that will captivate audiences for a long time to come. You can watch the Facing Emotions commercial on video:

The project that Microsoft recently released is its application called Seeing AI. The company gives hope to the visually impaired with the service it offers.

The artificial intelligence of this application detects the contents displayed by the camera and is described audibly to the user. This smart assistant makes life easier for visually impaired people by guiding them. When the app was first launched, its artificial intelligence could detect a human face, expression, gender, and age through the camera. Now, thanks to the new features he has gained, he can read handwriting, count Canadian Dollars, British Pounds and Euros, and perceive the colors of clothes.

Musical Light Detector, another newly added feature to the Seeing AI application, detects the weather and notifies the user by playing music according to the strength and color of the light. Besides, it can understand when the light should be turned on. In addition, the voice, speech rate and many more features of this smart assistant can be customized.

If you still can't see what I've told you, I recommend you to watch this video:

The artificial intelligence project that identifies photos for the visually impaired from Instagram:

Instagram has recently released new features for visually impaired people to use the application more easily. With the new changes made, it will be easier for screen readers to describe photos.

These definitions, commonly known as "alt text", are actually frequently used on the internet. However, with this new update, these texts are also placed on Instagram. Within the scope of this update, users can also write their own descriptions on their photos for those who use screen readers. Thus, visually impaired people can consume content audibly while browsing the stream, explore page or profile.

If there is no definition in the content, Instagram can automatically identify the photo using photo recognition technology. Likewise, when someone scrolls the screen, they read aloud the auto-generated description of the photo. In the meantime, let's mention that the 'alt text' definitions will not be visible. Users who want to turn on this feature can enter their text in the advanced settings section before sharing their content.

The fact that the issue of accessibility for individuals with disabilities, which has long been talked about for technological initiatives, is brought to life by technology giants stands out as a really positive step.

REFERENCES:

Nurbuke TEKER

Artifical Intelligence Rhythms

NVIDIA’s Newest Graphics Card Revolutionizing

Blog

BARRIERS ARE BEING LIFTED WITH ARTIFICIAL INTELLIGENCE

Stay Informed!