Breaking Language Barriers with AI: Lenovo's Remarkable Innovation:
Lenovo's recent Tech World event witnessed a groundbreaking moment - the real-time translation of Libras, the official Brazilian Sign Language. The event featured a software developer named Gabriel warmly greeting Lenovo's chairman and CEO, Yuanqing Yang, using Libras. What makes this encounter extraordinary is that Yang, also known as YY at Lenovo, does not know Libras, yet the two communicated seamlessly - all thanks to the power of AI.
Revolutionizing Accessibility: This game-changing accessibility solution is poised to transform the lives of countless individuals, including the 2.3 million people in Brazil who are deaf or hard of hearing. "This scalable solution exemplifies the potential to create a new AI-powered paradigm for accessibility and inclusion," said Hildebrando Lima, Lenovo's director of research and development in Brazil. The technology opens doors to interactions where a sign language interpreter may be unavailable, making autonomy and connection more accessible in various settings, from retail spaces to hospitals.
The Role of Edge Servers: Behind the scenes at the Tech World stage, Lenovo's edge servers played a pivotal role in providing the computing power needed to run the AI and process the data from Gabriel's sign language. While cloud computing is a viable option, edge servers offer a distinct advantage in terms of speed and reliability, ensuring that AI operates precisely where it's needed.
The Journey of AI Development: While the demonstration at Tech World served as a proof of concept, the underlying technology is the result of four years of rigorous development. The project received significant contributions from dozens of deaf and hard of hearing individuals who use Libras. Their participation, involving thousands of hours of anonymized video data, proved invaluable in training the AI and advancing the technology.
A Vision for Inclusivity: Lenovo's journey in pioneering this technology began with an internal team discussion in 2019. A software developer proficient in Libras highlighted various accessibility challenges faced by the deaf community in their day-to-day lives. She called upon Lenovo to contribute to improving independence and enhancing the quality of life for this community. Lenovo accepted the challenge, driven by its commitment to delivering smarter technology for all.
Overcoming Data Challenges: Real-time video capture and translation of sign language is no small feat, given the complexity involved. Data challenges range from aspects like lighting, background colors, and clothing to the unique gestures and hand positions of individual signers. Lenovo collaborated with Brazilian innovation center CESAR to build a substantial dataset of Libras videos. This dataset became the foundation for the AI, allowing it to identify and contextualize individual gestures effectively.
AI at the Heart of the Solution: The AI developed by Lenovo recognizes hand positions and the digital articulation points of the signer's fingers. By processing these movements and gestures, the AI accurately identifies the flow of a sentence and rapidly converts sign language into text. The Lenovo team worked closely with the Product Diversity Office (PDO) to ensure the AI is inclusive and accommodates diverse attributes such as skin tone, hair style, corrective lenses, and limb differences.
Scaling for Impact: The next step is to scale the project beyond internal testing. As the user base and data sets expand, the team is exploring self-learning algorithms and other technology to accelerate development. Lenovo also envisions tailoring the translation solution to specific industry verticals, further optimizing the user experience.
A Future of Inclusive Technology: Beyond bridging communication gaps, this AI-driven solution has the potential to accelerate the learning of sign language, using computer vision to track the accuracy of gestures and provide guidance to users. The AI can be deployed via wearable tech or augmented reality, creating immersive learning experiences.
Lenovo's commitment to accessibility and inclusivity reflects its broader mission of delivering technology that empowers all individuals, regardless of their abilities. As the project evolves and inspires more inclusive technology, it holds the promise of transforming the lives of more than 430 million deaf and hard of hearing individuals worldwide.
Conclusion: Lenovo's innovative AI technology transcends language barriers, facilitating inclusive communication and access. The AI's ability to interpret sign language in real-time opens new horizons for countless individuals, particularly those in the deaf and hard of hearing community. By harnessing the power of AI, Lenovo showcases its commitment to making technology accessible and empowering, paving the way for a more inclusive future.
Please login to comment