Wearable-Tech Glove Translates Sign Language Into Speech in Real Time
June 29, 2020 | UCLA NewsroomEstimated reading time: 2 minutes
UCLA bioengineers have designed a glove-like device that can translate American Sign Language into English speech in real time though a smartphone app. Their research is published in the journal Nature Electronics.
“Our hope is that this opens up an easy way for people who use sign language to communicate directly with non-signers without needing someone else to translate for them,” said Jun Chen, an assistant professor of bioengineering at the UCLA Samueli School of Engineering and the principal investigator on the research. “In addition, we hope it can help more people learn sign language themselves.”
The system includes a pair of gloves with thin, stretchable sensors that run the length of each of the five fingers. These sensors, made from electrically conducting yarns, pick up hand motions and finger placements that stand for individual letters, numbers, words and phrases.
The device then turns the finger movements into electrical signals, which are sent to a dollar-coin–sized circuit board worn on the wrist. The board transmits those signals wirelessly to a smartphone that translates them into spoken words at the rate of about a one word per second.
The researchers also added adhesive sensors to testers’ faces — in between their eyebrows and on one side of their mouths — to capture facial expressions that are a part of American Sign Language.
Previous wearable systems that offered translation from American Sign Language were limited by bulky and heavy device designs or were uncomfortable to wear, Chen said.
The device developed by the UCLA team is made from lightweight and inexpensive but long-lasting, stretchable polymers. The electronic sensors are also very flexible and inexpensive.
In testing the device, the researchers worked with four people who are deaf and use American Sign Language. The wearers repeated each hand gesture 15 times. A custom machine-learning algorithm turned these gestures into the letters, numbers and words they represented. The system recognized 660 signs, including each letter of the alphabet and numbers 0 through 9.
In addition to Chen, the study’s UCLA authors are co-lead author Zhihao Zhao, Kyle Chen, Songlin Zhang, Yihao Zhou and Weili Deng. All are members of Chen’s Wearable Bioelectronics Research Group at UCLA. The other corresponding author is Jin Yang, of China’s Chongqing University.
UCLA has filed for a patent on the technology. A commercial model based on this technology would require added vocabulary and an even faster translation time, Chen said.
Read the original article here.
Suggested Items
It’s Only Common Sense: Meet the New Young Guns in Sales
03/25/2024 | Dan Beaulieu -- Column: It's Only Common SenseI have been working quite a bit lately with younger people. These salespeople are literally two generations removed from my own demographic (and most of our industry’s demographic). Most of them are 30 years old or younger. I’d dare to call them “hotshots” because they are hungry, ambitious, and passionate, and they want to succeed.
Dan Beaulieu: It’s All About the Customer Experience
03/11/2024 | Nolan Johnson, PCB007Dan Beaulieu is an industry expert in sales and marketing who understands the unique dynamics of working in both B2B and B2C efforts. Through his work with companies across the electronics manufacturing industry, Dan advocates for businesses to always deliver a top-notch customer experience. Customer experience may not stop world wars—or might it? Read on to get a perspective that only Dan Beaulieu can deliver.
It’s Only Common Sense: Seeking the Possibility of Opportunity
03/11/2024 | Dan Beaulieu -- Column: It's Only Common SenseWe are often so immersed in what we are doing that we don’t have time to lift our heads and open our eyes to the possibility of opportunity. Why is this a problem? It’s because being open to opportunities is crucial for success in sales (as it is in all of business and in). Over the years, I have found there are several ways to take advantage of opportunities. The absolute best way is to always have an open mind. Here are some ways I do that.
Global Sourcing Spotlight: Global Sourcing is Good for Everyone
02/28/2024 | Bob Duke -- Column: Global Sourcing SpotlightIn business, as in life, it’s important to have an open mind. Take the people you work with at face value rather than what you are told by politicians and the media. It has always been amazing to me how easy it is to have resentment toward a people, as a country (or nationality) until you get up close and personal. Then it is not so easy. Dealing with people face to face, as human beings and fellow citizens of the world, where you get to see them as they are, is so much better and more productive. All business is people dealing with people. If we can keep it at that level, the world will become a much better place.
The Right Approach: Culture Change is Key to a QMS
02/26/2024 | Steve Williams -- Column: The Right ApproachWhy is organizational change needed? Because in America, people tend to accept that a certain amount of error is normal. You expect the plane to be late. You expect the mail to be undelivered. You expect consumer electronics and products to break down. This translates to our manufacturing operations as well.