Someone has created a tool that makes captions for deaf people in real world conversations
Company develops an app that transcribes speech into text that follows the speaker.
Live-captioning technology is gaining ground, an exciting development for the hard of hearing.
Captions are a daily part of most people’s lives even if you don't always realize it. On social media, captions are sometimes automatically generated for videos or you can simply go into your settings to turn them on. These options are designed to be more inclusive, and people that are hard of hearing or deaf need them on videos to understand what's being said. The fact that they’re more widely available is great news.
One developer wanted to take captions a step further, into the real world. Captions on televisions or videos playing on your device's screen are great, but wouldn’t it be helpful to have the ability to turn them on while you’re having an actual conversation? A video posted online by Paul Mealy, product design leadership at Meta, shows a new augmented reality (AR) tool that could be a game changer for people who are deaf or hard of hearing. Augmented reality is something that people are accustomed to through video games like Halo, the first-person game that has a pop-up display showing information about the player's surroundings.
Like the video game, the real-time live-captioning technology uses augmented reality to display captions on top of the person speaking via wearables. The captions can even follow the speaker around and work in crowded spaces, focusing only on the identified speaker's voice. Mealy says the prototype uses directional microphones, where speech is recorded and converted to live text and attached to the person speaking via body tracking in AR. “One of the issues the deaf and hard of hearing have had to deal with during the pandemic is masks obscuring facial expressions, which often provide cues to what a person is saying," he says. "By utilizing captioning, we can help facilitate communication regardless of if the user's face is covered.” According to Mealy, the prototype runs on mobile platforms, but performs best on wearable computing devices such as Microsoft’s HaloLens and other hands-free wearable devices.
These augmented reality glasses help deaf people see live captions of people's speech \n\nBy @paul_mealy\n\n#techforgood #innovation #technology #AR #VR #augmentedreality\n\n@TechAmazing @sebbourguignon @Nicochan33 @KirkDBorne @mvollmer1 @pierrecappellipic.twitter.com/B74kejGIug— Pascal Bornet (@Pascal Bornet) 1647922692
The post showing Mealy testing out the prototype has been shared several times across social media, with Pascal Bornet, the chief data officer of Aera Technology, sharing it with his more than 40,000 Twitter followers. Comments on the posts are positive in nature and filled with excitement about the potential benefits. Several commenters said the technology is “amazing” while some had handy tips like allowing the user to make the text stationary instead of staying with the person. Another advised that the text be placed at the side of the screen with an arrow prompting the user to look toward the text. The excitement from the commenters can be felt through the screen.
It’s not clear from the post when this technology will be available commercially, but it’s clear that when it is available it will give deaf and hard of hearing people much more accommodations to navigate hearing spaces. If people could learn ASL throughout their school years as a standard education course as well as having access to this new technology, the world would be so much more accessible to deaf and hard of hearing people. It's wonderful that people like Mealy are working to do their part.
- The anthem was performed in ASL at the Super Bowl. Unfortunately ... ›
- Teen created an app to help deaf kids enjoy children's films - Upworthy ›
- CODA–the first movie to feature a deaf cast–wins Best Picture ... ›
Our mouths loves chips. Our bodies not so much.Photo by 
You can eat well without giving up sweets completely.Photo by 
12 non-threatening leadership strategies for women
We mustn't hurt a man's feelings.
Men and the feels.
Note: This an excerpt is from Sarah Cooper's book, How to Be Successful Without Hurting Men's Feelings.
In this fast-paced business world, female leaders need to make sure they're not perceived as pushy, aggressive, or competent.
One way to do that is to alter your leadership style to account for the fragile male ego.
Should men accept powerful women and not feel threatened by them? Yes. Is that asking too much?
IS IT?
Sorry, I didn't mean to get aggressive there. Anyhoo, here are twelve non-threatening leadership strategies for women.
Encourage.
With permission from Sarah Cooper.
When setting a deadline, ask your coworker what he thinks of doing something, instead of just asking him to get it done. This makes him feel less like you're telling him what to do and more like you care about his opinions.
Sharing ideas.
With permission from Sarah Cooper.
When sharing your ideas, overconfidence is a killer. You don't want your male coworkers to think you're getting all uppity. Instead, downplay your ideas as just "thinking out loud," "throwing something out there," or sharing something "dumb," "random," or "crazy."
Email requests.
With permission from Sarah Cooper.
Pepper your emails with exclamation marks and emojis so you don't come across as too clear or direct. Your lack of efficient communication will make you seem more approachable.
Idea sharing.
With permission from Sarah Cooper.
If a male coworker steals your idea in a meeting, thank him for it. Give him kudos for how he explained your idea so clearly. And let's face it, no one might've ever heard it if he hadn't repeated it.
Sexism.
With permission from Sarah Cooper.
When you hear a sexist comment, the awkward laugh is key. Practice your awkward laugh at home, with your friends and family, and in the mirror. Make sure you sound truly delighted even as your soul is dying inside.
Mansplain.
With permission from Sarah Cooper.
Men love explaining things. But when he's explaining something and you already know that, it might be tempting to say, "I already know that." Instead, have him explain it to you over and over again. It will make him feel useful and will give you some time to think about how to avoid him in the future.
Mistakes.
With permission from Sarah Cooper.
Pointing out a mistake is always risky so it's important to always apologize for noticing the mistake and then make sure that no one thinks you're too sure about it. People will appreciate your "hey what do I know?!" sensibilities.
Promotions.
With permission from Sarah Cooper.
Asking your manager for a promotion could make you seem power- hungry, opportunistic, and transparent. Instead, ask a male coworker to vouch for you. Have your coworker tell your manager you'd be great for the role even though you don't really want it. This will make you more likely to actually get that promotion.
Rude.
With permission from Sarah Cooper.
Sometimes not everyone is properly introduced at the start of a meeting. Don't take it personally even if it happens to you all the time, and certainly don't stop the meeting from moving forward to introduce yourself. Sending a quick note afterward is the best way to introduce yourself without seeming too self-important.
Interruptions.
With permission from Sarah Cooper.
When you get interrupted, you might be tempted to just continue talking or even ask if you can finish what you were saying. This is treacherous territory. Instead, simply stop talking. The path of least resistance is silence.
Collaboration.
With permission from Sarah Cooper.
When collaborating with a man, type using only one finger. Skill and speed are very off-putting.
Disagreements.
With permission from Sarah Cooper.
When all else fails, wear a mustache so everyone sees you as more man-like. This will cancel out any need to change your leadership style. In fact, you may even get a quick promotion!
In conclusion...
With permission from Sarah Cooper.
Many women have discovered the secret power of non-threatening leadership. We call it a "secret power" because no one else actually knows about it. We keep our power hidden within ourselves so that it doesn't frighten and intimidate others. That's what makes us the true unsung heroes of the corporate world.
About the Author: Sarah Cooper
Sarah Cooper is a writer, comedian, and author of 100 Tricks to Appear Smart in Meetings. Her new book, How to Be Successful Without Hurting Men's Feelings, is out now.
The comedic book cover.
With permission from Sarah Cooper.
A satirical take on what it's like to be a woman in the workplace, Cooper draws from her experience as a former executive in the world of tech (she's a former Googler and Yahooer). You can get the book here.
This article was originally published on March 25, 2019.