The world's biggest social network just found a brilliant way to be more accessible to blind users.
Someone in my Facebook feed recently uploaded a ... surprising picture with the caption, "I drove past this on the way home."
In the comments, a friend wrote, "Woah!" Another person, "lol."
There are so many ways to react to a photo! Image by Theus Falcão/Flickr.
Want to know what it was a picture of? If you're like most of Facebook's 1.5 billion users, I could just send you the link so you could see for yourself. But if you're blind or visually impaired, like 285 million people worldwide, well, tough luck.
People who can't see are often stuck reading contextual clues, asking for clarification, or just flat missing out altogether on these shared Facebook experiences.
But there's some good news.
Facebook's accessibility team is working on new artificial intelligence that would scan, analyze, and describe photos to users who need it.
The Internet can be a challenging place for people who are blind or visually impaired, but it's actually come a really long way.
Amanda Martins, a student in New York who's been blind since just before her first birthday, told Upworthy, "I can do most things on the Internet."
She credits screen readers like Apple's VoiceOver that can read text aloud to her. And accessibility best practices have really evolved to help web designers and content creators when it comes to writing descriptive captions for their images, which can also be read by these programs.
But the uncharted world of user-generated content on social media is a totally different story.
Screen readers are kind of like Braille for the Internet. Photo by rolanddme/Flickr.
We share practically our entire lives on Facebook. Whether it's baby pictures, wedding photos, or the always popular "alcoholic beverage held up against a sunsetting sky." But if you can't see, you can't interact with these moments, and rarely do the captions we write for our photos accurately describe them (though Amanda said she's super appreciative when they do).
That leaves those who are blind or visually impaired missing out on the connectivity that's supposed to be at the heart of Facebook.
Facebook's new "object recognition," while it can't describe whole images, will be able to identify and describe some of their key elements to a user.
Matt King, a Facebook engineer who is also blind, walked TechCrunch through how it might work:
King eventually scrolled to a friend's post that featured text and a photo. His friend, Anne, wrote, “Ready for picture day of first grade" accompanied with a photo. Thanks to the object recognition technology Facebook is prototyping, King heard: “This image may contain, colon, one or more people. Child." Without it, all King would've known was that Anne wrote, “Ready for picture day of first grade," and that she posted a photo — but nothing about what was in the photo. For another photo, the tool told him: “This image may contain colon nature, outdoor, cloud, foliage, grass, tree."
OK, it's not exactly Hemingway, but it's better than nothing.
Talking about this intriguing development, Amanda said, "No technology is ever going to enable me to 'see' pictures. And that's fine. I just want to be able to understand what a huge percentage of my news feed is. Even if all this technology can do is tell me that someone's uncaptioned photo is 'outside, child, bus,' I'll be able to intuit that it's a photo of a kid getting on a bus for school."
Facebook's tool might describe this as "outside, children, bus." Photo by woodleywonderworks/Flickr.
King put it like this: "This might not be 100 percent yet, but even if it's just halfway there, the level of engagement that's possible, the amount of enjoyment I can get — that's like going from zero percent to at least 50 percent of what you might get. That's a huge jump."
Facebook's accessibility team has a tough job, but they've done some great work so far.
The team, led by Jeff Wieland, is designed to "improve Facebook for people with disabilities, and ensure that our products cooperate with assistive technology."
They do a lot of their work inside an "Empathy Lab," an environment that allows engineers to emulate what it might be like to use Facebook with different impairments. That's led them to make some pretty cool improvements to the platform, like better integration with VoiceOver and built-in support for people posting about depression or self-harm.
They're not perfect, though. Amanda says she's constantly encountering new Facebook features that don't work with VoiceOver, though she also says Facebook is usually pretty good about getting those issues fixed.
According to TechCrunch, Facebook hopes to release object identification by the end of the year on either their mobile or web platform.
Oh, and the picture my Facebook acquaintance put up? It was of some police trying to keep a cow from crossing the highway. But it could have just as easily been something much more memorable, like a baby's first steps or a friend proudly standing in front of her newly purchased home.
As for the fact that soon no one will have to miss out on things like that because they can't see? There's only one thing left to say:
Photo by Sean MacEntee/Flickr.
There's a reason why some people can perfectly copy accents, and others can't
Turns out, there's a neurodivergent link.
A woman in black long sleeve shirt stands in front of mirror.
Have you ever had that friend who goes on vacation for four days to London and comes back with a full-on Queen's English posh accent? "Oooh I left my brolly in the loo," they say, and you respond, "But you're from Colorado!" Well, there are reasons they (and many of us) do that, and usually it's on a pretty subconscious level.
It's called "accent mirroring," and it's actually quite common with people who are neurodivergent, particularly those with ADHD (Attention Deficit Hyperactivity Disorder). According Neurolaunch, the self-described "Free Mental Health Library," "Accent mirroring, also known as accent adaptation or phonetic convergence, is the tendency to unconsciously adopt the accent or speech patterns of those around us. This linguistic chameleon effect is not unique to individuals with ADHD, but it appears to be more pronounced and frequent in this population."
Essentially, when people have conversations, we're constantly "scanning" for information—not just the words we're absorbing, but the inflection and tone. "When we hear an accent, our brains automatically analyze and categorize the phonetic features, prosody, and intonation patterns," writes Neurolaunch. For most, this does result in copying the accent of the person with whom we're speaking. But those with ADHD might be more sensitive to auditory cues. This, "coupled with a reduced ability to filter out or inhibit the impulse to mimic…could potentially explain the increased tendency for accent mirroring."
While the article explains further research is needed, they distinctly state that, "Accent mirroring in individuals with ADHD often manifests as an unconscious mimicry of accents in social situations. This can range from subtle shifts in pronunciation to more noticeable changes in intonation and speech rhythm. For example, a person with ADHD might find themselves unconsciously adopting a Southern drawl when conversing with someone from Texas, even if they’ve never lived in the South themselves."
People are having their say online. On the subreddit r/ADHDWomen, a thread began: "Taking on accents is an ADHD thing?" The OP shares, "My whole life, I've picked up accents. I, myself, never noticed, but everyone around me would be like, 'Why are you talking like that??' It could be after I watched a show or movie with an accent or after I've traveled somewhere with a different accent than my 'normal.'
They continue, "Apparently, I pick it up fast, but it fades out slowly. Today... I'm scrolling Instagram, I watch a reel from a comedian couple (Darcy and Jeremy. IYKYK) about how Darcy (ADHD) picks up accents everywhere they go. It's called ADHD Mirroring??? And it's another way of masking."
(The OP is referring to Darcy Michaels and his husband Jeremy Baer, who are both touring comedians based in Canada.)
Hundreds of people on the Reddit thread alone seem to relate. One comments, "Omfg I've done this my whole life; I'll even pick up on the pauses/spaces when I'm talking to someone who is ESL—but English is my first language lol."
Sometimes, it can be a real issue for those around the chameleon. "I accidentally mimicked a waitress's weird laugh one time. As soon as she was out of earshot, my family started to reprimand me, but I was already like 'oh my god I don’t know why I did that, I feel so bad.'"
Many commenters on TikTok were shocked to find out this can be a sign of ADHD. One jokes, "Omg, yes, at a store the cashier was talking to me and she was French. She's like 'Oh are you French too? No, I'm not lol. I'm very east coast Canada."
And some people just embrace it and make it work for them. "I mirror their words or phrase! I’m 30. I realized I start calling everyone sweetie cause my manager does & I work at coffee shop."