The world's biggest social network just found a brilliant way to be more accessible to blind users.

Someone in my Facebook feed recently uploaded a ... surprising picture with the caption, "I drove past this on the way home."

In the comments, a friend wrote, "Woah!" Another person, "lol."


There are so many ways to react to a photo! Image by Theus Falcão/Flickr.

Want to know what it was a picture of? If you're like most of Facebook's 1.5 billion users, I could just send you the link so you could see for yourself. But if you're blind or visually impaired, like 285 million people worldwide, well, tough luck.

People who can't see are often stuck reading contextual clues, asking for clarification, or just flat missing out altogether on these shared Facebook experiences.

But there's some good news.

Facebook's accessibility team is working on new artificial intelligence that would scan, analyze, and describe photos to users who need it.

The Internet can be a challenging place for people who are blind or visually impaired, but it's actually come a really long way.

Amanda Martins, a student in New York who's been blind since just before her first birthday, told Upworthy, "I can do most things on the Internet."

She credits screen readers like Apple's VoiceOver that can read text aloud to her. And accessibility best practices have really evolved to help web designers and content creators when it comes to writing descriptive captions for their images, which can also be read by these programs.

But the uncharted world of user-generated content on social media is a totally different story.

Screen readers are kind of like Braille for the Internet. Photo by rolanddme/Flickr.

We share practically our entire lives on Facebook. Whether it's baby pictures, wedding photos, or the always popular "alcoholic beverage held up against a sunsetting sky." But if you can't see, you can't interact with these moments, and rarely do the captions we write for our photos accurately describe them (though Amanda said she's super appreciative when they do).

That leaves those who are blind or visually impaired missing out on the connectivity that's supposed to be at the heart of Facebook.

Facebook's new "object recognition," while it can't describe whole images, will be able to identify and describe some of their key elements to a user.

Matt King, a Facebook engineer who is also blind, walked TechCrunch through how it might work:

King eventually scrolled to a friend's post that featured text and a photo. His friend, Anne, wrote, “Ready for picture day of first grade" accompanied with a photo. Thanks to the object recognition technology Facebook is prototyping, King heard: “This image may contain, colon, one or more people. Child." Without it, all King would've known was that Anne wrote, “Ready for picture day of first grade," and that she posted a photo — but nothing about what was in the photo. For another photo, the tool told him: “This image may contain colon nature, outdoor, cloud, foliage, grass, tree."

OK, it's not exactly Hemingway, but it's better than nothing.

Talking about this intriguing development, Amanda said, "No technology is ever going to enable me to 'see' pictures. And that's fine. I just want to be able to understand what a huge percentage of my news feed is. Even if all this technology can do is tell me that someone's uncaptioned photo is 'outside, child, bus,' I'll be able to intuit that it's a photo of a kid getting on a bus for school."

Facebook's tool might describe this as "outside, children, bus." Photo by woodleywonderworks/Flickr.

King put it like this: "This might not be 100 percent yet, but even if it's just halfway there, the level of engagement that's possible, the amount of enjoyment I can get — that's like going from zero percent to at least 50 percent of what you might get. That's a huge jump."

Facebook's accessibility team has a tough job, but they've done some great work so far.

The team, led by Jeff Wieland, is designed to "improve Facebook for people with disabilities, and ensure that our products cooperate with assistive technology."

They do a lot of their work inside an "Empathy Lab," an environment that allows engineers to emulate what it might be like to use Facebook with different impairments. That's led them to make some pretty cool improvements to the platform, like better integration with VoiceOver and built-in support for people posting about depression or self-harm.

They're not perfect, though. Amanda says she's constantly encountering new Facebook features that don't work with VoiceOver, though she also says Facebook is usually pretty good about getting those issues fixed.

According to TechCrunch, Facebook hopes to release object identification by the end of the year on either their mobile or web platform.

Oh, and the picture my Facebook acquaintance put up? It was of some police trying to keep a cow from crossing the highway. But it could have just as easily been something much more memorable, like a baby's first steps or a friend proudly standing in front of her newly purchased home.

As for the fact that soon no one will have to miss out on things like that because they can't see? There's only one thing left to say:

Photo by Sean MacEntee/Flickr.

President Biden/Twitter, Yamiche Alcindor/Twitter

In a year when the U.S. saw the largest protest movement in history in support of Black lives, when people of color have experienced disproportionate outcomes from the coronavirus pandemic, and when Black voters showed up in droves to flip two Senate seats in Georgia, Joe Biden entered the White House with a mandate to address the issue of racial equity in a meaningful way.

Not that it took any of those things to make racial issues in America real. White supremacy has undergirded laws, policies, and practices throughout our nation's history, and the ongoing impacts of that history are seen and felt widely by various racial and ethnic groups in America in various ways.

Today, President Biden spoke to these issues in straightforward language before signing four executive actions that aim to:

- promote fair housing policies to redress historical racial discrimination in federal housing and lending

- address criminal justice, starting by ending federal contracts with for-profit prisons

- strengthen nation-to-nation relationships with Native American tribes and Alaskan natives

- combat xenophobia against Asian-Americans and Pacific Islanders, which has skyrocketed during the pandemic

Keep Reading Show less
True

If the past year has taught us nothing else, it's that sending love out into the world through selfless acts of kindness can have a positive ripple effect on people and communities. People all over the United States seemed to have gotten the message — 71% of those surveyed by the World Giving Index helped a stranger in need in 2020. A nonprofit survey found 90% helped others by running errands, calling, texting and sending care packages. Many people needed a boost last year in one way or another and obliging good neighbors heeded the call over and over again — and continue to make a positive impact through their actions in this new year.

Upworthy and P&G Good Everyday wanted to help keep kindness going strong, so they partnered up to create the Lead with Love Fund. The fund awards do-gooders in communities around the country with grants to help them continue on with their unique missions. Hundreds of nominations came pouring in and five winners were selected based on three criteria: the impact of action, uniqueness, and "Upworthy-ness" of their story.

Here's a look at the five winners:

Edith Ornelas, co-creator of Mariposas Collective in Memphis, Tenn.

Edith Ornelas has a deep-rooted connection to the asylum-seeking immigrant families she brings food and supplies to families in Memphis, Tenn. She was born in Jalisco, Mexico, and immigrated to the United States when she was 7 years old with her parents and sister. Edith grew up in Chicago, then moved to Memphis in 2016, where she quickly realized how few community programs existed for immigrants. Two years later, she helped create Mariposas Collective, which initially aimed to help families who had just been released from detention centers and were seeking asylum. The collective started out small but has since grown to approximately 400 volunteers.

Keep Reading Show less
True
Gates Foundation

Once upon a time, a scientist named Dr. Andrew Wakefield published in the medical journal The Lancet that he had discovered a link between autism and vaccines.

After years of controversy and making parents mistrust vaccines, along with collecting $674,000 from lawyers who would benefit from suing vaccine makers, it was discovered he had made the whole thing up. The Lancet publicly apologized and reported that further investigation led to the discovery that he had fabricated everything.

Keep Reading Show less
via TikTok

Menstrual taboos are as old as time and found across cultures. They've been used to separate women from men physically — menstrual huts are still a thing — and socially, by creating the perception that a natural bodily function is a sign of weakness.

Even in today's world women are deemed unfit for positions of power because some men actually believe they won't be able to handle stressful situations while mensurating.

"Menstruation is an opening for attack: a mark of shame, a sign of weakness, an argument to keep women out of positions of power,' Colin Schultz writes in Popular Science.

Keep Reading Show less