+
Sign up for
The Upworthiest
Our top stories of the day delivered straight to your inbox.
Heroes

The world's biggest social network just found a brilliant way to be more accessible to blind users.

Someone in my Facebook feed recently uploaded a ... surprising picture with the caption, "I drove past this on the way home."

In the comments, a friend wrote, "Woah!" Another person, "lol."

There are so many ways to react to a photo! Image by Theus Falcão/Flickr.

Want to know what it was a picture of? If you're like most of Facebook's 1.5 billion users, I could just send you the link so you could see for yourself. But if you're blind or visually impaired, like 285 million people worldwide, well, tough luck.

People who can't see are often stuck reading contextual clues, asking for clarification, or just flat missing out altogether on these shared Facebook experiences.

But there's some good news.

Facebook's accessibility team is working on new artificial intelligence that would scan, analyze, and describe photos to users who need it.

The Internet can be a challenging place for people who are blind or visually impaired, but it's actually come a really long way.

Amanda Martins, a student in New York who's been blind since just before her first birthday, told Upworthy, "I can do most things on the Internet."

She credits screen readers like Apple's VoiceOver that can read text aloud to her. And accessibility best practices have really evolved to help web designers and content creators when it comes to writing descriptive captions for their images, which can also be read by these programs.

But the uncharted world of user-generated content on social media is a totally different story.

Screen readers are kind of like Braille for the Internet. Photo by rolanddme/Flickr.

We share practically our entire lives on Facebook. Whether it's baby pictures, wedding photos, or the always popular "alcoholic beverage held up against a sunsetting sky." But if you can't see, you can't interact with these moments, and rarely do the captions we write for our photos accurately describe them (though Amanda said she's super appreciative when they do).

That leaves those who are blind or visually impaired missing out on the connectivity that's supposed to be at the heart of Facebook.

Facebook's new "object recognition," while it can't describe whole images, will be able to identify and describe some of their key elements to a user.

Matt King, a Facebook engineer who is also blind, walked TechCrunch through how it might work:

King eventually scrolled to a friend's post that featured text and a photo. His friend, Anne, wrote, “Ready for picture day of first grade" accompanied with a photo. Thanks to the object recognition technology Facebook is prototyping, King heard: “This image may contain, colon, one or more people. Child." Without it, all King would've known was that Anne wrote, “Ready for picture day of first grade," and that she posted a photo — but nothing about what was in the photo. For another photo, the tool told him: “This image may contain colon nature, outdoor, cloud, foliage, grass, tree."

OK, it's not exactly Hemingway, but it's better than nothing.

Talking about this intriguing development, Amanda said, "No technology is ever going to enable me to 'see' pictures. And that's fine. I just want to be able to understand what a huge percentage of my news feed is. Even if all this technology can do is tell me that someone's uncaptioned photo is 'outside, child, bus,' I'll be able to intuit that it's a photo of a kid getting on a bus for school."

Facebook's tool might describe this as "outside, children, bus." Photo by woodleywonderworks/Flickr.

King put it like this: "This might not be 100 percent yet, but even if it's just halfway there, the level of engagement that's possible, the amount of enjoyment I can get — that's like going from zero percent to at least 50 percent of what you might get. That's a huge jump."

Facebook's accessibility team has a tough job, but they've done some great work so far.

The team, led by Jeff Wieland, is designed to "improve Facebook for people with disabilities, and ensure that our products cooperate with assistive technology."

They do a lot of their work inside an "Empathy Lab," an environment that allows engineers to emulate what it might be like to use Facebook with different impairments. That's led them to make some pretty cool improvements to the platform, like better integration with VoiceOver and built-in support for people posting about depression or self-harm.

They're not perfect, though. Amanda says she's constantly encountering new Facebook features that don't work with VoiceOver, though she also says Facebook is usually pretty good about getting those issues fixed.

According to TechCrunch, Facebook hopes to release object identification by the end of the year on either their mobile or web platform.

Oh, and the picture my Facebook acquaintance put up? It was of some police trying to keep a cow from crossing the highway. But it could have just as easily been something much more memorable, like a baby's first steps or a friend proudly standing in front of her newly purchased home.

As for the fact that soon no one will have to miss out on things like that because they can't see? There's only one thing left to say:

Photo by Sean MacEntee/Flickr.

Family

Dad and daughter relationships, as explained by 10 paintings.

The amazing bond between dads and daughters.

All illustrations are provided by Soosh and used with permission.

I have plenty of space.

This article originally appeared on 04.09.16


It's hard to truly describe the amazing bond between dads and their daughters.

Being a dad is an amazing job no matter the gender of the tiny humans we're raising. But there's something unique about the bond between fathers and daughters.

Most dads know what it's like to struggle with braiding hair, but we also know that bonding time provides immense value to our daughters. In fact, studies have shown that women with actively involved fathers are more confident and more successful in school and business.

Keep ReadingShow less
Nature

Pennsylvania home is the entrance to a cave that’s been closed for 70 years

You can only access the cave from the basement of the home and it’s open for business.

Brian Marble/Facebook

This Pennsylvania home is the entrance to a cave.

Have you ever seen something in a movie or online and thought, "That's totally fake," only to find out it's absolutely a real thing? That's sort of how this house in Pennsylvania comes across. It just seems too fantastical to be real, and yet somehow it actually exists.

The home sits between Greencastle and Mercersburg, Pennsylvania, and houses a pretty unique public secret. There's a cave in the basement. Not a man cave or a basement that makes you feel like you're in a cave, but an actual cave that you can't get to unless you go through the house.

Turns out the cave was discovered in the 1830s on the land of John Coffey, according to Uncovering PA, but the story of how it was found is unclear. People would climb down into the cave to explore occasionally until the land was leased about 100 years later and a small structure was built over the cave opening.

Keep ReadingShow less
black-coffey cavern
Family

Two couples move in together with their kids to create one big, loving 'polyfamory'

They are using their unique family arrangement to help people better understand polyamory.

Instagram/Polyfamory

The Hartless and Rodgers families post together


Polyamory, a lifestyle where people have multiple romantic or sexual partners, is more prevalent in America than most people think. According to a study published in Frontiers in Psychology, one in nine Americans have been in a polyamorous relationship, and one in six say they would like to try one.

However popular the idea is, polyamory is misunderstood by a large swath of the public and is often seen as deviant. However, those who practice it view polyamory as a healthy lifestyle with several benefits.

Taya Hartless, 28, and Alysia Rogers, 34, along with their husbands Sean, 46, and Tyler, 35, are in a polyamorous relationship and have no problem sharing their lifestyle with the public on social media. Even though they risk stigmatization for being open about their non-traditional relationships, they are sharing it with the world to make it a safer place for “poly” folks like themselves.

Keep ReadingShow less
relationships
Health

All hail the mocktail: Growing demand makes non-alcoholic socializing a lot more fun

Sober bars and events are growing in popularity with delicious, grown-up alternatives to alcohol.

Photo by Blake Wisz on Unsplash

Non-alcoholic drinks go way beyond club sodas and Shirley Temples.

For as long as there's been alcohol, there have been people who don't drink it. Some don't care for the taste, some don't like the buzz, some have religious prohibitions against it and some are recovering addicts who need to avoid it altogether.

Whatever reasons people have for not drinking, there's an unspoken attitude by some that they're missing out on a key part of social culture, especially when countless movies and TV shows portrays people winding down (or wooing one another) with wine and bonding over beers at bars. There's an air of camaraderie over sharing a cocktail or clinking champagne flutes together that's hard to capture with a basic Coke or sparkling water.

But what if you want that fun, social atmosphere without the alcohol? What if you want to go out and have fancy, alcohol-free drinks with your friends at night without being surrounded by drunk people? Where do you go for that?

Keep ReadingShow less
Family

Touching video shows a new father joyfully singing while cradling his baby in the NICU

Seeing the baby raise his little hand moved the father to tears.

@fritojohnson89/TikTok

Little Remington listening to his father sing.

An incredible moment captured between a father and his newborn son has brought viewers to tears.

The viral video shows Daniel Johnson singing the worship song “Hallelujah Here Below” by Elevation Worship as he cradles his preemie son, Remington Hayze, in the neonatal intensive care unit (NICU).

Miraculously, as soon as Johnson begins singing a chorus of “hallelujahs,” Remington’s tiny hand raises as though he were carried away by the music. Seeing this, Johnson is instantly overcome with emotion and can’t finish the song.

Keep ReadingShow less
joy
Family

Professional tidier Marie Kondo says she's 'kind of given up' after having three kids

Hearing Kondo say, 'My home is messy,' is sparking joy for moms everywhere.

Marie Kondo/YouTube

Marie Kondo playing with her daughters.

Marie Kondo's book, "The Life-Changing Art of Tidying Up," has repeatedly made huge waves around the world since it came out in 2010. From eliminating anything that didn't "spark joy" from your house to folding clothes into tiny rectangles and storing them vertically, the KonMari method of maintaining an organized home hit the mark for millions of people. The success of her book even led to two Netflix series.

It also sparked backlash from parents who insisted that keeping a tidy home with children was not so simple. It's one thing to get rid of an old sweater that no longer brings you joy. It's entirely another to toss an old, empty cereal box that sparks zero joy for you, but that your 2-year-old is inexplicably attached to.

To be fair, Kondo never forced her way into anyone's home and made them organize it her way. But also to be fair, she didn't have kids when she wrote her best-selling book on keeping a tidy home. The reality is that keeping a home organized and tidy with children living in it is a whole other ballgame, as Kondo has discovered now that she has three kids of her own.

Keep ReadingShow less
marie kondo