+
upworthy

disability

Science

Man with muscular dystrophy shows how AI can be used for good with 'Project Gameface'

"Muscular dystrophy takes, and this actually added an ability. So it's the first time I've gained something in a physical sense."

Video game streamer Lance Carr using Project Gameface

Scientific discoveries and technological advancements have always been a double-edged sword. Nuclear fission gave us a powerful source of clean energy and as well as the most destructive weapons humanity has ever seen. The internet gave us unparalleled access to the entire library of human knowledge and also unparalleled exploitation and porn. Social media has connected people around the world in ways previous generations barely dreamed of and also resulted in a toxic online culture that threatens to shred the fabric of society.

Now, after several dozen movies imagining the best and worst-case scenarios, we're at that fork in the road with Artificial Intelligence. The sudden leap in AI tech hitting the mainstream has us all wondering what comes next. But for all the AI fear and uncertainty, there are some pretty incredible, humanity-boosting ways it is being used that may signal some hope for that future.


For instance, AI is allowing facial expressions to control computers. Case in point: a project inspired by quadriplegic video game streamer Lance Carr, whose rare form of muscular dystrophy only allows him to control his face and head movements. Carr had been using a head-tracking mouse (an expensive piece of accessibility equipment controlled by head movement) for gaming, but after his house caught fire during a livestream on Twitch in 2021, he lost everything.

"Video games are my link to the world," Carr explained in a video describing the project. "But I had to stop gaming because this house burnt down along with my adaptive equipment."

Carr got connected with some folks at Google to co-design Project Gameface, a fittingly-named tool that allows users to use facial movements as game controls. Linking several different AI models together, the project uses a mesh of 468 points on your face and converts them into telemetry to make mouse movements and clicks. For instance, raising your eyebrows can make the mouse drag or click and opening your mouth can move the cursor.

The best part is that since the project is open source and only requires a webcam for input, it will be widely accessible to people who want or need to use it. And for those who don't have full use of their limbs, it may be a game-changer as it has been for Carr.

"Muscular dystrophy takes, and this actually added an ability," he said. "So it's the first time I've gained something in a physical sense." He shared that the technology is so precise that he's able to write his name in cursive using only his face through a webcam.

Watch:

Though Google says it's still in development, they have made it available for preview through GitHub for people who want to give it a spin and help contribute to its improvement.

The potential dangers of AI may be making people nervous, but let's be sure not to throw the baby out with the bathwater. In the hands of people who are focused on helping humanity progress wisely and responsibly, AI can be a powerful, life-changing tool that makes people's lives better.

As Lance Carr said, "My hope is to definitely give this technology to everybody who could use it," the gamer added. "I just want to make a lot of people's lives better and easier."

Here's to those using ever-advancing technology for good.

When Cassandra J. Perry was 13, a physical disability prevented her from going to school.

She had a genetic connective tissue disorder called Ehlers-Danlos syndrome, which means that her joints are unstable, her connective tissue is weak, she’s more prone to injuries, and she has chronic pain.

When she began living alone as an adult after splitting up with her spouse, she worried about how she’d be able to grocery shop.


Her physical disabilities — Ehlers-Danlos syndrome, osteoarthritis, and pudendal neuralgia — had become more severe over time, making physical activity harder for her.

“Grocery shopping and food prep have become impossible on my own,” says Perry. “I can't always get to a store, and when I can, I can't carry my own groceries due to limitations on how much weight I'm allowed to hold and carry.”

Cassandra J. Perry. Photo by Louis Shackleton, used with permission.

Perry had to rely on the generosity of friends to get enough to eat.

With Supplemental Security Income (SSI) being her only source of financial support, she crowdfunded six times to have enough money to buy groceries.

She had a Patreon account for eight months. Two of her friends regularly helped her cook meals, and others invited her over for meals.

“To survive, I kept a strict budget, which I would share publicly each time I needed to crowdfund,” Perry explains. “I had to get over my pride and my fear of asking for help.”

She supplemented the crowdfunding and SSI income with money she made selling her belongings, such as clothing and books.

Perry knew this method of survival wasn’t sustainable, so she joined the Supplemental Nutrition Assistance Program in the spring of 2015.

Often known as "food stamps," this benefit gives her $192 each month, which covers half of her overall food costs.

“Without [it], I would only be able to meet my food needs by relying on the generosity of my social network, food pantries, and food kitchens," she says.

“Most days, I can't physically walk around a store, even if someone is doing the carrying for me,” she says. Her friends and family help by going to the store with her, and they do the shopping while she waits in the car. She then joins them in the checkout line to pay using her benefits.

Perry paying for groceries with her EBT card. Photo by Louis Shackleton, used with permission.

And thanks to local farmers markets,  that $192 a month extends even farther.

These local markets match up to an extra $30 for healthy items, allowing her to bring home more fresh produce.

Because she’s on food stamps, Perry also qualifies for community support agriculture, where subscribers receive a regular supply of produce and other farm goods, such as in-season fruits and vegetables, eggs, meat and milk.

Since unprocessed, fresh foods tend to be more costly, her benefits and the additional incentives to buy fruits and vegetables make a significant difference.

Perry says that food pantries and kitchens tend not to have the specific kinds of healthy foods her doctor recommends as part of her treatment. This makes the fact that her food stamps give her access to more fresh produce particularly invaluable. Perry can also use her benefits to buy prepackaged and prepared (cut, chopped, diced, or peeled) produce, which she can't get at food pantries and is easier for her since she has limited use of her hands.

Perry is grateful that she never has to make the choice between eating or paying rent.

Photo courtesy of Cassandra Perry.

“This provides me with a guarantee that I'll have food to eat because I won't have to choose between eating and paying bills,” she says. “Every last dollar I can muster is put to very good use.”

Because she is physically unable to work and lives on a limited budget, her benefits are a lifeline.

According to the 2015 National Health Interview Survey, 1 in 4 participants on food stamps have a disability that prevents them from working — just like Perry. That’s more than 11 million people. These benefits ensure they never have to make an impossible decision between going hungry or having a roof over their heads.

You can’t put a price on that kind of support.

If you could give yourself a superpower or a superhero-style gadget, what would it be?

I always say I'd want to be a shapeshifter or have a car that could shape-shift à la the Batmobile because I like pretending to be other things.

It's a fun question to ask friends because it gets everyone to think outside the box and have a good time being creative.


Now consider this: What if you could take those ideas and actually make them functional? (Who else's inner comic nerd just perked up?)

That's the idea behind Superhero Boost — a weeklong workshop where disabled kids get to create their own superpowers in the form of wearable devices.

One kid's light-up prosthetic. All photos by Autodesk/Blue Bergen, except where noted, used with permission.

The workshop was launched in 2014 by Kate Ganim and has since turned into an intensive series of workshops that help kids harness their inner designer and/or engineer.

"We aim to create a space for kids to celebrate the bodies that they're in and to re-think their disability as a super-ability," writes Ganim in an email.

However, she stresses that it's not about trying to "fix" these kids. Many of them were born without a limb or part of a limb; because those were never there in the first place, the kids don't feel like they're missing anything. Instead, it's about helping them create something cool and unique that they're proud to show off.

"Why does it have to be a hand, when it could be literally anything and it could do things that a natural hand isn't able to do?" asks Ganim.

What's more, the kids get to make their body modification using state-of-the-art technology like 3D modeling, robotics, and Google artificial intelligence technology — with the help of trained experts, of course.

Since 15-year-old Sydney's a competitive BMX rider, she updated her arm prosthetic so that it lights up to intimidate competitors.

Photo courtesy of Andrea Howard.

This was her second year doing the workshop, and since she's now quite proficient in 3D printing, she was asked to be a mentor as well as an inventor during the June Superhero Boost workshop in San Francisco.

"The thing that I like as a parent is that they want kids to think on their own and be themselves," says Audrey, Sydney's mom.

Sydney's currently ranked seventh in her state in her age group for BMX, and her handle bar was custom made to support her prosthetic, so she wanted to make it stand out in a major way. When she learned Google engineers were going to be at the workshop teaching kids how to incorporate AI, she knew that had to be part of her design.

Thanks to help from Google engineers and staff from both Superhero Boost and Autodesk, the company that held the workshop and offered up their plethora of tech tools, she got her modification to work by the end of the week.

"The [engineers] are like little kids," remarks Sydney. "It's quite fun. They get so excited."

Meanwhile, 16-year-old Kenzie created something entirely different — a robotic arm sleeve with a glowing gem that even Iron Man would envy.

Kenzie actually came up with the idea at a one-day workshop she did with Superhero Boost in Boston, near her hometown, but she really got to flesh it out during the most recent weeklong workshop in San Francisco.

While in the end, it wasn't totally what she'd envisioned, it still looked pretty darn cool.

"I was like, 'It's going to have to shoot something or do something,'" says Kenzie. "It ended up just lighting up. It did a thing — not a fantastic thing — but it did something."

She devised the whole modification on the computer in something called Tinkercad, a computer-aided design (CAD) program that allows you to 3D print your creations. Kenzie had to do some futzing with the voice control aspect of the project, which initially failed to function correctly, but eventually she and her engineer helper figured it out.

This experience is about much more than making awesome gadgets, though: It's also helping these kids see that they really can do anything they set their minds to with technology at their disposal.

Kenzie and Sydney working at the Superhero Boost workshop.

For example, Kenzie was blown away by a wheelchair booster that her friend Anaiss made — it literally lifts her wheelchair higher, which is not only super cool, but also legitimately useful.

These kids are also taking skills with them that will likely be instrumental in whatever career they end up choosing.

Kenzie, for one, is looking to go into toy design, and thanks to the workshop, she's already connecting the dots to that dream. "One lady at the end was talking about how she's going to be working on this augmented reality project, and that she wanted to work with me on that," she says.

What's more, everyone who participated gets to keep working with a professional designer on their prototypes to make them as cool as they can be.

But while all these tools are great, the real superpowers come from the kids themselves.

The kids from the most recent Superhero Boost workshop.

"By nature, these kids are incredibly creative and determined," writes Gamin. "They're having to adapt every day to an environment that was not designed for them, and it's on them to figure out how to adapt."

However, since the most formidable beings are the most adaptable, there's no doubt these kids are going to be unstoppable.

Fashion brand Chromat is bringing all the best poolside looks with its latest swimwear campaign.

Chromat is known for its inclusivity, and these ads are no different. The "Pool Rules" campaign includes models with disabilities sporting the brand's bold bathing suits.

A post shared by CHROMAT (@chromat) on


Mama Cax, a disability and body positivity advocate, is one of the featured models in the campaign.

Cax, who has a prosthetic leg, told Chromat she modeled in the campaign because she's "looking out for the babes with scars, for the babes with disabilities who often feel uncomfortable in these spaces."

A post shared by CHROMAT (@chromat) on

Cancer survivor and sexuality educator Ericka Hart also modeled for the campaign.

A post shared by CHROMAT (@chromat) on

The campaign, called "Pool Rules," comes with a set of 10 rules, such as "scars and stretch marks are welcome" and "all abilities accepted."

A post shared by CHROMAT (@chromat) on

You can check out the rest of Chromat's "Pool Rules" campaign here.

This story originally appeared on The Mighty and is reprinted here with permission.