An article in the November 2008 issue of IEEE Spectrum Online describes how Guitar Hero is being used to help "train" artificial arms for amputees. It's part of the Revolutionizing Prosthetics (RP) 2009 project, sponsored by the U.S. Defense Advanced Research Projects Agency (DARPA). One of the RP 2009 project's goals is that:

[i]n four years, DSO [the Defense Services Office] will deliver a prosthetic for clinical trials that has function almost identical to a natural limb in terms of motor control and dexterity, sensory feedback (including proprioception), weight, and environmental resilience. The four-year device will be directly controlled by neural signals.

The project has already pioneered a surgery whereby the nerves that used to control the amputee's arm are routed into the chest and affixed with electrodes. These electrodes "read" muscle activation signals (electromyography, or EMG)and translate them into movement for the artificial limb. So far, the procedure has enabled a prosthetic arm to move with six degrees of freedom, but getting fingers to move is much harder. As the IEEE article states:

To establish a clear link between mind and machine, the software that translates between EMG signals and the mechanical arm must be trained to understand what the different muscle signals mean. Pattern-recognition algorithms have to be trained by correlating input signal patterns (from muscle contractions) with the intended outputs (opening the mechanical index finger).

That's where Guitar Hero comes in.

After rewiring the game's controls for one-handed play and for using muscle contractions rather than button-presses for its control scheme, the researchers tested it with non-amputee volunteers. Then they brought it to Duke University and PhD candidate Jon Kuniholm, an Iraq veteran who lost his right hand. He also founded the Open Prosthetics Project, which aims to make open source prosthetic arm technology. The Applied Physics Laboratory at Johns Hopkins University, which designed the special interface for Guitar Hero, is working on making their prosthetic arm hardware and interface software open source.

(Via Kotaku)

Tera Kirk

Tera Kirk

Tera Kirk grew up in a small Nebraska town called Papillion. Although she has a nonverbal learning disability that affects her visual-spatial skills (among other things), she's always loved video games. Her first game system was a Commodore Vic-20, which her mom bought at a garage sale for $20. With this little computer Tera learned to write Mad Libs in BASIC, to play chess and to steal gold from Fort Knox.

But then a friend introduced her to the seedy underworld of the Mario brothers and she spent her saved-up birthday and Christmas money to buy a Nintendo Entertainment System (NES). Her mom didn't like the Nintendo at first, but The Legend of Zelda changed her mind. (When Tera got Zelda II: The Adventure of Link one Christmas, she suspected it was as much for her mother as for her).

Though she graduated from Agnes Scott College in 2002 and recently learned how to find the movie theater restroom by herself, Tera still loves video games. Far from being a brain-rotting waste of time, they've helped her practice spatial skills and discover new passions. Her love of games like Kid Icarus and The Battle of Olympus led to a degree in Classical Languages and Literatures. She thinks games have a place in discussions on disability and other cultural issues, and is excited to work with the like-minded staff at GameCritics.com.
Tera Kirk

Latest posts by Tera Kirk (see all)

Leave a Reply

2 Comments on "Guitar Hero helps calibrate prosthetic arms"

Notify of
avatar

Sort by:   newest | oldest
Dale Weir
Guest
Dale Weir
7 years 8 months ago

The last time I paid attention to advances in prosthetic limbs, it was very basic stuff: claw-like attachments that only allowed its user to grasp simple objects. I guess its like any technology, you turn your head for a moment and you have to play catch up on what you missed.

And yeah, like Brandon, I’m waiting for those Terminator-like limbs.

Brandon Erickson
Guest
Brandon Erickson
7 years 8 months ago

That’s some cool sounding technology. I just hope that they start making prosthetic arms that look like Terminator arms.

wpDiscuz