KEMBAR78
Wearable Computers and Accessibility | PPTX
Wearables and
Accessibility
EASI, Equal Access to Software and
Information
Ted Drake, Intuit Accessibility
@Ted_Drake
Wearable
Computers
Pacemakers
Pacemakers deliver small electric impulses to the
heart to regulate heart beat rhythm.
• Introduced in
1958
• Remote
monitoring
• Hackable
Obstacle Detection in 2004
iGlasses - 2010?
Google Glass, 2012
Wearable as Prototype
Cheaper and Faster
$40 Hack Kit
Acceptance and Ubiquity
Complexity in
the right place
Internet of Things
Brillo + Weave
Sensors
Vision
Hands Free
Google Soli
Piercings
Tongue
Drive
RFID implants
Hearing
Biometrics
Contact Lens Computer
iOS Health - Google Fit
Clothing
Project Jacquard
Navigate Jacket
Vibrating Shoes
Prosthetics
Myoelectric Prosthetics
Motion
Myo Gestures
Memory
Short Term
Memory Loss
Emotion Recognition
Text and Object Detection
Instant Captioning
Reading
OrCam Reader
Eye glass mounted
camera and bone
conducting
headphone.
Uses your finger as
the guiding gesture.
Force-Sensing
Switches
• Replace joysticks and
buttons with wearable
switches that detect
pressure change
• Embed within shoes
and gloves
Apple Watch
Apple + Google Pay
…as someone with low vision and
(mild) cerebral palsy, no longer do I
have to fumble around my wallet
trying to find my credit card or
struggle with swiping my card into
the terminal.
-Steven Aquino
Resources
•Ted Drake
• Twitter: @ted_drake
• Web: Last-Child.com
• SlideShare.net/7mary4
• WearAbility
• Twitter:@wearabilityorg
• Web: WearAbilty.org

Wearable Computers and Accessibility

Editor's Notes

  • #2 Wearable devices go beyond the watch and eye glasses. This presentation introduces the wide variety of devices and how they can make the world more accessible.  photo: DS18B20 temperature sensor by Sascha Grant on Flickr: https://www.flickr.com/photos/oflittleinterest/16361983862/
  • #3 photo: skin-pression by Clonny https://www.flickr.com/photos/clonpop/54765165/ Mobile computers have become indispensable, the logical extension is to move the computing, sensors, and output away from a singular object and explore other options on the body.
  • #4 http://en.wikipedia.org/wiki/Artificial_cardiac_pacemaker http://www.forbes.com/sites/singularity/2012/12/06/yes-you-can-hack-a-pacemaker-and-other-medical-devices-too/
  • #5 obstacle detection device from 2004 http://www.hitl.washington.edu/projects/wlva/ The prototype WLVA consists of three major components: a head mounted display (HMD), backpack mounted equipment, and software. The HMD incorporates the scanning fiber display and optics mounted in a tube on one side of a spectacle frame, and a video camera with IR light emitting diodes mounted on the other side. The backpack-mounted equipment consists of a laptop computer, an embedded processor, and hardware to drive the scanning fiber display.
  • #6 iGlasses have obstacle detection and vibrate when the user gets close to a low hanging branch or other object. http://ambutech.com/iglasses
  • #7 photo: Google Glass by Lubomir Panak https://www.flickr.com/photos/drakh/9896425204/ Google patent on eye frame based obstacle detection http://www.google.co.in/patents/US3654477
  • #8 At web4all 2015 conference there was a presentation on an application for improving stability with people that have parkinson’s. The project started with sensors mounted at the feet and hands as a proof of concept. Afterwards, the same functionality was recreated with just a phone’s built-in sensors.
  • #9 You can build your first wearable project for $40 via http://www.adafruit.com/products/1405
  • #10 Which of these kids is using an assistive technology device? Tablets, phones, and assorted mobile devices are so common that stigma associated with earlier devices has diminished. photo: student iPad school by Brad Flickinger https://www.flickr.com/photos/56155476@N08/6660001925/
  • #11 “What made the Rio and other devices so brain dead was that they were complicated. They had to do things like make playlists, because they weren’t integrated with the jukebox software on your computer. So by owning the iTunes software and the iPod device, that allowed us to make the computer and the device work together, and it allowed us to put the complexity in the right place.” -Steve Jobs photo: Seele der Musikindustrie by ken fager https://www.flickr.com/photos/kenfagerdotcom/4398922649/
  • #12 IPV6 allows every object to have its own ip address. Wearable devices can surround and work within your body and be uniquely defined. lamprey inspired nano-robots are being developed that can migrate through your body for healthcare. http://www.popsci.com/technology/article/2012-03/cyberplasm-micro-robot-modeled-after-sea-lamprey-could-swim-around-inside-you photo: pacific lamprey by USFWS Pacific https://www.flickr.com/photos/usfwspacific/7129322663/
  • #13 https://developers.google.com/brillo/ Google’s Brillo and Weave projects are defining a standard interface for the Internet of Things. This will make it much easier for a wearable to communicate directly with other smart objects, such as your smoke alarm sending a signal directly to a watch.
  • #14 Accuracy is increased when the sensor is attached to the body. For instance, a phone’s step counter is less accurate when the phone is in a backpack or purse.
  • #15 MIT’s Media Lab has been innovating the vision-based computers for many years. Eye-based wearables follow the head and the user’s point of interest. Eye tracking allows hands free. Sensors are at head level instead of floor level (cane) photo: http://cameraculture.media.mit.edu/
  • #16 Hands free control is what makes wearable accessibility devices mainstream. Handsfree control works for drivers, people carrying objects, provides alternative gesture support, and helps those with physical disabilities. http://www.usatoday.com/story/tech/2013/10/22/google-glass-aids-disabled/3006827/ photo: DJ Chameleon by Martin Fisch on Flickr https://www.flickr.com/photos/marfis75/1007645327/
  • #17 announced at Google IO, Soli is a handsfree gesture recognizer that uses radar instead of cameras. The latest prototype is tiny enough to fit within a watch or other wearable and allows people to control devices by moving fingers in the air. This solves the problem of small to no screen sizes. https://www.youtube.com/watch?v=0QNiZfSsPc0
  • #18 The tilt control function is available on gitHub to integrate with other applications. github.com/kaze0/tiltcontrol http://www.fastcompany.com/3027054/most-innovative-companies/look-ma-no-hands-tilt-control-brings-touchless-navigation-to-googl This is just one example of using Glass and other devices to control the user’s environment and computers without their hands. Watch for more work towards hands-free devices at https://www.facebook.com/googleglassaccessibility
  • #19 Tongue piercing as a switch device: http://www.washingtonpost.com/blogs/innovations/wp/2013/12/02/the-wheelchair-driven-by-a-tongue-piercing-cool-concept-faces-uphill-battle/ RFID implants could be used as an identification resource. http://www.forbes.com/sites/andygreenberg/2012/08/13/want-an-rfid-chip-implanted-into-your-hand-heres-what-the-diy-surgery-looks-like-video/ http://amal.net/
  • #20 Ear based devices are common, especially after years of bluetooth headphones. Ears provide same benefits of eye-based location. Biometric information, such as body temp, pulse are available hands-free, display-free interactions Japanese researchers and ear based computer http://phys.org/news/2014-03-japan-tiny-ear.html
  • #21 Dialog is just one example of using biometric sensors for health monitoring. This watch and patch detect seizures, user feedback, and emergency alerting. http://www.artefactgroup.com/content/work/dialog/ Biometric tracking has become a key feature of most wearables.
  • #22 Google and Sensimed (http://www.technologyreview.com/news/418247/glaucoma-test-in-a-contact-lens/) have been adding electronics to contact lenses to detect glaucoma and diabetes. Korean scientists are developing a soft contact lens with embedded diodes. http://www.technologyreview.com/news/515666/contact-lens-computer-like-google-glass-without-the-glasses/
  • #23 Apple, Google, and Microsoft have platforms that allow the user to synchronize their various health monitoring devices, diet tracking, and medical health records https://www.apple.com/ios/whats-new/health/ https://developers.google.com/fit/overview http://apps.microsoft.com/windows/en-us/app/healthvault/728f1c88-7e2f-4b40-95c1-74fc09983689
  • #24 clothing can be embedded with threads that transmit electronic signals. A connected shirt can track movement, bio metrics, and potentially gestures. This is great for health monitoring. http://www.omsignal.com/ Clothing can also be combined with sensory output, such as vibrations, to give the wearer feedback.
  • #25 Google and Levi’s are working together to develop a method to mass-produce cloth with embedded electronics. They’ve created the conductive threads and manufacturing process that allows the clothing to become the controller. https://www.google.com/atap/project-jacquard/
  • #26 This jacket gives vibrational feedback to let the user know if they should turn left or right while walking. http://wearableexperiments.com/navigate/
  • #27 Applying vibrations to the feet can provide enough stimulation to trigger a threshold within individuals with limited sense of touch. This could prevent falling. http://spectrum.ieee.org/tech-talk/biomedical/devices/vibrating-shoes-restore-balance-for-seniors http://spectrum.ieee.org/ns/pdfs/0405balaf1.pdf
  • #28 Prosthetics are no longer static extensions of the body. They contain multiple sensors, processors, and controllers. DARPA has been encouraging prosthetic and exoskeleton designs. http://science.howstuffworks.com/prosthetic-limb4.htm photo: Prosthetic Hand by Vern Hart https://www.flickr.com/photos/vernhart/1501901190/
  • #29 The bebionic hand has many microprocessors and motors that give it extreme versatility. It’s also programmable via a mobile phone. http://bebionic.com/
  • #30 Detecting the person’s motion for gesture recognition, detecting their tasks, understanding the difference between a sit up and a push up, hands-free Lars Asplund, Professor Emeritus in Robotics at MDH, is working on this hand-based device http://phys.org/news/2014-05-virtual-keyboard-reality-video.html#nRlv
  • #31 https://www.thalmic.com/myo/ primarily for basic gestures, i.e. presentations.
  • #32 smart watches could help those with memory loss via geolocation/geofencing, reminders, providing information to rescue http://www.alzheimers.org.uk/site/scripts/documents_info.php?documentID=109 photo: No, I’m sorry, I don’t know who you are by Neil Moralee https://www.flickr.com/photos/neilmoralee/8268874659/
  • #33 People with short term memory loss require reminders. The watch is a natural location for reminders. Motion and biometric sensors could also detect when an activity has been accomplished. This avoids reminding user to do an already completed task and encourages independence. shown watch: http://www.appsapk.com/calendar-reminder-smart-extras/
  • #34 Sension is working on facial and gesture recognition with Google Glass Facial Expressions Sension builds on the state of the art in face tracking to locate 76 landmarks in a user's face. Sension machine learns what it means to be engaged across the internal shape parameters of the face, giving us super accurate user engagement scores and analytical insights into the content users are interacting with in real-time http://www.sension.co/case
  • #35 WearScript from Open Shades uses Mechanical Turk and VizWiz to allow blind users to identify text and objects. http://www.openshades.com/ Text translation has also been integrated by Word Lens. http://questvisual.com/us/
  • #36 Captioning on Glass allows a person with a hearing impairment to see what another person is saying. This Georgia Tech project is available as open source. http://borg.cc.gatech.edu/ccg/?q=projects/cog Google also has a patent on speech to text transcription http://goo.gl/p9IEIq http://substance-en.etsmtl.ca/google-glass-instant-captioning-for-hearing-impaired/
  • #37 The finger reader project from MIT uses a finger based device to track the sentence a user is reading and convert to speech. It also guides the person to move up/down if they go off the line. http://fluid.media.mit.edu/projects/fingerreader This should be possible with an eye-based device.
  • #38 An intuitive portable device with a smart camera mounted on the frames of your eyeglasses, OrCam harnesses the power of Artificial Vision to assist the visually impaired. OrCam recognizes text and products, and speaks to you through a bone-conduction earpiece. http://www.orcam.com/
  • #39 http://technologylicensing.research.ufl.edu/technologies/13041_wearable-force-sensing-orthotic-device-enabling-disabled-persons-to-control-electronics http://apps.research.ufl.edu/otl/pdf/marketing/13041.pdf
  • #40 Apple watch released with full accessibility and an Accessibility API that closely matches iOS. Users can control the visual display for low vision. Android Watch is improving, but not to the same level. https://developer.apple.com/watchkit/ http://www.android.com/wear/
  • #41 Apple and Google Pay allows user to make payments with minimal movements Remote microphone for voice dictation, actions https://www.apple.com/apple-pay/
  • #42 http://www.imore.com/apple-pay-and-empowering-nature-inclusive-design
  • #43 http://www.brainyquote.com/quotes/keywords/glass.html#MkmtKupHAEVV7W3f.99 The opportunity exists for us to build devices that express our hidden selves, explore the world with new senses, and combine reactors and reactions. What could you solve with wearable computing?
  • #44 http://twitter.com/ted_drake http://last-child.com http://slideshare.net/7mary4 http://twitter.com/wearabilityorg http://wearability.org