Hands-free Minecraft from Special Effect

Posted on July 21, 2017 by Karl O'Keeffe

Love it or hate it, the game of Minecraft has captured the imagination of over 100 million young, and not so young people. It is available on multiple platforms; mobile device (Pocket Edition), Raspberry Pi, Computer, Xbox or PlayStation and it looks and feels pretty much the same on all. For those of us old enough to remember, the blocky graphics will hold some level of nostalgia for the bygone 8 Bit days when mere blobs of colour and our imagination were enough to render Ghosts and Goblins vividly. This is almost certainly lost on the main cohort of Minecraft players however who would most probably be bored silly with the 2 dimensional repetitive and predictable video games of the 80’s and early 90’s. The reason Minecraft is such a success is that it has blended its retro styling with modern gameplay and a (mind bogglingly massive) open world where no two visits are the same and there is room for self-expression and creativity. This latter quality has lead it to become the first video game to be embraced by mainstream education, being used as a tool for teaching everything from history to health or empathy to economics. It is however the former quality, the modern gameplay, that we are here to talk about. Unlike the afore mentioned Ghosts and Goblins, Minecraft is played in a 3 dimensional world using either the first person perspective (you see through the characters eyes) or third person perspective (like a camera is hovering above and slightly behind the character). While undoubtedly offering a more immersive and realistic experience, this means controlling the character and playing the game is also much more complex and requires a high level of dexterity in both hands to be successful. For people without the required level of dexterity this means that not only is there a risk of social exclusion, being unable to participate in an activity so popular among their peers, but also the possibility of being excluded within an educational context.

Fortunately UK based charity Special Effect have recognised this need and are in the process doing something about it. Special Effect are a charity dedicated to enabling those with access difficulties play video games through custom access solutions. Since 2007 their interdisciplinary team of clinical and technical professionals (and of course gamers) have been responsible for a wide range of bespoke solutions based on individuals’ unique abilities and requirements. Take a look at this page for some more information on the work they do and to see what a life enhancing service they provide. The problem with this approach of course is reach, which is why their upcoming work on Minecraft is so exciting. Based on the Open Source eyegaze AAC/Computer Access solution Optikey by developer Julius Sweetland, Special Effect are in the final stages of developing an on-screen Minecraft keyboard that will work with low cost eye trackers like the Tobii Eye X and the Tracker 4C (€109 and €159 respectively).

The inventory keyboard

The main Minecraft on screen keyboard

Currently being called ‘Minekey’ this solution will allow Minecraft to be played using a pointing device like a mouse or joystick or even totally hands free using an eyegaze device or headmouse. The availability of this application will ensure that Minecraft it now accessible to many of those who have been previously excluded. Special Effect were kind enough to let us trial a beta version of the software and although I’m no Minecraft expert it seemed to work great. The finished software will offer a choice of onscreen controls, one with smaller buttons and more functionality for expert eyegaze users (pictured above) and a more simplified version with larger targets. Bill Donegan, Projects Manager with Special Effect told us they hope to have it completed and available to download for free by the end of the year. I’m sure this news that will excite many people out there who had written off Minecraft as something just not possible for them. Keep an eye on Special Effect or ATandMe for updates on its release.

FlipMouse – Powerful, open and low cost computer access solution

Posted on May 4, 2017 by Karl O'Keeffe

The FLipMouse (Finger- and Lip mouse) is a computer input device intended to offer an alternative for people with access difficulties that prevent them using a regular mouse, keyboard or touchscreen. It is designed and supported by the Assistive Technology group at the UAS Technikum Wien (Department of Embedded Systems) and funded by the City of Vienna (ToRaDes project and AsTeRICS Academy project). The device itself consists of a low force (requires minimal effort to operate) joystick that can be controlled with either the lips, finger or toe. The lips are probably the preferred access method as the FlipMouse also allows sip and puff input.

Sip and Puff is an access method which is not as common in Europe as it is in the US however it is an ideal way to increase the functionality of a joystick controlled by lip movement. See the above link to learn more about sip and puff but to give a brief explanation, it uses a sensor that monitors the air pressure coming from a tube. A threshold can be set (depending on the user’s ability) for high pressure (puff) and low pressure (sip). Once this threshold is passed it can act as an input signal like a mouse click, switch input or keyboard press among other things. The Flipmouse also has two jack inputs for standard ability switches as well as Infrared in (for learning commands) and out (for controlling TV or other environmental controls). All these features alone make the Flipmouse stand out against similar solutions however that’s not what makes the Flipmouse special.

Open Source

The Flipmouse is the first of a new kind of assistive technology (AT) solution, not because of what it does but because of how it’s made. It is completely Open Source which means that everything you need to make this solution for yourself is freely available. The source code for the GUI (Graphical User Interface) which is used to configure the device and the code for the microcontroller (TeensyLC), bill of materials listing all the components and design files for the enclosure are all available on their GitHub page. The quality of the documentation distinguishes it from previous Open Source AT devices. The IKEA style assembly guide clearly outlines the steps required to put the device together making the build not only as simple as some of the more advanced Lego kits available but also as enjoyable. That said, unlike Lego this project does require reasonable soldering skills and a steady hand, some parts are tricky enough to keep you interested. The process of constructing the device also gives much better insight into how it works which is something that will undoubtedly come in handy should you need to troubleshoot problems at a later date. Although as stated above Asterics Academy provide a list of all components a much better option in my opinion would be to purchase the construction kit which contains everything you need to build your own FlipMouse, right down to the glue for the laser cut enclosure, all neatly packed into a little box (pictured below). The kit costs €150 and all details are available from the FlipMouse page on the Asterics Academy site. Next week I will post some video demonstrations of the device and look at the GUI which allows you program the FlipMouse as a computer input device, accessible game controller or remote control.

I can’t overstate how important a development the FlipMouse could be to the future of Assistive Technology. Giving communities the ability to build and support complex AT solutions locally not only makes them more affordable but also strengthens the connection between those who have a greater requirement for technology in their daily life and those with the creativity, passion and in-depth knowledge of emerging technologies, the makers. Here’s hoping the FlipMouse is the first of many projects to take this approach.

2016 – Technology Trends and Assistive Technology (AT) Highlights

Posted on December 22, 2016 by Karl O'Keeffe

As we approach the end of 2016 it’s an appropriate time to look back and take stock of the year from an AT perspective. A lot happened in 2016, not all good. Socially, humanity seems to have regressed over the past year. Maybe this short term, inward looking protectionist sentiment has been brewing longer but 2016 brought the opportunity to express politically, you know the rest. While society steps and looks back technology continues to leap and bound forward and 2016 has seen massive progress in many areas but particularly areas associated with Artificial Intelligence (AI) and Smart Homes. This is the first in a series of posts examining some technology trends of 2016 and a look at how they affect the field of Assistive Technology. The links will become active as the posts are added. If I’m missing something please add it to the comments section.

Dawn of the Personal Digital Assistants

Game Accessibility

Inbuilt Accessibility – AT in mainstream technology

Software of the Year – The Grid 3

Open Source AT Hardware and Software

The Big Life Fix

So although 2016 is unlikely to be looked on kindly by future historians… you know why; it has been a great year for Assistive Technology, perhaps one of promise rather than realisation however. One major technology trend of 2016 missing from this series posts is Virtual (or Augmented) Reality. While VR was everywhere this year with products coming from Sony, Samsung, Oculus and Microsoft its usefulness beyond gaming is only beginning to be explored (particularly within Education).

So what are the goals for next year? Well harnessing some of these innovations in a way where they can be made accessible and usable by people with disabilities at an affordable price. If in 2017 we can start putting some of this tech into the hands of those who stand to benefit most from its use, then next year will be even better.

From LOMAK to MILO – Good ideas are never obsolete

Posted on May 19, 2016 by Karl O'Keeffe

One of the more dubious advantages of working in a long running Assistive Technology service is access to an ever growing supply of obsolete hardware. While much of it is worthless junk now considering the technological progress in the field over the last 10 years, there are some real gems to be rediscovered. These were innovative solutions of their time grounded in strong research and while being seemingly made obsolete by a newer technology actually still have much to offer. The LOMAK keyboard is certainly one of these and being possibly the only piece of AT on permanent display at New York’s Museum of Modern Art I’m obviously not alone in thinking this.

The LOMAK (Light Operated Mouse And Keyboard) was invented by New Zealander Mike Watling and first came on the market in 2005 after a number of years research. It allowed hands free computer access through the innovative use of a laser pointer and light sensitive keyboard and mouse controls. To make the light sensitive keyboard and mouse (I’ll call it an input device from here) Watling used an array or photoresistors, one for each keyboard, mouse action and setting. This amounted to a whopping 122 photoresistors and possibly the most electronically complex input device ever marketed. Although complex the idea behind the LOMAK is quite straight forward. Photoresistors change their resistance depending on the amount of light they are picking up. Once you figure out roughly how much shining a laser pen on the resistor changes its value you have a good idea of where to set your threshold. You can then use the photo-resistor as a straightforward momentary switch, like a keyboard key, that activates once the resistance goes above/below a certain threshold. If you are like me you will want to see inside this thing so here it is.. (Below), a thing of beauty I’m sure you’ll agree.

So why aren’t more people using LOMAK keyboards today? Well eye tracking technology was just starting to become a realistic possibility for AT users with devices like the Tobii P10 hitting the market. Eye tracking just made more sense for computer access, it allows a neater more mobile solution and it a more direct input method. What has given the whole concept behind the LOMAK a new lease of life is the availability of cheap user-friendly prototyping platforms like Arduino.
This was the basis of one of the project proposals we made available to the final year students of the BSc (Honours) Creative Media Technologies course in IADT. Over the last few years Enable Ireland AT service have worked with IADT lecturer Conor Brennan to provide students with a selection of project briefs that both fit with their learning and skills while also fulfilling a need that has been recognised through our work supporting AT users and professionals in the area. This particular brief was to create a MIDI interface based on the same concept as the LOMAK that would allow someone to perform and compose music using only head movements. There are solutions available that use eye tracking to achieve this, for example the fantastic EyeHarp and more recently Ruud van der Wel of My Breath My Music released his Eye Play Music software. However these solutions all require a computer, we wanted something that was more in keeping with current trends in mainstream electronic music which seems to be moving back to a more hardware based performance. Thankfully a particularly talented student by the name of Rudolf Triebel took on the challenge of designing and building what we are now calling the MILO (Musical Interface using Laser Operation) (previously called LOMI Light Operated MIDI Interface which I think is much better..:). Rudolf exceeded our expectations and created the prototype you can see in the (badly filmed, sorry) video below. He has also created a tutorial including wiring diagram, code and bill of materials and put it up on Instructables to allow the project to be replicated and improved by others.

If you would like to see and maybe have a go of the MILO prototype (in its spanking new laser cut enclosure) Conor Brennan of IADT will be showing and demonstrating it at the 25th EAN Conference which takes place in University College Dublin between Sunday 29th – Tuesday 31st May.
Keep an eye on electroat.com where I hope to add a few more detailed posts on building, modifying and increasing the functionality of Rudolf’s design. I will also look into the possibility of using the same concept for building a hands free video game controller.

Accessible Gaming & Playing Agario with your Eyes

Posted on January 6, 2016 by Karl O'Keeffe

We in Enable Ireland Assistive Technology Training Service have long recognised the importance of gaming to many young and not so young assistive technology users. It’s a difficult area for a number of reasons. Firstly games (and we are talking about video games here) are designed to be challenging, if they are too easy they’re not fun, however if too difficult the player will also lose interest. Successful games manage to get the balance just right. Of course when it comes to physical dexterity as well as other skills required for gaming (strategic, special awareness, timing) this often involves game designers taking a one size fits all approach which frequently doesn’t include people with physical, sensory or cognitive difficulties. There are two methods of getting around this which when taken together ensure a game can be accessed and enjoyed by a much broader range of people; difficulty levels (not a new concept) and accessibility features (sometimes called assists). Difficulty levels are self-explanatory and have been a feature of good games for decades. Accessibility features might include the ability to remap buttons (useful for one handed gamers), automate certain controls, subtitles, high contrast and magnification.

Another challenge faced when creating an alternative access solution to allow someone successfully play a video game is that you need to have a pretty good understanding of the activity, how to play the game. This is where we often have difficulty and I’d imaging other non-specialist services (general AT services rather than game accessibility specialist services like SpecialEffect or OneSwitch.org.uk ) also run into problems. We simply do not have the time required to familiarise ourselves with the games or keep up to date with new releases (which would allow us better match a person with an appropriate game for their range of ability). We try and compensate for this by enlisting the help of volunteers (often from Enable Irelands IT department with whom we share office space), interns and transition year students. It’s often the younger transition year students who bring us some of the best suggestions and last week was no exception. After we demonstrated some eyegaze technology to Patrick, a transition year student visiting from Ardscoil Ris, Dublin 9, he suggested we take a look at a browser based game called agar.io. I implore you, do not to click that link if you have work to get done today. This game is equal parts addictive and infuriating but in terms of playability and simplicity it’s also very accessible with simple controls and a clear objective. The idea is that using your mouse you control a little (at first) coloured circular blob, think of it as a cell and the aim of the game it to eat other little coloured cells and grow. The fun part is that other players from every corner of the globe are also controlling cells and growing, if they are bigger than you they move a little slower but can eat you! Apart from the mouse there are two other buttons, the spacebar allows you to split your cell (can be used as an aggressive or defensive strategy) and the “W” key allows you to shed some weight. We set up the game to be played with a Tobii EyeX (€119) and IRIS software (€99). IRIS allows you to emulate the mouse action with your eyes and set up two onscreen buttons (called interactors) that can also be activated using your gaze, the video below should make this clearer.

Big thanks to Patrick for suggesting we take a look at Agrio and helping us set it up for eyegaze control. I’ll leave the final words to him. “I found playing Agrio with gaze software really fun. I think you have just as much control with your eyes as with your mouse. If an interactor was placed in the corner of the screen to perform the function of the spacebar (splits the cell in half) it would be beneficial. I believe it would be a very entertaining game for people who can only control their eyes, not their arms.”

Accessible presents for Christmas

Posted on November 28, 2014 by Sean Loughran

Finding accessible toys may at first may seem a difficult task. However there are various options from toys that are switch adapted to toys that are accessible by the nature of their design. The following information has been prepared by Enable Ireland’s National Assistive Technology Service to show some of the options and resources that you might want to consider.

The toys shown are not necessarily recommendations but simply a selection of items which may be of interest, particularly at times such as Christmas and birthdays, when presents are high on the list of priorities.

Download Accessible Apps Games and Toys in pdf (1.4MByte)

Game Accessibility Guidelines

Posted on August 29, 2014 by Sean Loughran

Game Accessibility Guidelines is a web resource created to help developers create games which are more inclusive of disabled gamers. Although launched back in 2012 from the collaboration of a group of game developers, accessibility specialists and academics it has recently been awarded for promoting accessibility for persons with disabilities. The web resources invites constant feedback from gamers and developers in order to keep the guidelines inclusive and up-to-date.

An example of how to make games more inclusive is providing gamers with options such as a choice of difficulty level or being able to configure which button does what on your controller or providing support for assistive technologies such as switches and screen-readers.

Making games more inclusive is important. It can be a great contributor to the quality of life for a person with a disability as well as making economic sense within a growing industry.

http://gameaccessibilityguidelines.com/

Some useful resources around game accessibility can be found at

AbleGamers Foundation

Games Accessibility

OneSwitch.org

SpecialEffect

ATandMe

Read, learn and share how assistive technology can help

Category Archives: Gaming