Software apps and online services
The HANDTALK glove needs to be worn on the hand by the disabled and depending on the variation of the movements, the device will convert it intelligently into beep (can be voice too) and in a text. This message will be out from the beeper and LCD display. The HANDTALK glove senses the movements through the flex sensors which detect the different patterns of motion. The device can sense carefully each resistance and each movement by the hand. Currently the device can convert only few, but depending on the success of this device few more additional features maybe added later onto this expressive system.
Technology has always been of great help to the disabled and given them a helping hand to allow them to live a normal and healthy life like others.
Embedded systems are designed to do some specific task, rather than be a general purpose computer for multiple tasks. “Embedded” reflects the fact that they are an integral part of the system. Some also have real time performance constraints that must be met, for reason such as safety and usability; others may have low or no performance requirements, allowing the system hardware to be simplified to reduce costs. An embedded system is not always a separate block- very often it is physically built-in to the device it is controlling.
Today, embedded systems are found in cell phones, digital cameras, camcorders, portable video games, calculators, and personal digital assistants, microwave ovens, answering machines, home security systems, washing machines, lighting systems, fax machines, copiers, printers etc.
An embedded system is a system that has software embedded into hardware, which makes a system dedicated for an application (s) or specific part of an application or product or part of a larger system. It processes a fixed set of pre-programmed instructions to control electro-mechanical equipment which may be part of an even larger system.
We are working on this project namely Hand talk: Interpreter for the Differently Abled that translates hand gestures into a particular message. Flex Sensors fixed with the glove pick up the gesture made by the individual and then with the help of Arduino, that analog input is converted into digital for various gestures. For every particular gesture there is specific digital output and that digital output for specific gesture is reserved for specific message. So, when the individuals do that particular gesture, the predefined message for that gesture is displayed on the LCD along with a beep (sound) and that specific message is also transmitted in the form of text or call with the help of GSM module to the various registered numbers.
For instance, if the patient perform a gesture of fist (most often we people form the fist in case of fear, emergency), there would be a message displayed on the LCD: “CRITICAL SITUATION” or “EMERGENCY” along with a beep and that particular message would also be transmitted in the form of text or call to the Doctor’s phone or the Relative’s one.
Not only can this but the particular needy person also use this glove to control the lights, fan, AC or any other devices, yes! We are talking about home automation by gestures i.e. controlling of devices smartly by various gestures.
The main advantage with this design was its simplicity and the cheap components and this project can help to improve greatly the communication barrier between disabled people and the regular world.
This Project has two parts :
1) Transmitter Section (Hand Glove)
2) Receiver Section (Display Module)
Transmitter Section :
This section is the main part of this project. It consists hand glove (fitted with Flex sensors and Heartbeat module) ,GSM module ,RF Transmitter and Arduino Uno as a Controller. All the gestures made by the hand glove (with Flex sensor ) is converted into different messages and commands for the operation of different devices .Example , if i want to start a fan then a command is send to the receiver end by the microcontroller with the help of RF module and the fan is easily controlled by the corresponding gestures. Now in case, i need water (or wheelchair or anything else) , all I need to do is to make a corresponding gesture accordingly and that gesture would be converted into text message and sent to the other person through the GSM module . Now using the Android app we can convert the text messages into voice also.
The Heartbeat module is used for the Heart rate monitoring of the patient .If there is any problem in heart rate then a message is also sent to the doctor or family members also.
In this project currently we are using seven gestures due to the problem of the accuracy but we can add about 100 plus gestures. Some examples of gestures are in shown in images.
This section is only for the display the message or the operation of different devices through the gesture. RF Receiver receives the command and this command is catch by the Arduino and Arduino controls the actions of this sections. In this part we are using fewer devices but you can also interface more devices. In this section LED bulb, motor and beeper is used for showing different action by the different gestures.
LCD (16x2) is used for the displaying the messages or requirement of the patients at different places .We can also place this section in the doctors chambers also.