Speathe: An innovative and evolving communication method for the paralyzed who are gone speechless after paralysis and for those elderly persons who can't speak well and move well. Even if there are methods for the paralyzed Speathe lends a helping hand by converting one's breath into auditory sounds and transferable texts. I hope there will be great evolution of this code and I request all the enthusiasts to work upon this to make this an effective communication for our paralyzed and our old fellow beings.Hardware Components
Walabot will listen to the breath and classify it to short and long breaths. Raspberry will assign dots and dashes to short and long breaths respectively and appends them to form an alphabet. There are collections of 3 lettered acronyms which have predefined meanings to simplify the communication. Raspberry will determine the word speathe by user and assigns a value for a variable and posts the data to the server running in python. The mobile application is developed using react-native which sends continuous requests to the server seeking the value of the variable. Whenever a not null value is received mobile app displays it. We also provide extension for people to reply back to paralyzed by posting the text typed by user back to server and pronouncing it loudly to the paralyzed.Software Development
1. Setting up Walabot SDK and Programming using Python
If you don't have the Python IDE installed, Python3 is available at : https://www.python.org/downloads/
Once that's done, you can download the Walabot SDK for your OS. Detailed information about the Walabot Python API is available at : https://walabot.com/api/_pythonapi.html
Once you've installed the.deb file you can find various example programs written for both C++ and Python in the source directory. The example programs are also available on the Walabot API website. For this project, I would recommend going through the Breathing Example python program.2. Breath detection and letter matching
The ability of walabot to determine energy of breathing is used to determine long and short breaths. We'll take 10-15 successive loops and if in them the energy is considerably high than a threshold value then it is assigned to be long breath and if energy is lower than threshold it is a short breath. In that for these one time calibration may be needed for each person.
After detecting long and short breaths successive breaths and arranged in an array with '-' for long breaths and '.' for short breaths which may form a Morse code like ['-.-.-']. Specific Morse code patterns and predefined for letters and if breaths matches them that letter is pronounced.3. Letters, Words, Sentences, Feelings
We in the first version of Speathe, have developed three lettered acronyms for common phrases used in day to day life, so that the paralyzed will not speathe too much. If a three lettered acronym match is found the value of variable which is taken by mobile application is replaced with the corresponding phrase. Thus an effective communication is possible for those who are fully paralyzed.4. Server
The server is running on raspberry pi and is completely controlled by python. Flask module is used to run the server in Raspberry Pi 3. A static IP is set on Raspberry Pi and server is started on some port (say 80).
How to setStaticIP
sudo nano /etc/dhcpcd.conf at the command prompt.
2. Scroll to the bottom of the script, and add the following lines:
3. Save the file with
ctrl + o and then exit nano with
ctrl + x.
4. Reboot with
The mobile application is developed in react-native. React-native requests for the value at the same port of server. When a value is found it is displayed in the User Interface. And if user wants to return something back, react-native post the data to some variable in server and python code checking the value of that variable will pronounce it louder so that the paralyzed and hear and make a reply, if needed.
Speathe is not a mere communication for the paralyzed. Using Speathe we are trying to build a wheelchair for the elderly and paralyzed. The elderly who can't speak well and who can't move well can consider this as a primary mode of movement.
For that we need a wheelchair equipped with motors. The wheelchair is a smart wheelchair with Raspberry Pi as the brain. The wheelchair can move according to the preset keywords flawlessly and can go to a specific predefined location.
The walabot connected with the smart wheelchair can translate the breathe into those predefined keywords and the wheelchair can move according to the given instructions.