Following an accident, Philippe lost the use of his hands. He now uses an electric wheelchair and still retains movement in his arms and forearms. Despite his condition, he maintains a positive spirit and a strong desire for exploration and creativity.
Philippe’s goal is to interact with a computer again — for tasks like 3D design, working, or even playing video games.
An initial prototype of a human-computer interface already exists, but it is fragile and unreliable. The interaction mechanisms it offers are limited and not yet well-developed.
❓ Problematic🔬 Does it exist already?💡 Our creative process🎯 Our objectives✅ Our results🪛 MaterialThe user operates the system using this custom Arduino code, which runs on an Adafruit ESP32 Feather board, compiled with the ESP32 core version 2.0.7 for Arduino. This setup leverages Bluetooth Low Energy (BLE) to emulate both a keyboard and a mouse, enabling full wireless interaction with a computer.
After uploading the code to the board, the user must manually pair the device via Bluetooth from the computer. The ESP32 will appear under the name configured in the code (e.g., "ESP32 Joystick Mouse"). Once paired, the system can be used to control the computer through joystick and button inputs — supporting mouse movement, various clicks, and keyboard commands, all in real time.
🧠 BibliographyAnd you need the librairy on Arduino and the code.
https://github.com/blackketter/ESP32-BLE-Combo



Comments