Play Rock Paper Scissors against your Raspberry Pi — powered by AI hand gesture recognition! Show your hand to the camera, and the AI detects your move in real time. It generates a random opponent choice and announces the result with sound effects. No coding required — everything is built with Grablo's visual drag-and-drop interface.
Why did we decide to make it?Rock Paper Scissors is one of the simplest games, yet building it with AI gesture recognition showcases the power of computer vision. We wanted to prove that you don't need to write a single line of code to create an interactive AI game.
What You'll Build- AI-powered hand gesture detection (Rock, Paper, Scissors)
- Random opponent move generation with animated images
- Win/Lose/Tie results with sound effects
- Live score tracking on a dashboard
- Download Grablo software on your Raspberry Pi from grablo.co/download
- Connect a camera and speaker to your Raspberry Pi
- Open Grablo web app at app.grablo.co
- Copy this project from the Grablo Gallery
- Connect to your Raspberry Pi and hit RUN
- Press Start on the dashboard and show your hand!
Create a dashboard with the following widgets to control the game and see results in real time:
- Camera Widget: Select your camera to display the live video feed
- Push Button Widget (×2): Create Start and Stop buttons to control the game
- Image Switch Widget (×2): Display the opponent's hand (rock/paper/scissors) and the round result (win/lose/tie) — each mapped to different images based on variable values
- Label Widget (×2): Show the current score and game status
Logic Controls
This project uses 3 Logics with a total of 7 Controls. Here's how each one works:
Control 1: Start CameraInitialize the camera when the project starts.
When the Start button is pressed, activate AI hand tracking and begin the game.
When the Stop button is pressed, stop AI analysis and reset the scores.
Continuously update the score display on the dashboard.
Reset the display and play the "Rock, Paper, Scissors, Shoot!" audio prompt.
Detect the player's hand gesture using AI Hand Tracking.
💡 Tip: Make sure your hand is well-lit and clearly visible. Hold your gesture steady for about 0.5 seconds for reliable detection.
Control 7: Calculate ResultRandomly pick the opponent's hand, determine the winner, update scores, and play the result sound.
That's It!
Your AI-powered Rock Paper Scissors game is ready to play. Connect your Raspberry Pi, hit RUN, and challenge the AI!
Expected Results
- The camera feed shows your hand in real time on the dashboard
- After the audio prompt, show your gesture — the AI captures it instantly
- The opponent's random choice appears as an animated image
- A sound effect plays for win, lose, or tie
- Scores update automatically — press Stop to reset and play again
Hardware SetupCamera Options
- Raspberry Pi Camera Module (CSI) — Best performance
- USB Camera — Plug and play
- 3.5mm Audio Jack — Direct connection
- USB Audio Adapter — For Pi models without 3.5mm jack
- Bluetooth Speaker — Wireless option
What's Next?
- Add more gestures (Lizard, Spock) for an extended game
- Display a win streak counter on the dashboard
- Add LED indicators that light up on win or lose
- Connect a servo motor to make a physical hand that shows the AI's choice
- Log game history to track your performance over time
Troubleshooting
Hand gesture not detecting:
- Ensure good lighting — avoid backlighting or shadows on your hand
- Hold each gesture (fist, open palm, peace sign) steadily for 1–2 seconds
- Make sure only one hand is visible to avoid confusion
No sound playing:
- Check that your speaker is properly connected
- On Raspberry Pi, set the correct audio output (3.5mm vs HDMI) in system settings
Camera feed not showing:
- For CSI cameras, ensure the ribbon cable is securely seated
- For USB cameras, try a different USB port
- Verify the camera is enabled in Raspberry Pi configuration
Resources & Support
- Website:grablo.co
- Web App:app.grablo.co
- Gallery Project:Rock Paper Scissors
- Documentation:doc.grablo.co
- Support Email: support@grablo.co






Comments