Published November 5, 2019

Kids Project: Empathetic Panda ~Facial Imitation~

Let's make an empathetic panda imitating your facial expression!

BeginnerFull instructions provided449

Kids Project: Empathetic Panda ~Facial Imitation~

Things used in this project

Hardware components

Cambrian Robotics obniz

ServoMotor SG5010

Paper and Wires

Story

Introduction

It is more than happy to have a friend understanding and empathizing with my feeling! Here, we make a panda friend imitating our facial expressions, looking like he/she is empathizing with us! This can be also used as a toy for your kids!

Materials

obniz board
SG5010 servo motor (x2)
Paper and wires

Step 1

First, create an animal face like panda and use two motor to create its mouth.

Step 2

Connect two servo motors to an obniz. First one to signal-io0, vcc-io1 and gnd-io2; then second to signal-io9, vcc-io10, gnd-io11.

Program

It's using clmtrackr library to score smiling/sadness.

Run a program and frame in your face. Let's smile and sad face to move an animal.

Video

What is obniz?

obniz is a cloud-connected IoT development board. You can program on the web browser of any smartphone or computer and the command is sent to obniz through the internet via obniz cloud. By connecting the obniz to the cloud through wifi, users can remotely control devices that are physically connected to obniz.

obniz has 12 IO and WiFi-BLE module. It can be controlled through the APIs – REST or WebSocket API – on obniz cloud. Not only simple IO on/off but also UART, I2C, BLE etc can be used by remotely controlling obniz via internet. All you need to do to connect obniz is to input unique ID by scanning QR code. Complicated processes are done by obniz and its cloud. You can just start programming in HTML, browser and circuit have already been integrated. If you write a program to collect sensor values, you can make a chart of the values easily.

For more information, please visit our website! https://obniz.io/

You can find a varitety of projects made with obniz board! https://blog.obniz.io/example/

untitled_file-1.html

<html>
<head>
 <script src="https://obniz.io/js/jquery-3.2.1.min.js"></script>
 <script src="https://unpkg.com/obniz@1.8.2/obniz.js"></script>
 <script src="https://rawgit.com/auduno/clmtrackr/dev/build/clmtrackr.js"></script>
 <script src="https://rawgit.com/auduno/clmtrackr/dev/models/model_pca_20_svm.js"></script>
 <script src="https://rawgit.com/auduno/clmtrackr/dev/examples/js/emotion_classifier.js"></script>
 <script src="https://rawgit.com/auduno/clmtrackr/dev/examples/js/emotionmodel.js"></script>
</head>
<body>
 <div id="obniz-debug"></div>
 <video id="video" width="400" height="300" autoplay></video>
 <canvas id="canvas" width="400" height="300"></canvas> 
 <div id="print"></div>
<script>
var speaker;
var obniz = new Obniz("OBNIZ_ID_HERE")
var servoR;
var servoL;
obniz.onconnect = async () => {
servoR = obniz.wired("ServoMotor", {signal:0,vcc:1, gnd:2});
servoL = obniz.wired("ServoMotor", {signal:9,vcc:10, gnd:11});
//servoR.angle(90);
//servoL.angle(90);
await startEmotion()
}
async function startEmotion() {
 var video = document.getElementById("video");
 var canvas = document.getElementById("canvas");
 var context = canvas.getContext("2d");
 var stream = await navigator.mediaDevices.getUserMedia({
   video: {facingMode: "user"},
   audio: false
 });
 video.srcObject = stream;
 video.onloadedmetadata = function(e) {
   video.play();
 };
 var tracker = new clm.tracker();
 tracker.init(pModel);
 tracker.start(video);
 var classifier = new emotionClassifier();
 classifier.init(emotionModel);
 function drawLoop() {
   requestAnimationFrame(drawLoop);
   var positions = tracker.getCurrentPosition();
   var parameters = tracker.getCurrentParameters();
   var emotion = classifier.meanPredict(parameters);   
   context.clearRect(0, 0, canvas.width, canvas.height);
   tracker.draw(canvas);
   var emotions = {};
   for (var i=0; i<emotion.length; i++) {
     emotions[emotion[i].emotion] = emotion[i].value;
   }
   $("#print").html("sad: " + emotions.sad +"happy: " + emotions.happy)
   var angleR = 90;
   var angleL = 90;
   if(emotions.happy > emotions.sad){
     angleR = (emotions.happy) * (120 - 90) / (1 - 0) + 90;
     servoR.angle(angleR);
     angleL = ((emotions.happy) * (60 - 90) / (1 - 0) + 90);
     servoL.angle(angleL);
     console.log("happy");
   } else if (emotions.happy < emotions.sad){
     angleR = (emotions.sad) * (30 - 90) / (0.8 - 0) + 90;
     servoR.angle(angleR);
     angleL = ((emotions.sad) * (150 - 90) / (0.8 - 0) + 90);
     servoL.angle(angleL);
     console.log("sad");
   }
   console.log("R=" + angleR + "\nL=" + angleL);
 }
 drawLoop();
}
</script>
</body>
</html>

Credits

obniz developer team

80 projects • 36 followers

Development board "obniz" is controlled via the internet.

Kids Project: Empathetic Panda ~Facial Imitation~

Things used in this project

Hardware components

Story

Introduction

Materials

Step 1

Step 2

Program

Video

What is obniz?

Code

untitled_file-1.html

Credits

obniz developer team

Comments

Embed the widget on your own site

Kids Project: Empathetic Panda ~Facial Imitation~

Kids Project: Empathetic Panda ~Facial Imitation~

Things used in this project

Hardware components

Story

Introduction

Materials

Step 1

Step 2

Program

Video

What is obniz?

Code

untitled_file-1.html

Credits

obniz developer team

Comments

Related channels and tags