Team Visteli Labs: Irak Mayer, Stephanie Vicarte

Published April 28, 2019 © MIT

Smart Rider

Smart Rider allows the user to verify the identity of your ride before boarding the vehicle. Smart safety with IOTA.

IntermediateFull instructions providedOver 2 days1,746

Things used in this project

Hardware components

Adafruit HUZZA32 ESP32

Adafruit TFT FeatherWing - 2.4" 320x240 Touchscreen For All Feathers

Cellphone Samsung S7 Edge

Software apps and online services

JAVA

JavaScript

ESP32 IDF

C language

Arduino IDE

Story

Introduction

A Smart City requires to provide comfort, value, convenience and SAFETY to the people that lives and visits. It saddens us and worry me as a father when we heard the news about a South Carolina student that was killed when mistakenly ride a car pretending being a popular commercial taxi service. With so much smart devices now days, we thought there should be a way to confirm your ride before boarding it.

Smart Rider IOTA Schematic

The proposal prototype shows a system that sends a unique confirmation code to the device installed on the taxi service window that can be corroborate by your cell phone.

The project envelopes the request of the service, the authentication of ride identity, the payment of the service and the preserve of the user and driver riding history in a immutable transaction records.

This phase shows the first stage of an authentication of ride identity system based on the IOTA Tangle security and transactions on the transfer of a unique token.

HUZZA32 ESP32 and Feather wing ESP32 TFT

A Tangle of possibilities

IOTA is a DLT (Distributed Ledger Technology) that has taken momentum and buzz in the blockchain ecosystem. We were thrilled to see so much support for the technology and all the different libraries to support different platforms, from servers to IOT devices. We have to admit that it was complicated to surf our way in which platform to use and develop. The following are some of the projects we found and even though we did not use all of them, we were able to find a platform we could put together a small prototype much faster than using blockchain, Hyperledger Fabric, or Hedera Hashgraph.

JAVA

You can download a Java library based on IOTA from its github repository here. Compilation of the jar library was not straight forward, but we figure out after properly installing the mvn application, together with the Apache Maven.

The IOTA libraries have a client version programmed in C that can run on an ESP32 board. You can download the library here with a nice explanation on how to install here. In order to use this library you need the ESP32 Espressif make environment.

A complete step-by-step on how to install the environment is found here. The process although well explain take some time for the first time user (like us).

Arduino

There is an interesting article where they use a light version of IOTA wallet to support Arduino, you can find it here.

JavaScript

Recently, the IOTA organization release a workshop of samples that goes from the traditional Hello World to the more advance MAM system, you can download them here. These examples were actually the first ones that we were able to run successfully by following the instructions on the github page. The npmi command work like a charm and install all the dependencies and variables needed to run the examples. Kudos. However, when it come the time to program the interface, we were puzzle by our inexperience with the node package manager and to link a user interface libraries to the project.

QR codes on ESP32

We started by looking for libraries that could display a QR code on a Feather Wing TFT ESP32 display. We found the QR code libraries that supports ESP8266 with a Oled Driver for SSD1306.

We modified the library to support the ESP32 and the Adafruit FeatherWing TFT ILI9341. We also scale by 2 the QR code to have a better look at the code.

Here is where the interesting part start. We realize that the support for IOTA on Arduino was not gonna be easy to support. Then we decided to use the Espressif ESP32 IDF platform to develop since there is a C client library for IOTA. Check the Authentication Identity section for a detail explanation of the library.

Since we were to use the ESP32 IDF we needed a C library that could support the ILI9341 library. We then found the ESP32_TFT_Library based on the ESP32 make platform. After solving a couple of header files that were not in the path defined, we were able to compile the tft_demo program.

This will be the base for our AID device, once we can merge the C client library based on the Cmake platform with these library based on the make platform. Not an easy task.

Since we run out of time, we decided to use the Arduino QR code library in order to show a prototype of the AID device and later develop the application.

The modified library makes use of the Adafruit GFX library and the corresponding display ILI9341. Here is the header file that substitutes the display instance.

 #include <Adafruit_GFX.h>#include <Adafruit_ILI9341.h>class ESP32QRcode{ private:        Adafruit_ILI9341 *display; void render(int x, int y, int color); public:        ESP32QRcode(Adafruit_ILI9341 *display); void init(); void debug(); void screenwhite(); void create(String message);};

We also scale the QR code image by a factor of two by copying the surrounding neighbor pixels of the original code. Here is the code

 void ESP32QRcode::render(int x, int y, int color){  x=x+offsetsX;  y=y+offsetsY; if(color==1) {    display->drawPixel(x*2,y*2,ILI9341_BLACK);    display->drawPixel((x*2)+1,(y*2)+1,ILI9341_BLACK);    display->drawPixel((x*2),(y*2)+1,ILI9341_BLACK);    display->drawPixel((x*2)+1,(y*2),ILI9341_BLACK);  } else {    display->drawPixel(x*2,y*2,ILI9341_WHITE);  }}

The example to generate a QR code is as follows

 /* *********************************************************************************
* ESP8266 QRcode
* dependency library :
*   ESP8266 Oled Driver for SSD1306 display by Daniel Eichborn, Fabrice Weinberg
*
* SDA --> D6
* SCL --> D7
***********************************************************************************/
#include <SPI.h>
#include <Adafruit_GFX.h>
#include <Adafruit_ILI9341.h>
#include <esp32qrcode.h>
  #define STMPE_CS 32
  #define TFT_CS   15
  #define TFT_DC   33
  #define SD_CS    14
Adafruit_ILI9341 display = Adafruit_ILI9341(TFT_CS, TFT_DC);
ESP32QRcode qrcode (&display);
void setup() {
   Serial.begin(115200);
   Serial.println("");
   Serial.println("Starting...");
   display.begin();
   // Initialize QRcode display using library
   qrcode.init();
   // create qrcode
   qrcode.create("UNIQUECODEBLUE");
}
void loop() { }

We have provide the two files that updates the library to use the ILI9341 display.

We are currently working to port this code into the ESP32 IDF platform.

Smart Rider App

We developed a prototype on JAVA to simulate the last stage of the program as depicted on the above time chart. The user selects a passcode, the passcode is bundle on a transaction and send to the destination address that belongs to the Authentication Identity Device (AID) device.

The AID device receives the transaction and creates the QR code on the display. The user walks to the vehicle and scans the QR code. If the codes matches the application displays a green check mark icon, if the codes does not match a red icon displays and the user walks away from the vehicle.

1 / 3 • Load application

At this point we are assuming that the application received the drivers address once the request for ride was accepted.

The status window shows the first two lines, the result of the the message sent to the tangle. The third line thru shows the transactions that have being committed to the specific destination address.

The application calls the SendMessageTest class which creates the IOTA client.

    	iotaClient = new IotaAPI.Builder()
   	        .protocol("https")
   	        .host("nodes.devnet.thetangle.org")
   	        .port(443)
   	        .build();

Here we are creating an instance of an IOTA client that will connect to a public node. In this case the devnet tangle.

The we create the transaction

new Transfer(TEST_ADDRESS_WITH_CHECKSUM_SECURITY_LEVEL_2, 0, StringUtils.rightPad(TEST_MESSAGE, 2188, '9'), TEST_TAG)

We bundle it up and send it to the tangle.

 iotaClient.sendTransfer(TEST_SEED1, 2, DEPTH, MIN_WEIGHT_MAGNITUDE, transfers, null, null, false, false, tips);

Finally, we check the transactions submitted using the defined seed, and verify that the message was submitted and committed.

iotaClient.getTransfers(TEST_SEED1, 2, 0, 0, false); 
gtr.getTransfers();

You can see from the code that currently we have the destination address hard coded. This was done in order to proof the concept. A future version of the application will receive the the destination address by checking the acceptance transaction from the driver.

Authentication Identity Device

The Authentication Identity Device (AID) prototype is based on an Adafruit HUZZA32 ESP32board. The device will receive a transaction with the passcode to be converted into a QR code and display.

In order to read the QR code we are using an app for android in our phone to scan and display the QR code data. We use the QR Code Reader app which scans the code and displays the encoded message. At this point we verify that the message matches the one sent in the transaction.

1 / 3 • QR code generated

Conclusions.

The next step is to integrate all the platforms and to support 4G cell phone communication instead of WiFi.

We hope this can inspire on developing a more SAFETY support system.

Thank you for reading.

Code

package MyWinIOTA;


import java.awt.EventQueue;

import javax.swing.JFrame;
import org.iota.jota.dto.response.SendTransferResponse;
import org.iota.jota.error.ArgumentException;
import org.iota.jota.model.Transaction;
import org.iota.jota.model.Transfer;

import com.google.gson.Gson;

import javax.swing.JButton;
import javax.swing.JTextField;
import javax.swing.JLabel;
import java.awt.event.ActionListener;
import java.util.List;
import java.awt.event.ActionEvent;
import javax.swing.JOptionPane;
import javax.swing.JTextArea;

public class IOTAWindow {

	private JFrame frame;
	private JTextField passcodeTxt;
	private JTextArea statusField;

	public void prepareMessage() {
		SendTransferResponse retTransfer;
		String data;
		List<String> retResponse;
		
		SendMessageTest MyMessage = new SendMessageTest();
		
		MyMessage.createApiClientInstance();
		
		retTransfer = MyMessage.shouldSendMessage(passcodeTxt.getText());
		
		data = retTransfer.getTransactions().get(0).getSignatureFragments().substring(0, 20);
		data = data + " \n" + retTransfer.getTransactions().get(1).getSignatureFragments().substring(0, 20);
		statusField.setText(data);

		retResponse = MyMessage.shouldGetTransfers();
		
        for (String strData : retResponse) {
        	data = data +"\n" + strData.substring(0, 20);
        }
        statusField.setText(data);
        
        JOptionPane.showMessageDialog(frame, "Done");
		
	}
	/**
	 * Launch the application.
	 */
	public static void main(String[] args) {
		EventQueue.invokeLater(new Runnable() {
			public void run() {
				try {
					IOTAWindow window = new IOTAWindow();
					window.frame.setVisible(true);
					
					
				} catch (Exception e) {
					e.printStackTrace();
				}
			}
		});
	}

	/**
	 * Create the application.
	 */
	public IOTAWindow() {
		initialize();
	}

	/**
	 * Initialize the contents of the frame.
	 */
	private void initialize() {
		frame = new JFrame();
		frame.setBounds(100, 100, 450, 430);
		frame.setDefaultCloseOperation(JFrame.EXIT_ON_CLOSE);
		frame.getContentPane().setLayout(null);
		
		JButton btnSendPasscode = new JButton("Send Passcode");
		btnSendPasscode.addActionListener(new ActionListener() {
			public void actionPerformed(ActionEvent e) {
				prepareMessage();
				//JOptionPane.showMessageDialog(frame, "Button Pressed");
			}
		});
		btnSendPasscode.setBounds(128, 125, 157, 25);
		frame.getContentPane().add(btnSendPasscode);
		
		passcodeTxt = new JTextField();
		passcodeTxt.setBounds(58, 69, 333, 44);
		frame.getContentPane().add(passcodeTxt);
		passcodeTxt.setColumns(10);
		
		JLabel lblEnterPasscode = new JLabel("Enter passcode");
		lblEnterPasscode.setBounds(58, 42, 115, 15);
		frame.getContentPane().add(lblEnterPasscode);
		
		JLabel lblStatus = new JLabel("Status");
		lblStatus.setBounds(30, 173, 70, 15);
		frame.getContentPane().add(lblStatus);
		
		statusField = new JTextArea();
		statusField.setLineWrap(true);
		statusField.setWrapStyleWord(true);
		statusField.setEditable(false);
		statusField.setBounds(28, 200, 394, 172);
		frame.getContentPane().add(statusField);
		statusField.setColumns(10);
	}
}

package MyWinIOTA;


import java.util.ArrayList;
import java.util.List;

import org.apache.commons.lang3.StringUtils;
import org.iota.jota.IotaAPI;
import org.iota.jota.dto.response.GetTransferResponse;
import org.iota.jota.dto.response.SendTransferResponse;
import org.iota.jota.error.ArgumentException;
import org.iota.jota.model.Transaction;
import org.iota.jota.model.Transfer;
import com.google.gson.Gson;
import org.iota.jota.model.Bundle;


public class SendMessageTest {

    private static final String TEST_SEED1 = "IHDEENZYITYVYSPKAURUZAQKGVJEREFDJMYTANNXXGPZ9GJWTEOJJ9IPMXOGZNQLSNMFDSQOTZAEETUEA";
    private static final String TEST_ADDRESS_WITH_CHECKSUM_SECURITY_LEVEL_2 = "LXQHWNY9CQOHPNMKFJFIJHGEPAENAOVFRDIBF99PPHDTWJDCGHLYETXT9NPUVSNKT9XDTDYNJKJCPQMZCCOZVXMTXC";
    private static String TEST_MESSAGE = "JUSTANOTHERJOTATEST";
    private static final String TEST_TAG = "MYSPSPAM9999999999999999999";
    private static final int MIN_WEIGHT_MAGNITUDE = 14;
    private static final int DEPTH = 4;//9;

    private IotaAPI iotaClient;

    public void createApiClientInstance() {
    	iotaClient = new IotaAPI.Builder()
    	        .protocol("https")
    	        .host("nodes.devnet.thetangle.org")
    	        .port(443)
    	        .build();    	
    }

    public List<String> shouldGetTransfers() throws ArgumentException {
    	List<String> retData = new ArrayList<>();
    	int index=0;
    	
        GetTransferResponse gtr = iotaClient.getTransfers(TEST_SEED1, 2, 0, 0, false);
        gtr.getTransfers();

        for (Bundle test : gtr.getTransfers()) {
            for (Transaction trx : test.getTransactions()) {
            	retData.add(trx.getSignatureFragments());
                System.out.println(retData.get(index++));
            }
        }
        
        return retData;
    }
    public SendTransferResponse shouldSendMessage(String txtMessage) throws ArgumentException {
        List<Transfer> transfers = new ArrayList<>();
        List<Transaction> tips = new ArrayList<>();

        TEST_MESSAGE = txtMessage.replaceAll("\\s", "").toUpperCase();
        
        // for each 2187 trytes in a message one transfer is necessary
        transfers.add(new Transfer(TEST_ADDRESS_WITH_CHECKSUM_SECURITY_LEVEL_2, 0, StringUtils.rightPad(TEST_MESSAGE, 2188, '9'), TEST_TAG));

        SendTransferResponse str = iotaClient.sendTransfer(TEST_SEED1, 2, DEPTH, MIN_WEIGHT_MAGNITUDE, transfers, null, null, false, false, tips);
        str.getTransactions();
        str.getTransactions();
        str.getSuccessfully();
        
        return str;
    }
}

/* *********************************************************************************
 * ESP8266 QRcode
 * dependency library :
 *   ESP8266 Oled Driver for SSD1306 display by Daniel Eichborn, Fabrice Weinberg
 *
 * SDA --> D6
 * SCL --> D7
***********************************************************************************/

#include <SPI.h>
#include <Adafruit_GFX.h>
#include <Adafruit_ILI9341.h>

#include <esp32qrcode.h>

   #define STMPE_CS 32
   #define TFT_CS   15
   #define TFT_DC   33
   #define SD_CS    14

Adafruit_ILI9341 display = Adafruit_ILI9341(TFT_CS, TFT_DC);
ESP32QRcode qrcode (&display);

void setup() {

    Serial.begin(115200);
    Serial.println("");
    Serial.println("Starting...");

    display.begin();

    // Initialize QRcode display using library
    qrcode.init();
    // create qrcode
    qrcode.create("UNIQUECODEBLUE");

}

void loop() { }

#include <Arduino.h>
#include "esp32qrcode.h"
#include "qrencode.h"

int offsetsX = 42;
int offsetsY = 10;
int screenwidth = 320;
int screenheight = 240;
bool QRDEBUG = false;

ESP32QRcode::ESP32QRcode(Adafruit_ILI9341 *display){
	this->display = display;
}

void ESP32QRcode::init(){
	if(QRDEBUG)
		Serial.println("QRcode init");

  display->begin();
  //display->flipScreenVertically();
  display->fillScreen(ILI9341_BLACK);
}

void ESP32QRcode::debug(){
	QRDEBUG = true;
}

void ESP32QRcode::render(int x, int y, int color){
  x=x+offsetsX;
  y=y+offsetsY;
  if(color==1) {
    display->drawPixel(x*2,y*2,ILI9341_BLACK);
    display->drawPixel((x*2)+1,(y*2)+1,ILI9341_BLACK);
    display->drawPixel((x*2),(y*2)+1,ILI9341_BLACK);
    display->drawPixel((x*2)+1,(y*2),ILI9341_BLACK);
  }
  else {
    display->drawPixel(x*2,y*2,ILI9341_WHITE);
  }
}

void ESP32QRcode::screenwhite(){
  display->fillScreen(ILI9341_WHITE);
}

void ESP32QRcode::create(String message) {

  // create QR code
  message.toCharArray((char *)strinbuf,260);
  qrencode();
  screenwhite();

  if(QRDEBUG){
	Serial.println("QRcode render");
	Serial.println();
  }
  // print QR Code
  for (byte x = 0; x < WD; x+=2) {
    for (byte y = 0; y < WD; y++) {
      if ( QRBIT(x,y) &&  QRBIT((x+1),y)) {
        // black square on top of black square
        if(QRDEBUG)
			Serial.print("@");
        render(x, y, 1);
        render((x+1), y, 1);
      }
      if (!QRBIT(x,y) &&  QRBIT((x+1),y)) {
        // white square on top of black square
        if(QRDEBUG)
			Serial.print(" ");
        render(x, y, 0);
        render((x+1), y, 1);
      }
      if ( QRBIT(x,y) && !QRBIT((x+1),y)) {
        // black square on top of white square
        if(QRDEBUG)
			Serial.print("@");
        render(x, y, 1);
        render((x+1), y, 0);
      }
      if (!QRBIT(x,y) && !QRBIT((x+1),y)) {
        // white square on top of white square
        if(QRDEBUG)
			Serial.print(" ");
        render(x, y, 0);
        render((x+1), y, 0);
      }
    }
    Serial.println();
  }
  Serial.println();
  //display->display();
}

Credits

Irak Mayer

18 projects • 10 followers

Stephanie Vicarte

14 projects • 12 followers

Smart Rider

Things used in this project

Hardware components

Software apps and online services

Story

Introduction

A Tangle of possibilities

QR codes on ESP32

Smart Rider App

Authentication Identity Device

Conclusions.

Schematics

Smart Rider with IOTA

Code

IOTAWindow.java

SendMessageTest.java

QR code generator for arduino

esp32qrcode.cpp

esp32qrcode.h

Credits

Irak Mayer

Stephanie Vicarte

Comments

Embed the widget on your own site

Smart Rider

Smart Rider

Things used in this project

Hardware components

Software apps and online services

Story

Introduction

A Tangle of possibilities

QR codes on ESP32

Smart Rider App

Authentication Identity Device

Conclusions.

Schematics

Smart Rider with IOTA

Code

IOTAWindow.java

SendMessageTest.java

QR code generator for arduino

esp32qrcode.cpp

esp32qrcode.h

Credits

Irak Mayer

Stephanie Vicarte

Comments

Related channels and tags