Step 1: Continuation..
Step 2: Tools Needed
Step 3: How to Make the HUD
Step 4: OLED Display
Step 5: OLED and AR Display
Step 6: Hardware Interfacing with Ard-G
Step 7: Schematic
Step 8: Arduino Code
Step 9: Final test

Published May 3, 2016 © Apache-2.0

Arduino Glass - Open Source Augmented Reality Headset

A less than 10$ distraction-less, augmented reality development kit which allows you to experiment with both the software and hardware.

IntermediateFull instructions provided12 hours16,750

Arduino Glass - Open Source Augmented Reality Headset

Things used in this project

Hardware components

Arduino Nano R3

SparkFun Triple Axis Accelerometer Breakout - ADXL335

Onion Corporation OLED Expansion

Seeed Studio Grove starter kit plus for Intel Edison

OSH Park Custom fabricated PCB

HC-05 Bluetooth Module

Perma-Proto Breadboard Half Size

Buzzer

Software apps and online services

ATC lite

Hand tools and fabrication machines

Laser cutter (generic)

Soldering iron (generic)

Story

Have you ever considered getting an augmented reality headset? Were you also wowed at the possibility of augmented reality and looked at the price tag with a broken heart?

Yes, me too!

But that didn't stop me there. I built up my courage and instead decided to build my own AR headset.

I really felt that augmented reality market is niche and it needs an open market. Makers and developers are the market enablers.

But the problem is that their developer kits are expensive and costs over than $1000. So a normal maker or developer cannot afford it. So I am building this open source platform for augmented reality on both software and hardware so makers and developers can innovate together on it.

Step 1: Continuation...

Me testing the glass

The cost of building this development kit won't cost you more than $20 for a bare minimum design. Now that is where I realised that I need to understand the basic science on how an augmented reality headset works.

I watched a few hands-on demos of few headsets on YouTube and I understood the simple logic behind the display.

One of the uses of this device is to avoid accidents. Most accidents happen in the city due to the distraction caused by phone calls while riding. This could be developed as a device that helps in delivering message notifications and navigates users through the helmet, causing lesser distractions thereby making it a safe ride. Fitted with a GPS and accelerometer, both connected to the cloud, the geographical data collected helps in providing better terrain details for that the rider’s geographical location.

Step 2: Tools Needed

Parts needed:

Perf board

Arduino Nano

HC 05

SSD1306 OLED Display

Buzzer

Vibrator motor

Transparent plastic sheets

Berg pins female

Wires

Solder station

Scissors

Battery bank

Step 3: How to Make the HUD

1 / 5

How does an HUD work?

So how does the HUD work? High school physics tells you that light reflects on a mirror, refracts on a semitransparent mirror, and passes through a transparent glass. We will be using exactly that principle here.

How to make the HUD?

Cut the thick polythene sheet into 5 equal square-shaped pieces.

Arrange four pieces as a cube with OLED and glue it together.

Fix the light refractor by placing the sixth piece diagonally inside the cube.

Glue it such that one surface is facing the OLED display and the other is facing the side of your eye.

Finally fix the last piece and seal it.

Ta-da!! That is your HUD display. So simple!

Step 4: OLED Display

1 / 2

I used a Chinese OLED display that works on the SPI bus. It took me almost a day to figure out the data sheet. I found out that the u8lib library is needed to make it work.

Connect the SPI OLED Display to the SPI pin of the Arduino Nano. Now connect this OLED display with a long wire to fit near your eye for easy viewing. Download the library file and extract it into your Arduino library folder. Now uncomment the particular OLED driver in the program to enable your OLED display. Test with different modes in Library Example folder.

Step 5: OLED and AR Display

1 / 3

Test the OLED with the AR glass by using the sample code and adjust the display for better viewing experience.

The major problem with this AR display is that we are using a mirror to refract the rays, so the image to be displayed has to be inverted. This requires you to build a library with the inverted alphabet and bitmaps to display it properly.

There are many websites that convert bitmap into HEX code that can be used directly into the OLED library files.

You can use a small concave lens for better focal length.

Step 6: Hardware Interfacing with Ard-G

1 / 9

Now refer to the schematics here and solder it in a perf board.

It will be a bit tricky to solder if you are a NOOB in soldering. I would recommend that you use as many wires as possible to avoid any mistake while soldering.

Now cut the perf board into two pieces and make it look like an AR glass. Place some foam between the OLED and the perf board to ensure stability. You can also glue it together. Here I have made a bare bone shield for the Arduino Nano where any sensor or device can be interfaced.

I have connected the accelerometer, light sensor and sound sensor for sensor acquisition and can be used for user's application.

Step 7: Schematic

1 / 2

Step 8: Arduino Code

Click on the attachment to download the code.

For each function I am sending a number followed by “.” which acts as the end of data and cue to read the next data. It can configure in the ATC Lite Android App.

Check the in-line comment for better understanding of the code.

As for the Android app part, let me be honest. I am not an Android app developer so I haven't implemented the navigation control to it. I just downloaded the ATC lite app and created a custom layout like forward, backward, message and call notification to it. This sends numbers via Bluetooth to the headset.

C l i c k h e r e to download the app and test it.

Step 9: Final test

1 / 3

In the above image, you can see the HUD projecting the display to your eye gear.

Please do give me suggestions and your feedback after trying it out. I would love to hear from you. Feel free to comment below! Let’s talk!

Code

Arduino AR glasses

#include "U8glib.h"

U8GLIB_SSD1306_128X64 u8g(10, 9);		// HW SPI Com: CS = 10, A0 = 9 (Hardware Pins are  SCK = 13 and MOSI = 11)


void draw(void) { //Sensor function
  
  u8g.setFont(u8g_font_osb21);  // font type
  u8g.drawStr( 0, 22, "thgiL"); //Light inverted
   u8g.setPrintPos(0, 44);  //print position x,y
   int a = analogRead(A0); //analog read lght sensor
   a = map(a, 0 , 1024, 0 , 100);  /// light to percentage
   u8g.setPrintPos(14, 44);  // print in next line
   u8g.print((int)a);  u8g.print("%"); // Print %
   
   u8g.drawStr( 0, 66, "dnS"); //Sound sensor
      u8g.setPrintPos(0, 88);  // next line
    
   int b = analogRead(A1); // Read sensor
   b = map(b, 0 , 1024, 0 , 100);//sound to percentahe
    u8g.setPrintPos(14, 88);  // next line
   u8g.print((int)b);  u8g.print("%"); // print %
   digitalWrite(2, LOW);
digitalWrite(3, LOW);
  
}
void ace(void) {  //Accelerometer function
  // graphic commands to redraw the complete screen should be placed here  
 // u8g.setFont(u8g_font_unifont);
  u8g.setFont(u8g_font_osb21); // 
  u8g.drawStr( 0, 22, "x:"); //X: Print
   u8g.setPrintPos(0, 44); 
   int a = analogRead(A2); // read x
   a = map(a, 0 , 1024, -100 , 100); // scaling
   u8g.setPrintPos(20, 22);  // next line
   u8g.print((int)a); // print
   
   u8g.drawStr( 0, 44, "y:"); // y: print
      u8g.setPrintPos(0, 44); // 
   
   int b = analogRead(A3); // read y
   b = map(b, 0 , 1024, -100 , 100); // scaling
    u8g.setPrintPos(20, 44);  // Next line
   u8g.print((int)b);  // print y
   digitalWrite(2, LOW);
digitalWrite(3, LOW);
 u8g.drawStr( 0, 66, "z:"); // z: print
      u8g.setPrintPos(0, 66);
   
   int c = analogRead(A4); // read z
   c = map(b, 0 , 1024, -100 , 100); /// scaling
    u8g.setPrintPos(20, 66);  // next line
   u8g.print((int)c);   // print z
   digitalWrite(2, LOW);
digitalWrite(3, LOW);
  
}

void message(void) { // Message function
 u8g.setFont(u8g_font_unifont);
  u8g.drawStr( 0, 55, "========"); ///ASCII Message art
  u8g.drawStr( 0, 66, "|  __  |");
  u8g.drawStr( 0, 77, "|______|");  
  digitalWrite(2, LOW);
digitalWrite(3, LOW);
 
   
}
void left(void) { // left navi function
 
 u8g.setFont(u8g_font_osb21); // ASCII left arrow
  u8g.drawStr( 0, 55, " <<<");
  u8g.drawStr( 0, 66, "<");
  u8g.drawStr( 0, 77, " <<<");  
  digitalWrite(2, LOW);
digitalWrite(3, LOW);
  
}
void right(void) {
 
 u8g.setFont(u8g_font_osb21); // ASCII right arrow
  u8g.drawStr( 0, 55, " >>>");
  u8g.drawStr( 0, 66, "      >");
  u8g.drawStr( 0, 77, " >>>");  
  digitalWrite(2, LOW);
digitalWrite(3, LOW);
}
void up(void) {
 
 u8g.setFont(u8g_font_osb21); //ASCII UP arrow
  u8g.drawStr( 0, 55, "  ^^");
  u8g.drawStr( 0, 66, " ^^^^");
  u8g.drawStr( 0, 77, " ^^^^");  
  digitalWrite(2, LOW);
digitalWrite(3, LOW);
}
void vib(void) { // Vibrator
 
digitalWrite(2, HIGH);  // .5 sec buzz
  digitalWrite(3, LOW);
  delay(500);         
  digitalWrite(3, HIGH);
  digitalWrite(2, LOW);    // .5 sec vibb
  delay(500);
  digitalWrite(3, LOW);
}
void call(void) {
  
 u8g.setFont(u8g_font_unifont); //ASCII CAll 
  u8g.drawStr( 0, 55, "  ==}");
  u8g.drawStr( 0, 66, " ||");
  u8g.drawStr( 0, 77, " ||");  
  u8g.drawStr( 0, 88, "  ==}");  
  digitalWrite(2, LOW);
digitalWrite(3, LOW);
  
}
void lig(void) {
 
 
}


void setup(void) {
   Serial.begin(9600);
   pinMode(2, OUTPUT); // Buzzer pin
  pinMode(3, OUTPUT);  // Vibrator pin
 
   u8g.setRot90(); // flip screen
  
  // set SPI backup if required
  //u8g.setHardwareBackup(u8g_backup_avr_spi);

  // assign default color value
  if ( u8g.getMode() == U8G_MODE_R3G3B2 ) {
    u8g.setColorIndex(255);     // white
  }
  else if ( u8g.getMode() == U8G_MODE_GRAY2BIT ) {
    u8g.setColorIndex(3);         // max intensity
  }
  else if ( u8g.getMode() == U8G_MODE_BW ) {
    u8g.setColorIndex(1);         // pixel on
  }
  else if ( u8g.getMode() == U8G_MODE_HICOLOR ) {
    u8g.setHiColorByRGB(255,255,255);
  }
}

void loop(void) {

  while (Serial.available() > 0) { //HC05 pin 
  
    int red = Serial.parseInt(); // Read the integer
digitalWrite(2, LOW);
digitalWrite(3, LOW);
if (Serial.read() == '.') { // check for Next value 
  if(red==1) ////condition statement
  {
 
         u8g.firstPage();  
           do {
                 draw(); 
                 } while( u8g.nextPage() );
  
            delay(50); //delay for each display execution
  
  }

  else if(red==2)
  {
     u8g.firstPage();  
           do {
                 message(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
  else if(red ==3)
  {
     u8g.firstPage();  
           do {
                 left(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
    else if(red ==4)
  {
     u8g.firstPage();  
           do {
                 right(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
    else if(red ==5)
  {
     u8g.firstPage();  
           do {
                 up(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
    else if(red ==6)
  {
     
                 vib(); 
               
  }
    else if(red ==7)
  {
     u8g.firstPage();  
           do {
                 call(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
  else if(red ==8)
  {
     u8g.firstPage();  
           do {
                 lig(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
  else if(red ==9)
  {
     u8g.firstPage();  
           do {
                 ace(); 
                 } while( u8g.nextPage() );
  
            delay(50);
  }
  
  }
  }            

}

Credits

Arun Magesh

3 projects • 42 followers

hello.. hellooo i am arun. hardcore fan of electronics. it makes me happy. be with me and feel me.

Arduino Glass - Open Source Augmented Reality Headset