Follow my Eye

Project by Thejasvi Magudilu Vijayaraj,Karthik Raghavan,Pramod Nataraja and Vishnu Venkataraman

Purpose

Detecting the position of eye using an algorithm developed using Open CV library and move a Robot according to the movement of the eyes.

Description

We have implemented eye detection using the Open CV library. To minimize the error in eye detection we are first detecting the face and then searching for the eye inside the face region. The eyes are detected using the features provided by the Haar cascades. The movement of the head of a person is detected by determining the difference between the center point of the rectangle that contains the eyes between successive frames. Depending upon the direction of motion of the head, suitable command is sent to the robot.The Mbed controller on receiving these commands sends it to the Xbee transmitter. The receiver Xbee module placed on the Robot receives these signals and sends it to the Mbed which controls the movement of the Robot's motors through an Dual H bridge IC.

/media/uploads/pramodnataraja/_scaled_mbed_controller.jpg

Figure 1: Mbed controller with Xbee Transmitter

/media/uploads/pramodnataraja/_scaled_mbed_robot.jpg

Figure 2: Mbed on the RObot along with Xbee receiver and H-Bridge drivers

/media/uploads/pramodnataraja/_scaled_screenshot.jpg

Figure 3: Screenshot of the eye detection and command window showing commands sent to the Mbed Controller

Demo

Equipment

LaptopMBed_ControllerXbee_TxXbeeRxMBed_RobotDual_H_BridgeMotorExternal Power Supply
USB portUSB port
3.3VVCC(1)
P10DOUT(2)
P9DIN(3)
P11RESET(5)
GNDGND(10)
VCC(1)3.3V
DOUT(2)P10
DIN(3)P9
RESET(5)P11
GND(10)GNDGND
+5VVCC
P22PWMA
P5AIN2
P6AIN1
+5VSTBY
P7BIN1
P8BIN2
P23PWMB
AO1Motor1+
AO2Motor1-
BO2Motor2+
BO1Motor2-
VINVMOT+6V
GNDGNDGND

Code

Import programMbed_Robot

Code for Mbed Receiver for the Follow My Eye Project

Import programMbed_Controller

Controller Code of Mbed for Follow My Eye Project

Import programEye_Detection

Eye Detection Using Open CV(Should be run on a system with Open CV library)

References

Below is the references of programs and libraries that the present project was based on

Possible Improvements

  • This project detects the eyes and not the eyeball itself. So the algorithm can be enhanced to detect eyeball movement.
  • The blink of an eye, point of focus of the eyes determination can also be done as an enhancement to this.


Please log in to post comments.