School of Science and Technology 科技學院
Computing Programmes 電腦學系

Reuse Your Old Smartphone: Automatic Surveillance Camera Application iEye

Leung Pok Man

  
ProgrammeBachelor of Science with Honours in Internet Technology
SupervisorDr. Keith Lee
AreasSmart Living
Year of Completion2016
Award ReceivedIFIP Student Project Contest Merit Award

 

Objectives

The aim of this project is to utilize the camera and microphone of an old smartphone to keep our home under automatic surveillance in order to increase the utilization rate of old smartphone and keep home safe. This application focuses on real time streaming. It turns your old smartphone to home security cameras which captures the audio and video and send them to the server by Wi-Fi. This allows user to keep monitor the current home situation on another smartphone wherever you are. Besides, automatic surveillance is another important issue. This application will automatically detect abnormal activity at home such as stranger comings or goings from the door, brightness variations, objects motion, baby crying and falling of someone (elderly or children). The application will notify the user by email immediately when an abnormal activity is detected.

To achieve the aim, the project has defined a number of objectives as follows:

  • Develop a server-side automatic surveillance system to detect various abnormal activities at home.
  • Develop a notification system to notify the users when an abnormal activity is detected.
  • Develop a component for two-way talk between viewer and smartphone.
  • Evaluate if users can reuse an old smartphone and ensure their home safety after using this application.

Background and Methodology

Overview of Major Features or Components:

The purpose of video stream is to provide a stable channel to send a compressed video from over the Internet and display uncompressed video to viewer in real time. It plays an important role in this project since the video quality, stability and speed directly affect the performance of detection and the video watched by users. We use Nginx RTMP module and Node Media Client's SDK and library. Nginx provides RTMP streaming server to send real time video. Node Media Client provides encoder and decoder.

The purpose of motion detection is to detect changes or movement in a scene. Its role is one of the detector for automatic surveillance. The function is to draw a green rectangle around the motion. The size of rectangle depends on the area of motion as a larger motion is found and larger rectangle is drawn.

The purpose of motion detection is to detect changes or movement in a scene. Its role is one of the detector for automatic surveillance. The function is to draw a green rectangle around the motion. The size of rectangle depends on the area of motion as a larger motion is found and larger rectangle is drawn.

The purpose of human recognition is to detect and track multiple human as these moved in front of a camera. Its role is one of the detector for automatic surveillance. The function is to draw a yellow rectangle around a human.

The purpose of light detection is to provide brightness detail of your home. Its role is one of the detector for automatic surveillance. The function is to turn on the flashlight of smartphone in the dim environment automatically in order to ensure the surveillance work in any situation and time. Base on the brightness value and CCT index, we can determine whether the light is on or off at your home.

My solution is implemented with Java language. It utilizes OpenCV 2.4.5 and JavaCV 0.5. Before execution, it requires two Android smartphones (camera and viewer) and a server (notebook).

The purpose of user-defined abnormal event is to provide a platform for users to create their own detection event. Users can use our detectors to create any different detection event. Once the event is detected, users will be notified by an email and the video will be recorded automatically immediately.

Conclusion and Future Development

iEye provides various detection components, including motion detection, face recognition, human detection and light detection. Users can define their own abnormal events by the above detectors. If an abnormal event is detected, iEye will record the video and notify user by an email immediately. It is practically suitable for working parents, elderly lived alone and pet keepers, and gives a new life to old smartphones so as to reduce the e-waste.

As original design is the automatic surveillance at home, the usage is very narrow. In order to extend the usage and increase the market value, we would like to extend the application from home to office and nursing home. We will first collect the advice from the related people to understand their needs. Then, we will improve the current design and provide some related functions to meet their needs.

For the individual version, we will put the app iEye in the play store for free download. For the business version, we will invite the nursing home organization to try. During the first year, our target is not profit, but the feedback from user. It is important and useful to improve our application. After a year, we will provide different monthly plans for them in order to make profit.

Copyright Leung Pok Man and Keith Lee 2016

Jonathan Chiu
Marketing Director
3DP Technology Limited

Jonathan handles all external affairs include business development, patents write up and public relations. He is frequently interviewed by media and is considered a pioneer in 3D printing products.

Krutz Cheuk
Biomedical Engineer
Hong Kong Sanatorium & Hospital

After graduating from OUHK, Krutz obtained an M.Sc. in Engineering Management from CityU. He is now completing his second master degree, M.Sc. in Biomedical Engineering, at CUHK. Krutz has a wide range of working experience. He has been with Siemens, VTech, and PCCW.

Hugo Leung
Software and Hardware Engineer
Innovation Team Company Limited

Hugo Leung Wai-yin, who graduated from his four-year programme in 2015, won the Best Paper Award for his ‘intelligent pill-dispenser’ design at the Institute of Electrical and Electronics Engineering’s International Conference on Consumer Electronics – China 2015.

The pill-dispenser alerts patients via sound and LED flashes to pre-set dosage and time intervals. Unlike units currently on the market, Hugo’s design connects to any mobile phone globally. In explaining how it works, he said: ‘There are three layers in the portable pillbox. The lowest level is a controller with various devices which can be connected to mobile phones in remote locations. Patients are alerted by a sound alarm and flashes. Should they fail to follow their prescribed regime, data can be sent via SMS to relatives and friends for follow up.’ The pill-dispenser has four medicine slots, plus a back-up with a LED alert, topped by a 500ml water bottle. It took Hugo three months of research and coding to complete his design, but he feels it was worth all his time and effort.

Hugo’s public examination results were disappointing and he was at a loss about his future before enrolling at the OUHK, which he now realizes was a major turning point in his life. He is grateful for the OUHK’s learning environment, its industry links and the positive guidance and encouragement from his teachers. The University is now exploring the commercial potential of his design with a pharmaceutical company. He hopes that this will benefit the elderly and chronically ill, as well as the society at large.

Soon after completing his studies, Hugo joined an automation technology company as an assistant engineer. He is responsible for the design and development of automation devices. The target is to minimize human labor and increase the quality of products. He is developing products which are used in various sections, including healthcare, manufacturing and consumer electronics.

Course Code Title Credits
  COMP S321F Advanced Database and Data Warehousing 5
  COMP S333F Advanced Programming and AI Algorithms 5
  COMP S351F Software Project Management 5
  COMP S362F Concurrent and Network Programming 5
  COMP S363F Distributed Systems and Parallel Computing 5
  COMP S382F Data Mining and Analytics 5
  COMP S390F Creative Programming for Games 5
  COMP S492F Machine Learning 5
  ELEC S305F Computer Networking 5
  ELEC S348F IOT Security 5
  ELEC S371F Digital Forensics 5
  ELEC S431F Blockchain Technologies 5
  ELEC S425F Computer and Network Security 5
 Course CodeTitleCredits
 ELEC S201FBasic Electronics5
 IT S290FHuman Computer Interaction & User Experience Design5
 STAT S251FStatistical Data Analysis5
 Course CodeTitleCredits
 COMPS333FAdvanced Programming and AI Algorithms5
 COMPS362FConcurrent and Network Programming5
 COMPS363FDistributed Systems and Parallel Computing5
 COMPS380FWeb Applications: Design and Development5
 COMPS381FServer-side Technologies and Cloud Computing5
 COMPS382FData Mining and Analytics5
 COMPS390FCreative Programming for Games5
 COMPS413FApplication Design and Development for Mobile Devices5
 COMPS492FMachine Learning5
 ELECS305FComputer Networking5
 ELECS363FAdvanced Computer Design5
 ELECS425FComputer and Network Security5