School of Science and Technology 科技學院
Computing Programmes 電腦學系

VR REHEARSAL SIMULATOR

WONG Tsz Hin, CHAN Pui Ho, CHENG Kai Yuen

  
ProgrammeBachelor of Computing with Honours in Internet Technology
SupervisorDr. Raymond Pang
AreasVirtual Reality Applications
Year of Completion2017

Objectives

The aim of our project is to reduce the cost of doing a real practice for practice teachers with the use of VR classroom rehearsal simulator. The practice teachers can use our VR rehearsal simulator. It can enhance practice efficiency. Practice teachers and the experienced teacher can use application to know the report and the result of the user. The report will record the grades for the teacher. And give them some suggestion to improve themselves. Also, the application has the interactive system. It has some basic interactive to the user who using this VR application. Such as voice command input, eyes contact. Application has some different burst situation; it need the teachers to handle and make some decide. Therefore, the VR rehearsal simulator have the Situation editor, user can modify the rehearsal situation. User can modify the Difficulty level.

To achieve the aim, the main objective of the project is to develop a class practice of VR rehearsal simulator that the practice teachers can do the practice using by the virtual reality.

The project has defined a few sub-objectives as follows:

  • Scenes of Object
    • Build up the VR artificial world, the classroom environment. Such as the desk, chair, board, student.
    • Integration all element in to the artificial world.
  • Interactive System
    • Capture the user of eye content or voice command using the sensor (Gyrometer) and microphone.
    • Analyze the eye content to which object.
    • Create virtual students that can response, such as visually reflects
  • User Interface and reporting
    • Build up the menu for user to select different case and option.
    • Capture the user using the simulator in different case.
    • Analysis the user makes the decision are right way or wrong way.
    • Report to the user and suggest some way to improve them.
 

Background and Methodology

 

In this project, we will have several components in our project. We include to build up the virtual classroom, situation handle and generate evaluation report. The following functions in those systems are build up the virtual classroom, menu on start page, selection dialog, capture the user of eye content and build up the dynamic VR object.

In this project, my works is about the front-end of the application: building up the static model/object, all the models are save as. fbx format and place in Assert folder. After that I will combine them to be a classroom environment and display them in teacher's point of view. Also, I expect that I will make them become close to the real Hong Kong classroom in daily life. So, that user can feel more immersive and make the rehearsal be more effectively.

Fig. 1 System Overview

Fig.2 Classroom material

Conclusion

After we finish make out application and did the evaluation, we find that our system can help some students who will join the education sector. Our application has 2 main benefit for can help them. First, practice teachers can reduce nervous after using our application. The second one that can more opportunity for doing practice, because practice teachers didn't have many opportunities to do the real practice. Our application can let them do the practice at any time and everywhere.

But at the same time, we need to do some improve. After doing the evaluation, we have some feedback about the application, some feedback is talking about some benefit, also it has some shortage of our application. We need to increase the reality and scene optimization, upload materials and audio record in the system and improve the input method. We know our application not really reality, we may use some better material and texture in the scene. Also, we need to improve the system, let user can upload class materials and listen the audio record in the system. Because we don't want user use much time to find the location to upload the class materials and listen the record. The last one, it improves the input method, some user said that the pointer is difficult to trigger the voice recognition function.

Jonathan Chiu
Marketing Director
3DP Technology Limited

Jonathan handles all external affairs include business development, patents write up and public relations. He is frequently interviewed by media and is considered a pioneer in 3D printing products.

Krutz Cheuk
Biomedical Engineer
Hong Kong Sanatorium & Hospital

After graduating from OUHK, Krutz obtained an M.Sc. in Engineering Management from CityU. He is now completing his second master degree, M.Sc. in Biomedical Engineering, at CUHK. Krutz has a wide range of working experience. He has been with Siemens, VTech, and PCCW.

Hugo Leung
Software and Hardware Engineer
Innovation Team Company Limited

Hugo Leung Wai-yin, who graduated from his four-year programme in 2015, won the Best Paper Award for his ‘intelligent pill-dispenser’ design at the Institute of Electrical and Electronics Engineering’s International Conference on Consumer Electronics – China 2015.

The pill-dispenser alerts patients via sound and LED flashes to pre-set dosage and time intervals. Unlike units currently on the market, Hugo’s design connects to any mobile phone globally. In explaining how it works, he said: ‘There are three layers in the portable pillbox. The lowest level is a controller with various devices which can be connected to mobile phones in remote locations. Patients are alerted by a sound alarm and flashes. Should they fail to follow their prescribed regime, data can be sent via SMS to relatives and friends for follow up.’ The pill-dispenser has four medicine slots, plus a back-up with a LED alert, topped by a 500ml water bottle. It took Hugo three months of research and coding to complete his design, but he feels it was worth all his time and effort.

Hugo’s public examination results were disappointing and he was at a loss about his future before enrolling at the OUHK, which he now realizes was a major turning point in his life. He is grateful for the OUHK’s learning environment, its industry links and the positive guidance and encouragement from his teachers. The University is now exploring the commercial potential of his design with a pharmaceutical company. He hopes that this will benefit the elderly and chronically ill, as well as the society at large.

Soon after completing his studies, Hugo joined an automation technology company as an assistant engineer. He is responsible for the design and development of automation devices. The target is to minimize human labor and increase the quality of products. He is developing products which are used in various sections, including healthcare, manufacturing and consumer electronics.

Course Code Title Credits
  COMP S321F Advanced Database and Data Warehousing 5
  COMP S333F Advanced Programming and AI Algorithms 5
  COMP S351F Software Project Management 5
  COMP S362F Concurrent and Network Programming 5
  COMP S363F Distributed Systems and Parallel Computing 5
  COMP S382F Data Mining and Analytics 5
  COMP S390F Creative Programming for Games 5
  COMP S492F Machine Learning 5
  ELEC S305F Computer Networking 5
  ELEC S348F IOT Security 5
  ELEC S371F Digital Forensics 5
  ELEC S431F Blockchain Technologies 5
  ELEC S425F Computer and Network Security 5
 Course CodeTitleCredits
 ELEC S201FBasic Electronics5
 IT S290FHuman Computer Interaction & User Experience Design5
 STAT S251FStatistical Data Analysis5
 Course CodeTitleCredits
 COMPS333FAdvanced Programming and AI Algorithms5
 COMPS362FConcurrent and Network Programming5
 COMPS363FDistributed Systems and Parallel Computing5
 COMPS380FWeb Applications: Design and Development5
 COMPS381FServer-side Technologies and Cloud Computing5
 COMPS382FData Mining and Analytics5
 COMPS390FCreative Programming for Games5
 COMPS413FApplication Design and Development for Mobile Devices5
 COMPS492FMachine Learning5
 ELECS305FComputer Networking5
 ELECS363FAdvanced Computer Design5
 ELECS425FComputer and Network Security5