School of Science and Technology 科技學院
Computing Programmes 電腦學系

Driving Test Simulator with Virtual Reality (VR) Device 

Chan Chi Yat, Koo Chung Hing, Shen Jiahang 

ProgrammeBachelor of Computing with Honours in Internet Technology

Bachelor of Science with Honours in Computer Science
SupervisorDr. Keith Lee
AreasVirtual Reality Applications 
Year of Completion2024

Objectives

Project Aim

This is a driving test simulator developed to provide a low-cost realistic immersive driving environment. To construct the immersive simulated driving environment, we have used a VR headset and a driving set to construct the environment. The VR headset can track the user’s head's moving behaviours while driving 

Project Objectives  
  1. To conduct a thorough analysis of the setup and criteria of the driving test for simulation. 
  2. To design and develop a full Hong Kong Driving Test mock test scenario.  
  3. To design and develop a Hong Kong Driving Test Part B scenario.  
  4. To design and develop an awareness training section.  
  5. To design and develop a VR version visual of the driving test simulator.  
  6. To build a driving environment by using real-world terrain model and based the real driving test route.  
  7. To evaluate the effectiveness and user satisfaction of the simulator through a survey. 

Videos

Demonstration Video

Presentation Video

Methodologies and Technologies used

Requirements and Technologies 

Key needs include: 

  • A realistic simulation of the Hong Kong driving test 
  • An intuitive user interface 
  • A community-driven platform 

Supporting Technologies: 

  • Pico 4 (VR): Provides an immersive 3D environment with eye-tracking for real-time visual guidance 
  • Drive wheels and gear shifts: Offer authentic vehicle control with tactile feedback 
  • Mouse: Acts as an alternative input method for simulator interaction 

Architecture or Level System Design: 

  • The VR headset and Monitor are viewed in the application.  
  • The mouse, and driving wheel are controllers in the application.  
  • The controllers and the viewer are connecting with the Server.  
  • The user can use different devices for the controller to control the driving test. Such as a keyboard and mouse or a Driving wheel. The user also needs to decide on the viewer on the driving test such as a VR headset or Monitor.  

There are a total of 3 components that construct the driving test simulator: User, VR headset, Personal Computer (PC), and Driving wheelset. Based on these 3 components, we have designed 2 types of systems for users with different devices they have owned.

Figure 1: Technologies and Solution diagram 

Use Case Diagram and Function List: 

Figure 2: Use Case Diagram and Function List 

Results (Prototype System Design) 

The driving simulator offers two core modes: 

  • Mock Test Mode: Guided practice sessions that allow users to build driving skills safely. 
  • Identification Training Mode: Evaluates users' performance based on predefined standards. 

The system integrates VR technology with steering wheel hardware to create a realistic, immersive driving experience. Users engage with dynamic, lifelike environments that simulate real-world road conditions. 

At its core, the system features an intelligent assessment engine that uses data analytics and context-aware algorithms to: 

  • Detect correct and incorrect driving behaviors 
  • Deliver real-time feedback 
  • Generate comprehensive test reports to support ongoing skill development and progress tracking 

It blends immersive tech with smart evaluation to help users train effectively and gain confidence behind the virtual wheel. 

Game Map

Figure 3: Map of Ho Man Tin in Unity 

Figure 4: Chung Yee Street Text Route 

Road Sign

Figure 5: Hong Kong Road signs 

Figure 6: Hong Kong Road signs 

Implementation 

Mock Test  

The driving test mode is structured to replicate a standard driving test, with the scenario range chosen to be one of the test sections at the Zhong Yi Street test center. The system evaluates user performance against pre-defined criteria and provides detailed feedback after the test.  

Figure 7: Simulator Driver’s View with HUD 

Part B (Intermediate Test)  

Part B of the main part of the ramp parking and starting, three-point turnaround, and s-parking into the same module, for special training, to ensure that players can familiarize themselves with the process and master the focus of the examination of these special modules 

Figure 8: Mark Deducted Shown on HUD 

User interface

The user interface is designed to be clear and easy to use, with a dashboard interface that displays real-time data and highlights key information through HUD alerts. 

Figure 9: Simulator Driver’s View with HUD 

Traffic

The traffic system is designed to mimic real-world dynamics through timer-controlled traffic signals and user-operated, crosswalk use to create realistic driving conditions.  

Figure 10: Traffic Light from Driver’s View

NPC

The NPC, as a model in a contingency, has a complete course of action and action animation, which is triggered by the player passing an animation trigger during normal gameplay. 

Figure 11: NPC Crossing Road 

Conclusion

The team successfully achieved the core goal of delivering an immersive VR driving simulation using steering wheels and virtual environments. The simulator: 

  • Replicates real-world Hong Kong driving tests, including Part B scenarios. 
  • Includes emergency-response quizzes to enhance user awareness. 
  • Uses real terrain models to mimic actual test routes. 
  • Was evaluated via user feedback surveys. 

 

Current Limitations 

  • Basic UI design lacks visual appeal. 
  • Eye-tracking functionality is not implemented. 
  • Half-clutch functionality for vehicle start is missing. 
  • Car performance (horsepower and gears) does not perfectly mirror real vehicles. 

Future Development

  • Address unresolved technical limitations.
  • Incorporate user feedback to refine features. 
  • Add new elements such as scoreboards, community support features, additional car models, diverse test sections, and randomized NPC events to boost realism and engagement. 

The project lays a solid foundation for an engaging and educational driving simulator with plenty of room to grow. 

Jonathan Chiu
Marketing Director
3DP Technology Limited

Jonathan handles all external affairs include business development, patents write up and public relations. He is frequently interviewed by media and is considered a pioneer in 3D printing products.

Krutz Cheuk
Biomedical Engineer
Hong Kong Sanatorium & Hospital

After graduating from OUHK, Krutz obtained an M.Sc. in Engineering Management from CityU. He is now completing his second master degree, M.Sc. in Biomedical Engineering, at CUHK. Krutz has a wide range of working experience. He has been with Siemens, VTech, and PCCW.

Hugo Leung
Software and Hardware Engineer
Innovation Team Company Limited

Hugo Leung Wai-yin, who graduated from his four-year programme in 2015, won the Best Paper Award for his ‘intelligent pill-dispenser’ design at the Institute of Electrical and Electronics Engineering’s International Conference on Consumer Electronics – China 2015.

The pill-dispenser alerts patients via sound and LED flashes to pre-set dosage and time intervals. Unlike units currently on the market, Hugo’s design connects to any mobile phone globally. In explaining how it works, he said: ‘There are three layers in the portable pillbox. The lowest level is a controller with various devices which can be connected to mobile phones in remote locations. Patients are alerted by a sound alarm and flashes. Should they fail to follow their prescribed regime, data can be sent via SMS to relatives and friends for follow up.’ The pill-dispenser has four medicine slots, plus a back-up with a LED alert, topped by a 500ml water bottle. It took Hugo three months of research and coding to complete his design, but he feels it was worth all his time and effort.

Hugo’s public examination results were disappointing and he was at a loss about his future before enrolling at the OUHK, which he now realizes was a major turning point in his life. He is grateful for the OUHK’s learning environment, its industry links and the positive guidance and encouragement from his teachers. The University is now exploring the commercial potential of his design with a pharmaceutical company. He hopes that this will benefit the elderly and chronically ill, as well as the society at large.

Soon after completing his studies, Hugo joined an automation technology company as an assistant engineer. He is responsible for the design and development of automation devices. The target is to minimize human labor and increase the quality of products. He is developing products which are used in various sections, including healthcare, manufacturing and consumer electronics.

Course Code Title Credits
  COMP S321F Advanced Database and Data Warehousing 5
  COMP S333F Advanced Programming and AI Algorithms 5
  COMP S351F Software Project Management 5
  COMP S362F Concurrent and Network Programming 5
  COMP S363F Distributed Systems and Parallel Computing 5
  COMP S382F Data Mining and Analytics 5
  COMP S390F Creative Programming for Games 5
  COMP S492F Machine Learning 5
  ELEC S305F Computer Networking 5
  ELEC S348F IOT Security 5
  ELEC S371F Digital Forensics 5
  ELEC S431F Blockchain Technologies 5
  ELEC S425F Computer and Network Security 5
 Course CodeTitleCredits
 ELEC S201FBasic Electronics5
 IT S290FHuman Computer Interaction & User Experience Design5
 STAT S251FStatistical Data Analysis5
 Course CodeTitleCredits
 COMPS333FAdvanced Programming and AI Algorithms5
 COMPS362FConcurrent and Network Programming5
 COMPS363FDistributed Systems and Parallel Computing5
 COMPS380FWeb Applications: Design and Development5
 COMPS381FServer-side Technologies and Cloud Computing5
 COMPS382FData Mining and Analytics5
 COMPS390FCreative Programming for Games5
 COMPS413FApplication Design and Development for Mobile Devices5
 COMPS492FMachine Learning5
 ELECS305FComputer Networking5
 ELECS363FAdvanced Computer Design5
 ELECS425FComputer and Network Security5