School of Science and Technology 科技學院
Computing Programmes 電腦學系

Driving Test Simulator with Virtual Reality (VR) Device 

Chan Chi Yat, Koo Chung Hing, Shen Jiahang 

ProgrammeBachelor of Computing with Honours in Internet Technology

Bachelor of Science with Honours in Computer Science
SupervisorDr. Keith Lee
AreasVirtual Reality Applications 
Year of Completion2024

Objectives

Project Aim

This is a driving test simulator developed to provide a low-cost realistic immersive driving environment. To construct the immersive simulated driving environment, we have used a VR headset and a driving set to construct the environment. The VR headset can track the user’s head's moving behaviours while driving 

Project Objectives  
  1. To conduct a thorough analysis of the setup and criteria of the driving test for simulation. 
  2. To design and develop a full Hong Kong Driving Test mock test scenario.  
  3. To design and develop a Hong Kong Driving Test Part B scenario.  
  4. To design and develop an awareness training section.  
  5. To design and develop a VR version visual of the driving test simulator.  
  6. To build a driving environment by using real-world terrain model and based the real driving test route.  
  7. To evaluate the effectiveness and user satisfaction of the simulator through a survey. 

Videos

Demonstration Video

Presentation Video

Methodologies and Technologies used

Requirements and Technologies 

Key needs include: 

  • A realistic simulation of the Hong Kong driving test 
  • An intuitive user interface 
  • A community-driven platform 

Supporting Technologies: 

  • Pico 4 (VR): Provides an immersive 3D environment with eye-tracking for real-time visual guidance 
  • Drive wheels and gear shifts: Offer authentic vehicle control with tactile feedback 
  • Mouse: Acts as an alternative input method for simulator interaction 

Architecture or Level System Design: 

  • The VR headset and Monitor are viewed in the application.  
  • The mouse, and driving wheel are controllers in the application.  
  • The controllers and the viewer are connecting with the Server.  
  • The user can use different devices for the controller to control the driving test. Such as a keyboard and mouse or a Driving wheel. The user also needs to decide on the viewer on the driving test such as a VR headset or Monitor.  

There are a total of 3 components that construct the driving test simulator: User, VR headset, Personal Computer (PC), and Driving wheelset. Based on these 3 components, we have designed 2 types of systems for users with different devices they have owned.

Figure 1: Technologies and Solution diagram 

Use Case Diagram and Function List: 

Figure 2: Use Case Diagram and Function List 

Results (Prototype System Design) 

The driving simulator offers two core modes: 

  • Mock Test Mode: Guided practice sessions that allow users to build driving skills safely. 
  • Identification Training Mode: Evaluates users' performance based on predefined standards. 

The system integrates VR technology with steering wheel hardware to create a realistic, immersive driving experience. Users engage with dynamic, lifelike environments that simulate real-world road conditions. 

At its core, the system features an intelligent assessment engine that uses data analytics and context-aware algorithms to: 

  • Detect correct and incorrect driving behaviors 
  • Deliver real-time feedback 
  • Generate comprehensive test reports to support ongoing skill development and progress tracking 

It blends immersive tech with smart evaluation to help users train effectively and gain confidence behind the virtual wheel. 

Game Map

Figure 3: Map of Ho Man Tin in Unity 

Figure 4: Chung Yee Street Text Route 

Road Sign

Figure 5: Hong Kong Road signs 

Figure 6: Hong Kong Road signs 

Implementation 

Mock Test  

The driving test mode is structured to replicate a standard driving test, with the scenario range chosen to be one of the test sections at the Zhong Yi Street test center. The system evaluates user performance against pre-defined criteria and provides detailed feedback after the test.  

Figure 7: Simulator Driver’s View with HUD 

Part B (Intermediate Test)  

Part B of the main part of the ramp parking and starting, three-point turnaround, and s-parking into the same module, for special training, to ensure that players can familiarize themselves with the process and master the focus of the examination of these special modules 

Figure 8: Mark Deducted Shown on HUD 

User interface

The user interface is designed to be clear and easy to use, with a dashboard interface that displays real-time data and highlights key information through HUD alerts. 

Figure 9: Simulator Driver’s View with HUD 

Traffic

The traffic system is designed to mimic real-world dynamics through timer-controlled traffic signals and user-operated, crosswalk use to create realistic driving conditions.  

Figure 10: Traffic Light from Driver’s View

NPC

The NPC, as a model in a contingency, has a complete course of action and action animation, which is triggered by the player passing an animation trigger during normal gameplay. 

Figure 11: NPC Crossing Road 

Conclusion

The team successfully achieved the core goal of delivering an immersive VR driving simulation using steering wheels and virtual environments. The simulator: 

  • Replicates real-world Hong Kong driving tests, including Part B scenarios. 
  • Includes emergency-response quizzes to enhance user awareness. 
  • Uses real terrain models to mimic actual test routes. 
  • Was evaluated via user feedback surveys. 

 

Current Limitations 

  • Basic UI design lacks visual appeal. 
  • Eye-tracking functionality is not implemented. 
  • Half-clutch functionality for vehicle start is missing. 
  • Car performance (horsepower and gears) does not perfectly mirror real vehicles. 

Future Development

  • Address unresolved technical limitations.
  • Incorporate user feedback to refine features. 
  • Add new elements such as scoreboards, community support features, additional car models, diverse test sections, and randomized NPC events to boost realism and engagement. 

The project lays a solid foundation for an engaging and educational driving simulator with plenty of room to grow.