Like their fellow graduating students in the Department of Creative Arts, student Kelvin Mak Ka-wai and his teammates put their best foot forward for their final-year project (FYP) several years ago. Entitled 'VR Driving School', the FYP aimed to develop a virtual reality (VR) system that provides simulated driving lessons and mock tests for learner-drivers. When the prototype went on public display at the HKMU Creative Arts Graduation Show 2021, it was given another life. It was first spotted by Lee Kin Driving School, which offered to back a preliminary study on scaling up the system. On this basis, a proposal for a more sophisticated VR-based driving training system was developed, which won another grant from the government's Smart Traffic Fund earlier this year. Thanks to the combination of industry, government and internal funding, the students' prototype is now being expanded into a specific system.
Kelvin's team was in the Bachelor of Arts with Honours in Computing and Interactive Entertainment (CIE) programme, a joint offering of the School of Science and Technology and the School of Arts and Social Sciences (A&SS) that trains technical artists. Dr William Lai, the team's supervisor at A&SS's Department of Creative Arts and the principal investigator of the funded project, had recognised the FYP's potential from the very beginning. Knowing that a complete system would be beyond the scope of the FYP, he had encouraged the team to apply for funding from the then Open InnoChallenge, the University's in-house start-up support scheme. 'We did get the initial proof-of-concept support but didn't make our way to the finals because we weren't that good at sales pitching. We were amazed to learn that Lee Kin Driving School was interested in our project!' says Kelvin, who immediately jumped at the opportunity as soon as he learnt that their FYP was to be developed into a funded project. After a year in gamification, he returned to the University to join the research team as a research assistant.
The initial idea of the FYP was sparked by the team's own knowledge in driving as well as the development of the eye-tracking technology, which was newly introduced to VR headsets. 'We noticed some challenges in learning to drive in Hong Kong, such as the existence of prohibited zones for learners and inadequate driving instructors, so we tried to develop a solution to the problem,' explains Kelvin. Other than providing guidance on the operation of the vehicle, an important role of the driving instructor is to ensure that the learner is keeping a watchful eye. With a built-in eye-tracking script, the VR Driving School is able to detect where the user is looking at and provide feedback signals.
The prototype was constructed based on the Ho Man Tin area in the University's vicinity, where one of Hong Kong's busiest driving test centres is located. The process of reconstructing the road conditions of the driving test route was painstaking. 'Simply building the railings took us two weeks of work day and night!' recalls Kelvin. Developing the traffic rules took them another few months. By the time the project was due, the team had managed to complete a third of the rules, create the first four to five driving lessons and get a few friends to test out the system.
Obviously, a major limitation of the original FYP was scalability, as the 3D models had to be constructed manually. Scaling up the project to cover all driving test routes in Hong Kong warrants an automated process. This is made possible by the extra funding, which is providing for the acquisition of a road scanner for street data collection. Another quintessential improvement over the FYP is the introduction of AI-generated hazard situations that learner-drivers may not encounter in physical lessons. 'We're also purchasing a motion chair to better simulate the driving environment,' adds Dr Lai.
Dr Lai is very pleased with what the student team has accomplished. They have perfectly lived up to the goal of the FYP course. 'We have two major criteria in deciding whether to give the green light to a project proposal — whether there's a reasonable rationale, and whether the project is feasible,' Dr Lai elaborates. 'We won't approve a project just because students find it interesting. We want our students to observe problems and try to solve them by what they've learnt.'
Thus, the FYPs coming from the CIE programme are always practically oriented. According to Dr Lai, it is not uncommon to see a few graduation projects exhibiting good potential every year, but whether any can be further developed and eventually commercialised depends on numerous factors. 'First, the students themselves may have their own plans. Second, obtaining funding is no mean feat,' he expresses. 'But I'm glad the University is now placing an emphasis on knowledge transfer. I hope we'll get even more support in this area.'
