This project aims to use VR and AI to develop more effective digital tools for understanding commuting experiences.
Brief
Traditional methods for evaluating commuter experiences, such as surveys and observations, are time-consuming and may disrupt participants, affecting data quality. The project consists of 3 major parts - DataProc, VRCS and CRMA.
DataProc
The Data Processing (DataProc) tool is a research artifact in the form of a graphical tool that investigates how to best process LiDAR-based terrestrial scans and photogrammetry-based aerial scans that capture real-life streetscape data to be translated for use in VR and mobile environments for VRCS and CRMA respectively.
There are many research problems that the team worked on the “translation” process, which includes 3D semantic segmentation for 3D scene understanding and usability design in our custom tool interface to manipulate these massive point clouds (file size of ~8GB per 200m² tile).
VRCS
The Virtual Reality Commuting Simulator (VRCS) is a research artefact that helps the team understand how to design a VR tool for evaluating commuter experiences. It addresses data quality and cost challenges associated with physical surveys and field observations, while providing a safer, more controlled environment to obtain nuanced commuter responses.
Key research areas include interaction design for infinite walking in VR, VR UI design, and procedural generation of VR assets from point cloud data processed through DataProc.
CRMA
The Commuter Routing Mobile App (CRMA) is a research tool designed to explore whether a highly localised routing app with personalised features, such as barrier-free routes that consider weather, can offer new benefits for Singaporean commuters.
The research investigates suitable machine learning architectures for personalised routing and whether the app can encourage commuters to provide useful data for transport planners.
The processed data will be translated into high fidelity 3D assets for use in VRCS, e.g., in the sample images (these are redacted synthetic environments made from the point clouds and not directly modeled after the real test site), and 2D topographical data for use in the CRMA.
Live demo:
See a demonstration of the DataProc tool for 3D point cloud exploration and annotation.
View our prototype for an infinite walking interaction modality.
See the collision guidance system designed to prevent users from hitting virtual obstacles.
View a demonstration of personalised routing based on user demographics and terrain.
Watch our gamified prototype designed to encourage commuters to explore FMLM routes.