Smart Glasses for Mixed Reality (MR) O&M Assistance with potential 5G integration

I&T Wish Smart Glasses for Mixed Reality (MR) O&M Assistance with potential 5G integration
(REF : W-0349)
Matched I&T Solution
Trial Project
Summary and Challenges For some emergency problems in constrained area, it is a challenge to mobilize the whole technical team members on site.  With the development of smart glasses solution with real-time 2-ways video communication, an effective communication channels can be formulated between the supporting team and the front-line staff.  The supporting team could offer precise instruction and assistance to the front-line staff for solving the problems. With the freehand interactions, the front-line staff can focus their maintenance and repair tasks that required hand-free performance. 


For the E&M operation & maintenance, it is difficult to locate the electrical and mechanical equipment inside the ceiling void. The operators have to guess the location of actual equipment (e.g. valve) by referring the indicative 2D drawings. By developing the solution of smart glasses with Mixed Reality (MR) and Building Information Modeling, the operators are able to identify the equipment inside the ceiling void directly and the work efficiency can be enhanced.

The aforesaid operation might demand large data transmission for the good quality of video communication and graphic exchange (e.g. BIM models), the 5G technology should be explored for this application to enhance the system stability and minimize the latency. 
Expected Outcome By adopting the smart glasses solution with real time video communication and integration of BIM-MR, fault diagnosis can be sped up with fast response time.  Besides, the mis-understanding can be eliminated with the real-time 2-ways video communication. Therefore, the service reliability can be enhanced even under the limited resources.
Expected Trial Duration 12-month
Contact Information
I&T Wish Proposer:Electrical and Mechanical Services Department (EMSD)
Contact Person:Vincent Choi
Position:Project Officer/Innovation/19
Tel: 55381540
Email: kpchoi@emsd.gov.hk
Upload Date 2021-02-01
Closing Date 2021-02-15
Propose I&T Solution Closed