Smart Site Record Taker - Voice Tagging Smartglasses

I&T Wish Smart Site Record Taker - Voice Tagging Smartglasses
(REF : W-0455)
Matched I&T Solution
Trial Project
Summary and Challenges
  • When performing regular maintenance or test & commissioning in government building, photo taking normally is required for record. Owing to lots of similar or even identical equipment (e.g. CCTV camera, Display monitor, workstation…etc), retrieving captured photo from smartphone / digital camera and matching corresponding location / description is a time-consuming operation and reducing reporting efficiency.
Expected Outcome
  • Deploying a SmartGlasses embedded with a mobile application which is able to operate internal camera by voice command, adding multiple tags to the captured photo by performing speech-to-text and stored locally. The mobile app shall pair the photo with tag and upload to cloud server for backup when under good coverage of network, and support generation of a tailor-made report (e.g. inspection report).
  • Requirement (Operation):
    • Able to recognize Cantonese Mixed with English
    • Voice controlled camera on smartglasses format
    • Speech-to-text tagging
    • Tag the location, description and comments to photo taken
    • Search photos by speech using tags
    • Able to be operated Offline
    • Able to be installed to any Android / IOS device
  • Requirement (Reporting) : Information required to be generated automatically-
    1. Photo taken
    2. Location
    3. Description
    4. Voice recorded
Expected Trial Duration 9-month
Contact Information
I&T Wish Proposer:Electrical and Mechanical Services Department (EMSD)
Contact Person:YI Yim Ting
Position:Assistant Project Officer/Innovation/3
Tel: 3528 6371
Email: ytyi@emsd.gov.hk
Upload Date 2023-05-16
Closing Date 2023-05-30
Propose I&T Solution Closed