PulseExploreJournal ClubDebatesTrendingResearchersJournals
Instagram
HomeExploreJournal ClubTrending
Synapse
⌘+K
Synapse
February 5, 2026Multimodal Technologies and Interaction3 citationsOpen Access

A Mixed Reality Tool with Automatic Speech Recognition for 3D CAD Based Visualization and Automatic Dimension Generation in the Industry 5.0 Shipyard

View Full Paper
AVAida Vidal-BaleaAVAntón Valladares-PoncelaJVJavier Vilar-Martínez

Key Points

  • To develop and evaluate a mixed reality application that enhances workflow and precision in shipyard assembly tasks.
  • Developed a mixed reality application for HoloLens 2.
  • Implemented automatic dimension generation for 3D models.
  • Integrated an automatic speech recognition system for voice command input.
  • Conducted usability and functionality evaluations of the application.
  • Enhanced precision in assembly processes with 3D model positioning.
  • Reduced reliance on paper-based documentation.
  • Validated mixed reality as an effective tool for shipyard tasks.

Abstract

Industry 5.0 is composed of a variety of complex tasks and challenging processes requiring specialized labor and multidisciplinary coordination. Specifically, when it comes to shipbuilding, shipyards leverage advanced technologies, seeking to replace operations that continue to rely on traditional methods, such as 2D blueprints and paper-based documentation, which can lead to inefficiencies and alignment errors in precision-dependent tasks. For this reason, this article focuses on embracing Mixed Reality (MR) technologies to address these challenges in the context of electrical outfitting tasks. The design, development and evaluation of a MR application tailored for HoloLens 2 smart glasses aims to streamline the workflow for operators, reducing reliance on paper-based documentation and enhancing the precision of assembly processes. The proposed system allows for the precise positioning of 3D models in the real environment, ensuring accurate alignment during assembly. Additionally, it incorporates automatic dimension generation between objects in the scene. To further enhance usability, the application integrates a Galician on-device Automatic Speech Recognition (ASR) system, allowing operators to interact seamlessly with the MR interface using voice commands. The whole system has been exhaustively tested, both through usability and functionality evaluations, which validate MR as a viable tool for shipyard assembly and inspection tasks.

Ask AI
Helpful
Bookmark
Share
View Full Paper

Cite This Study

Vidal-Balea et al. (2026) studied this question.

synapsesocial.com/papers/69843451f1d9ada3c1fb258ahttps://doi.org/10.3390/mti10020013
Ask AI
Helpful
Bookmark
Share
View Full Paper