Advanced Environment Modelling for Remote Teleoperation to Improve Operators’ Experience

Jin, Yixiang, Paredes Soto, Daniel Alonso, Rossiter, John Anthony and Veres, Sandor M (2021) Advanced Environment Modelling for Remote Teleoperation to Improve Operators’ Experience. In: icARTi '21: Proceedings of the International Conference on Artificial Intelligence and its Applications. Association for Computing Machinery (ACM), pp. 1-8.

[thumbnail of assaagyei-2023-ijca-922941]
PDF (assaagyei-2023-ijca-922941) - Published Version
Download (451kB) | Preview


This work presents a novel intelligent robot perception system, including a real-time, high-quality, 3D scanning pipeline for texture-less scenes and a human-supervised grasping system. Comparison is carried out with the state of the art 3D reconstruction systems, and the performance of the proposed system is demonstrated. The scanning methods are applied to a new user interface with object 6D-pose estimation. This work supports human-robot interaction in remote handling operations in hazardous environments by providing a high-quality telepresence. Current teleoperation systems primarily utilise 2D images or point clouds to display the remote workspace to the operator. Operators require extensive training to be able to perceive the spatial relationship between the robot and the target objects by remotely looking at multiple 2D images. Therefore, this paper proposes a new teleoperation system that exploits artificial intelligence to improve the efficiency of operators. The experiments show that the proposed method surpasses state-of-the-art reconstruction systems and successfully complements a simulated nuclear waste handling experiment.

Item Type: Book Section
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 22 Nov 2023 03:47
Last Modified: 22 Nov 2023 03:47
DOI: 10.1145/3487923.3487939


Downloads per month over past year

Actions (login required)

View Item View Item