Motion stereo at sea: Dense 3D reconstruction from image sequences monitoring conveyor systems on board fishing vessels

Fisher, Mark, French, Geoffrey, Gorpincenko, Artjoms, Holah, Helen, Clayton, Lauren, Skirrow, Rebecca and Mackiewicz, Michal ORCID: https://orcid.org/0000-0002-8777-8880 (2023) Motion stereo at sea: Dense 3D reconstruction from image sequences monitoring conveyor systems on board fishing vessels. IET Image Processing, 17 (2). pp. 349-361. ISSN 1751-9659

Preview

PDF (IET Image Processing - 2022 - Fisher - Motion stereo at sea Dense 3D reconstruction from image sequences monitoring) - Published Version Available under License Creative Commons Attribution. Download (3MB) | Preview

Abstract

A system that reconstructs 3D models from a single camera monitoring fish transported on a conveyor system is investigated. Models are subsequently used for training a species classifier and for improving estimates of discarded biomass. It is demonstrated that a monocular camera, combined with a conveyor's linear motion produces a constrained form of multiview structure from motion, that allows the 3D scene to be reconstructed using a conventional stereo pipeline analogous to that of a binocular camera. Although motion stereo was proposed several decades ago, the present work is the first to compare the accuracy and precision of monocular and binocular stereo cameras monitoring conveyors and operationally deploy a system. The system exploits Convolutional Neural Networks (CNNs) for foreground segmentation and stereo matching. Results from a laboratory model show that when the camera is mounted 750 mm above the conveyor, a median accuracy of <5 mm can be achieved with an equivalent baseline of 62 mm. The precision is largely limited by error in determining the equivalent baseline (i.e. distance travelled by the conveyor belt). When ArUco markers are placed on the belt, the inter quartile range (IQR) of error in z (depth) near the optical centre was found to be ±4 mm.

Item Type:	Article
Additional Information:	Research Funding: Horizon 2020 Programme. Grant Number: 773521
Faculty \ School:	Faculty of Science > School of Computing Sciences
Related URLs:	https://onlinelibrary.wiley.com/doi/10.1...
Depositing User:	LivePure Connector
Date Deposited:	24 Oct 2022 11:30
Last Modified:	30 Jan 2024 03:22
URI:	https://ueaeprints.uea.ac.uk/id/eprint/89302
DOI:	10.1049/ipr2.12636

Downloads

Actions (login required)

View Item