Motion stereo at sea: Dense 3D reconstruction from image sequences monitoring conveyor systems on board fishing vessels

Fisher, Mark, French, Geoffrey, Gorpincenko, Artjoms, Holah, Helen, Clayton, Lauren, Skirrow, Rebecca and Mackiewicz, Michal (2022) Motion stereo at sea: Dense 3D reconstruction from image sequences monitoring conveyor systems on board fishing vessels. IET Image Processing. ISSN 1751-9659

[thumbnail of IET Image Processing - 2022 - Fisher - Motion stereo at sea Dense 3D reconstruction from image sequences monitoring]
Preview
PDF (IET Image Processing - 2022 - Fisher - Motion stereo at sea Dense 3D reconstruction from image sequences monitoring) - Published Version
Available under License Creative Commons Attribution.

Download (3MB) | Preview

Abstract

A system that reconstructs 3D models from a single camera monitoring fish transported on a conveyor system is investigated. Models are subsequently used for training a species classifier and for improving estimates of discarded biomass. It is demonstrated that a monocular camera, combined with a conveyor's linear motion produces a constrained form of multiview structure from motion, that allows the 3D scene to be reconstructed using a conventional stereo pipeline analogous to that of a binocular camera. Although motion stereo was proposed several decades ago, the present work is the first to compare the accuracy and precision of monocular and binocular stereo cameras monitoring conveyors and operationally deploy a system. The system exploits Convolutional Neural Networks (CNNs) for foreground segmentation and stereo matching. Results from a laboratory model show that when the camera is mounted 750 mm above the conveyor, a median accuracy of <5 mm can be achieved with an equivalent baseline of 62 mm. The precision is largely limited by error in determining the equivalent baseline (i.e. distance travelled by the conveyor belt). When ArUco markers are placed on the belt, the inter quartile range (IQR) of error in z (depth) near the optical centre was found to be ±4 mm.

Item Type: Article
Faculty \ School: Faculty of Science > School of Computing Sciences
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 24 Oct 2022 11:30
Last Modified: 24 Oct 2022 19:30
URI: https://ueaeprints.uea.ac.uk/id/eprint/89302
DOI: 10.1049/ipr2.12636

Actions (login required)

View Item View Item