Point2PartVolume: Human body volume estimation from a single depth image

Hu, Pengpeng, Dai, Xinxin, Zhao, Ran, Wang, He, Ma, Yingliang ORCID: https://orcid.org/0000-0001-5770-5843 and Munteanu, Adrian (2023) Point2PartVolume: Human body volume estimation from a single depth image. IEEE Transactions on Instrumentation and Measurement, 72. ISSN 0018-9456

[thumbnail of Point2PartVolume_Human_Body_Volume_Estimation_from_A_Single_Depth_Image]
Preview
PDF (Point2PartVolume_Human_Body_Volume_Estimation_from_A_Single_Depth_Image) - Accepted Version
Download (7MB) | Preview

Abstract

Human body volume (BV) is a useful biometric feature for human identification and an important medical indicator for monitoring body health. Traditional BV estimation techniques such as underwater weighing and air displacement demand a lot of equipment and are difficult to be performed under some circumstances, for example, in clinical environments when dealing with bedridden patients. In this contribution, a novel vision-based method dubbed Point2PartVolume based on deep learning is proposed to rapidly and accurately predict the part-aware BVs from a single-depth image of the dressed body. First, a novel multitask neural network is proposed for jointly completing the partial body point clouds, predicting the body shape under clothing and semantically segmenting the reconstructed body into parts. Next, the estimated body segments are fed into the proposed volume regression network to estimate the partial volumes. A simple yet efficient two-step training strategy is proposed for improving the accuracy of volume prediction regressed from point clouds. Compared to existing methods, the proposed method addresses several major challenges in vision-based human BV estimation, including shape completion, pose estimation, body shape estimation under clothing, body segmentation, and volume regression from point clouds. Experimental results on both the synthetic data and public real-world data show that our method achieved average 90% volume prediction accuracy and outperformed the relevant state-of-the-art.

Item Type: Article
Uncontrolled Keywords: 3d scanning,biological system modeling,biometric data security,deep learning,human body shape reconstruction,human body under clothing,image reconstruction,point cloud completion,point cloud compression,shape,solid modeling,three-dimensional displays,volume estimation,volume measurement,human body shape reconstruction,biometric data security,deep learning,point cloud completion,3-d scanning,volume estimation,human body under clothing,instrumentation,electrical and electronic engineering,sdg 3 - good health and well-being ,/dk/atira/pure/subjectarea/asjc/3100/3105
Faculty \ School: Faculty of Science > School of Computing Sciences
UEA Research Groups: Faculty of Science > Research Groups > Norwich Epidemiology Centre
Faculty of Medicine and Health Sciences > Research Groups > Norwich Epidemiology Centre
Related URLs:
Depositing User: LivePure Connector
Date Deposited: 16 Jun 2023 08:31
Last Modified: 18 Jul 2023 16:31
URI: https://ueaeprints.uea.ac.uk/id/eprint/92413
DOI: 10.1109/TIM.2023.3284948

Downloads

Downloads per month over past year

Actions (login required)

View Item View Item