
Feedback Mechanisms of an iOS App to Record RGBD Data for AI-Based Diagnosis and Monitoring of Infant Head Deformation - 22.39
F. Rapp et al., "Feedback Mechanisms of an iOS App to Record RGBD Data for AI-Based Diagnosis and Monitoring of Infant Head Deformation", Proc. of 3DBODY.TECH 2022 - 13th Int. Conf. and Exh. on 3D Body Scanning and Processing Technologies, Lugano, Switzerland, 25-26 Oct. 2022, #39, https://doi.org/10.15221/22.39.
Title:
Feedback Mechanisms of an iOS App to Record RGBD Data for AI-Based Diagnosis and Monitoring of Infant Head Deformation
Authors:
Fabian RAPP 1, Samuel ZEITVOGEL 3, Christian MEDER 1, Kai STOEVESANDT 2, Christian WERNET 3, Astrid LAUBENHEIMER 3
1 inovex GmbH, Karlsruhe, Germany;
2 VARILAG GmbH & Co. KG, Ettlingen, Germany;
3 Intelligent Systems Research Group (ISRG), Karlsruhe University of Applied Sciences, Germany
Abstract:
We present a prototype of a 3D infant head reconstruction app on a mobile phone for a cranial asymmetry measurement method. In this work, we focus on the user experience and user feedback of the interactive reconstruction pipeline.
The advent of 3D sensor-equipped mobile phones such as the iPhone TrueDepth camera enables widespread 3D reconstruction and measurement applications such as room measurements for interior design preview and object reconstruction. Reconstructing an infant's head with an RGBD sequence is challenging due to the uncooperative behaviour of the subject.
The RGBD data for the scan is recorded with the TrueDepth camera system on the front of iPhones (starting with the iPhone X), which is normally used for FaceID. The forward-facing position of the sensor poses a challenge to the app operator because the screen is hardly visible during recording.
The major contribution of this work is an app providing audible, haptic and visual feedback to support the user during the scanning process. Furthermore, the app is designed to be easy to use following an intuitive user experience design. Lastly, the developed app is tested by a team of physical therapists to evaluate the feedback concept and the user experience.
Keywords:
3D, TrueDepth camera system, user feedback, CVAI measurement, scanning app
Full paper:
Presentation:
Details:
Proceedings: 3DBODY.TECH 2022, 25-26 Oct. 2022, Lugano, Switzerland
Paper id#: 39
DOI: 10.15221/22.39
License/Copyright notice
Proceedings: © Hometrica Consulting - Dr. Nicola D'Apuzzo, Switzerland, hometrica.ch.
Authors retain all rights to individual papers, which are licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
The papers appearing in the proceedings reflect the author's opinions. Their inclusion in the proceedings does not necessary constitute endorsement by the editor or by the publisher.
Note: click the + on the top left of the page to open/close the menu.