Precise 4D Facial Imaging System Composed by Multiple Infrared Structured Light Sensors and Color Cameras - 25.26

Title:

Precise 4D Facial Imaging System Composed by Multiple Infrared Structured Light Sensors and Color Cameras

Authors:

Di WU 1, Yuping YE 2,3, Bin REN 1,4, Jixin LIANG 1,4, Zhan SONG 1,5

1 Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China;
2 School of Smart Marine Science and Technology, Fujian University of Technology, Fuzhou, China;
3 Fujian Provincial Key Laboratory of Marine Smart Equipment, Fuzhou, China;
4 Southern University of Science and Technology, Shenzhen, China;
5 The Chinese University of Hong Kong, Hong Kong, China

Keywords:

structured light, 4D face, multi-view

Abstract:

This paper presents a high-precision, multi-view 4D facial imaging system based on structured light. The system comprises three structured-light devices operating at distinct infrared wavelengths. Imaging devices equipped with projectors operating at the 730 nm, 850 nm, and 950 nm bands are deployed at the left-front, front, and right-front positions relative to the face, respectively. Synchronous multi-view scanning is achieved by using distinct wavelength bands combined with an external trigger. In each device, the infrared camera work in conjunction with the projector to reconstruct a 3D point cloud, while the RGB camera at the same view synchronously acquires the corresponding texture. To meet real-time processing requirements, we use CUDA to optimize and accelerate core algorithms, including structured-light decoding, point-cloud meshing, point-cloud reprojection, and normal-map generation. Experiments show that the system maintains a reconstruction accuracy of 0.1 mm while achieving up to 29 Hz full-face 3D reconstruction and high-fidelity rendering exceeding 50 Hz. This provides high-precision, low-latency 3D sensing for real-time applications such as medical diagnosis and virtual reality.

Full paper:

PDF

Note:

This paper is currently under review for publication in the 3DBDOY.TECH Journal - Vol. 2, 2025 (jrnl.3dbody.tech).
It will be updated also in this page once the review process is concluded.

Presentation:

VIDEO will be available here in Q3.2026.
VIDEO availble in proceedings (purchase order)

How to Cite (MLA):

D. Wu et al., "Precise 4D Facial Imaging System Composed by Multiple Infrared Structured Light Sensors and Color Cameras", Proceedings of 3DBODY.TECH 2025 - 16th International Conference and Expo on 3D/4D Body Scanning, Data and Processing Technologies, Lugano, Switzerland, 21-22 Oct. 2025, #26, https://doi.org/10.15221/25.26

Details:

Proceedings: 3DBODY.TECH 2025, 21-22 Oct. 2025, Lugano, Switzerland
Paper/Presentation: #26
DOI: https://doi.org/10.15221/25.26

License/Copyright notice

Proceedings: © Hometrica Consulting - Dr. Nicola D'Apuzzo, Switzerland, hometrica.ch.
Authors retain all rights to individual papers, which are licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
The papers appearing in the proceedings reflect the author's opinions. Their inclusion in the proceedings does not necessary constitute endorsement by the editor or by the publisher.


Note: click the + on the top left of the page to open/close the menu.