Development of a standardized framework for cost-effective communication system based on 3D data streaming and real-time 3D reconstruction

The common approachs for people to converse over a large geographical distance are via either SMS or video conference. A more immersive communication method over the internet that creates an experience which is closer to a face-to-face conversation is more desirable. The closest form is a conversation via the holographic projection of the participants and environment. Many motion pictures have featured this type of communication. While a complete system itself that uses holographic projection is still many years away, the core functions of such a system are not im- possible to achieve now. Two such features include 3D reconstruction of the target and streaming of 3D data. With the current development speed of technology, 3D reconstruction can be achieved with cost-effective depth cameras and 3D streaming can be done after data optimization. The focus of this work is on how to approach the idea by using such devices to create a standardized platform for the implemen- tation of the system with aforementioned features. Specifically, the system is able to capture 3D data from multiple depth sensors, reconstruct a 3D model of the human target to create an avatar, and stream the changes acquired from the sensors to the client to control the avatar in real time.