Virtual Staging Technologies for the Metaverse

Muhammad Tukur, Boraey Yehia, Jashari Sara, Alberto Jaspe-Villanueva, Uzair Shah, Mahmood Alzubaidi, Giovanni Pintore, Enrico Gobbetti, Jens Schneider, and Marco Agus

IEEE iMeta 2024 - The 2nd International Conference on Intelligent Metaverse Technologies & Applications

Paper PDF CRS4 Website

@inproceedings{TYSJSAPGSA24,
 author       = {Tukur, M. and Yehia, B. and Sara, J. and Jaspe Villanueva, A. and Shah,
 U. and Alzubaidi, M. and Pintore, G. and Gobbetti, E. and Schneider, J. and Agus, M.},
 title        = {Virtual Staging Technologies for the Metaverse},
 booktitle    = {Proc. IEEE iMeta},
 year         = {2024},
 publisher    = {IEEE},
 note         = {To appear},
 }

Abstract

We discuss virtual staging technologies, focusing on two primary pipelines for creating and exploring immersive indoor environments in the metavers: an AI-based image processing pipeline and a LIDAR-based pipeline. The AI-based image processing pipeline leverages advanced AI algorithms for tasks such as clutter removal, semantic style transfer, and super-resolution, enabling rapid generation of high-quality, photorealistic virtual environments from single panoramic images. The LIDAR-based pipeline captures measurable 3D models of indoor spaces, facilitating immersive editing and collaborative design through real-time interaction with high-fidelity virtual environments. A qualitative comparative analysis of these technologies highlights their strengths and limitations in various applications. The practical implications of these pipelines are discussed, particularly their potential to transform industries such as real estate, furniture retail, interior design, construction, remote collaboration, and immersive training. The paper concludes with suggestions for future research, including conducting user studies, integrating the two pipelines, and optimizing technologies for mobile and edge devices to enhance accessibility and usability.