A Proposed Meta-Reality Immersive Development Pipeline: Generative AI Models and Extended Reality (XR) Content for the Metaverse
Open Access
- 1 January 2023
- journal article
- research article
- Published by Scientific Research Publishing, Inc. in Journal of Intelligent Learning Systems and Applications
- Vol. 15 (01), 24-35
- https://doi.org/10.4236/jilsa.2023.151002
Abstract
The realization of an interoperable and scalable virtual platform, currently known as the “metaverse,” is inevitable, but many technological challenges need to be overcome first. With the metaverse still in a nascent phase, research currently indicates that building a new 3D social environment capable of interoperable avatars and digital transactions will represent most of the initial investment in time and capital. The return on investment, however, is worth the financial risk for firms like Meta, Google, and Apple. While the current virtual space of the metaverse is worth $6.30 billion, that is expected to grow to $84.09 billion by the end of 2028. But the creation of an entire alternate virtual universe of 3D avatars, objects, and otherworldly cityscapes calls for a new development pipeline and workflow. Existing 3D modeling and digital twin processes, already well-established in industry and gaming, will be ported to support the need to architect and furnish this new digital world. The current development pipeline, however, is cumbersome, expensive and limited in output capacity. This paper proposes a new and innovative immersive development pipeline leveraging the recent advances in artificial intelligence (AI) for 3D model creation and optimization. The previous reliance on 3D modeling software to create assets and then import into a game engine can be replaced with nearly instantaneous content creation with AI. While AI art generators like DALL-E 2 and DeepAI have been used for 2D asset creation, when combined with game engine technology, such as Unreal Engine 5 and virtualized geometry systems like Nanite, a new process for creating nearly unlimited content for immersive reality is possible. New processes and workflows, such as those proposed here, will revolutionize content creation and pave the way for Web 3.0, the metaverse and a truly 3D social environment.Keywords
This publication has 26 references indexed in Scilit:
- NVIDIA A100 Tensor Core GPU: Performance and InnovationIEEE Micro, 2021
- AI Explainability. A Bridge Between Machine Vision and Natural Language ProcessingPublished by Springer Science and Business Media LLC ,2021
- A rapid and cost-effective pipeline for digitization of museum specimens with 3D photogrammetryPLOS ONE, 2020
- Artificial Intelligence: State of the ArtPublished by Springer Science and Business Media LLC ,2019
- Topology Control and Simplification of Reality-based Meshes for Finite Element AnalysisPublished by U-turn Press LLC ,2019
- Performance Simulation Integrated in Parametric 3D Modeling as a Method for Early Stage Design Optimization—A ReviewEnergies, 2017
- A System for High-Resolution Topology OptimizationIEEE Transactions on Visualization and Computer Graphics, 2015
- Sketching, scaffolding, and inkingPublished by Association for Computing Machinery (ACM) ,2007
- Geometric surface processing via normal mapsACM Transactions on Graphics, 2003
- A dynamical systems perspective on agent-environment interactionArtificial Intelligence, 1995