Editing Reality

Infographic explaining Editing Reality

Editing Reality is a Mixed Reality system which integrates multiple Generative A.I. (GenAI)models. There are three functions: Addition, Erasure, and Modification. These functions are employed to add generated objects to the real environment, hide or subtract actual objects, and alter the real environment. Through the combination of GenAI and Editing Reality, users gain the capability to virtually manipulate reality in real-time with their speech. Editing Reality can potentially be used for interior design, prototyping for products, accessibility use, and also the exploration of security issues in MR.

ACME Lab   Poster

Diagram of Editing Reality

Associated Researchers

Additional Researcher

Yan-Ming Chiou, Pritalee Kadam

Publications

Suibi Che-Chuan Weng, Yan-Ming Chiou and Ellen Yi-Luen Do. 2024. "Dream Mesh: A Speech-to-3D Model Generative Pipeline in Mixed Reality" In: 2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR). (January 17-19, 2024).