Programmable Reality Lab

A simple graphic in three sections labeled Today's Interfaces, Augmented Reality and Reconfigurable Reality, with the latter two grouped and labeled "Programmable Reality"

Today we program computers we live with.
Tomorrow we program the whole environment we live in.

The goal of Programmable Reality Lab is to make our whole living environment dynamic, interactive, and programmable. With that, we envision to transform our living space into a dynamic medium―instead of constraining ourselves into a flat rectangle screen, we envision to make our entire world a dynamic and expressive canvas, as if we are living in a computer, rather than we are living with computers. Towards this seamlessly coupled digital and physical world, we pursue both visually and physically programmable reality by exploring novel interactive technologies enabled by AR/VR, robotics, and shape-changing interfaces.

Programmable Reality Lab News

Programmable Reality Lab Director

Programmable Reality Lab Associated Researchers

Programmable Reality Lab Publications

Aditya Gunturu, Ben Pearman, Keiichi Ihara, Morteza Faraji, Bryan Wang, Rubaiat Habib Kazi and Ryo Suzuki. 2025. "MapStory: Prototyping Editable Map Animations with LLM Agents". In: ACM Symposium on User Interface Software and Technology (UIST'2025) (Busan, Republic of Korea, Sep 28 - Oct 1, 2025)

Kentaro Takahira, Yue Yu, Takanori Fujiwara, Ryo Suzuki and Huamin Qu. 2025. "InSituTale: Enhancing Augmented Data Storytelling with Physical Objects". In: Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST'2025) (Busan, Republic of Korea, Sep 28 - Oct 1, 2025)

Ada Yi Zhao, Aditya Gunturu, Ellen Yi-Luen Do and Ryo Suzuki. 2025. "Guided Reality: Generating Visually-Enriched AR Task Guidance with LLMs and Vision Models". In: ACM Symposium on User Interface Software and Technology (UIST'2025) (Busan, Korea, Sep 28 - Oct 1, 2025)

Riku Arakawa, Franklin Mingzhe Li, Nandi Zhang, Mina Huh, Amy Pavel, Ryo Suzuki, Patrick Carrington, and Yukang Yan. 2025. “Accessible Cyber-Physical Activities”. In: Adjunct Proceedings of the 38th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct '25). (September 27, 2025)

Ryo Suzuki, Parastoo Abtahi, Cheng Zhu-Tian, Mustafa Doga Dogan, Andrea Colaco, Eric J. Gonzalez, Karan Ahuja Mar and Gonzalez-Franco. 2025. “Programmable Reality”. In: Frontiers in Virtual Reality: Augmented Reality Volume 6. (September 8, 2025)

Marcus KE Friedel, Zachary McKendrick, Ehud Sharlin, Ryo Suzuki. 2025. “PantographHaptics: a Technique for Large-Surface Passive Haptic Interactions Using Pantograph Mechanisms”. In: IEEE Transactions on Visualization and Computer Graphics Volume: 31, Issue: 5. (March 21, 2025).

Keiichi Ihara, Kyzyl Monteiro, Mehrad Faridan, Rubaiat Habib Kazi, Ryo Suzuki. 2025. “Video2MR: Automatically generating mixed reality 3D instructions by augmenting extracted motion from 2D videos”. In: IUI '25: Proceedings of the 30th International Conference on Intelligent User Interfaces. (Cagliari, Italy, March 24 - 27, 2025).

Ryo Suzuki, Mar Gonzalez-Franco, Misha Sra, David Lindlbauer. 2025. "Everyday AR through AI-in-the-Loop". In: CHI 2025 Extended Abstract. (Forthcoming.)

Panayu Keelawat, Ryo Suzuki. 2024. "Transforming Procedural Instructions into In-Situ Augmented Reality Guides with InstructAR." In: Adjunct Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST Adjunct 2024). (Pittsburgh, PA, October 13-16, 2024)

Wanli Qian, Chenfeng Gao, Anup Sathya, Ryo Suzuki, Ken Nakagaki. 2024. SHAPE-IT: Exploring Text-to-Shape-Display for Generative Shape-Changing Behaviors with LLMs. In: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024). (Pittsburgh, PA, October 13-16, 2024)

Aditya Gunturu, Yi Wen, Nandi Zhang, Jarin Thundathil, Rubaiat Habib Kazi, Ryo Suzuki. 2024. Augmented Physics: Creating Interactive and Embedded Physics Simulations from Static Textbook Diagrams. In: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology (UIST 2024). (Pittsburgh, PA, October 13-16, 2024)