SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness & LLM Reasoning
SituationAdapt optimizes Mixed Reality UIs with situation awareness for dynamic environments. Integrating a VLM for reasoning about layout suitability, our method considers environmental & social cues for the optimization. #UIST2024
more information: https://siplab.org/projects/Situation...
publication:
Zhipeng Li, Christoph Gebhardt, Yves Inglin, Nicolas Steck, Paul Streli, Christian Holz. SituationAdapt: Contextual UI Optimization in Mixed Reality with Situation Awareness via LLM Reasoning. In Proceedings of ACM UIST 2024.
Sensing, Interaction & Perception Lab
Department of Computer Science
ETH Zürich, Switzerland
#virtualreality #mixedreality #optimization #productivity #UIlayouts #usability