Augmented Reality, Machine Learning
About This Project

Augmented reality empathetic operating system design for Arctop Inc. Brain Computer Interface company.


While working as Head of Experience at Arctop, one of my core projects was envisioning and designing the future uses of the technology for AR – a system that could directly understand the intent and emotional state of the user. At the time there were few any design patterns for augmented reality, and even less examples of brain controlled interface design.


This led me to examine question about 3D interfaces, spatially aware and context driven design, and questions of empathy in human computer interaction. Drawing from my experience in HCI research and inspired by film and game design, we began a series of user interface experiments in the development of experiences and interactions and demos that we developed in house.


Based on this qualitative user data from different projects, I designed the first prototype of the Neuos Operating System. This design combines elements of natural language communication, context aware options for direct selection by users, with emotional empathetic response by the system.


The Neuos core can appear when summoned or appropriate to give information, ask questions and offer options, either around the user or near objects of interest.


As with all design for augmented reality, it was important to keep the design as clean and minimal as possible, with high contrast, so as to give the information necessary in context and be as unobtrusive as possible when not needed, as the user is using the system while engaged with reality.


Developed in Unity for Microsoft Hololens.