As the next generation of computer interface emerges, it is important for our clients to adapt the technology. In response to this VirtuLabs has researched and developed methods of interaction for financial software in augmented and virtual reality.
We explored the language of communicating data in 3D to understand ways to take advantage of all dimensions in augmented reality and virtual reality to deliver information based on the user’s perspective, interest, and urgency.
Creating a mechanism to become aware of the user’s intention by analyzing the gaze through reactive design, we achieved developing a complex system for demonstrating massive amount of data and organizing it in a spatial system. The user could walk through and explore the data, click, move and interact with different data visualizations. Moving through space was used to provide different levels of detail for specific data through Z axis.
A simple case study which allows the user to roam freely using an IOS device to scan the environment. Once a virtual object is within reach, the user can then interact with it using touch controls. In this case, a score is tallied and each object. Materials were created inside substance painter and an HDR environment map was made on-site which gave the virtual objects a real reflection of the players surroundings. Animation and export was through Unity 2017.
As part of their R&D initiatives, VirtuLabs has been helping Pillantas on prototyping various eye-tracking concepts, with a focus on applications that range from social media to augmented reality. Among these projects are the eye-controlled Snapchat glasses and a shared reality Hololens experience, which allows users to control physical objects, such as drones, with eye gestures in an augmented reality environment.
Furthermore, Pillantas has been exploring the use of Unity3D and eye-tracking technology for medical purposes. This groundbreaking approach enables healthcare professionals to interact with complex 3D models, simulations, and medical imaging data using only their eyes, thereby increasing efficiency and reducing the risk of contamination.
Additionally, Pillantas has been investigating the potential of eye-tracking technology in gaming. By incorporating this technology into popular game engines like Unity3D, Pillantas envisions a future where gamers can control and manipulate in-game objects using only their eyes. This innovative control scheme not only enhances immersion and gameplay but also opens up new possibilities for accessibility in gaming, catering to users with physical disabilities.
Pillantas' R&D portfolio showcases the immense potential of eye-tracking technology across various sectors, from healthcare to gaming. By pushing the boundaries of this technology, Pillantas is contributing to a more inclusive and interactive future for all.
We had the opportunity to speak at OFFF 2016 - Digital Design Days in Milan, where Sorob talked about the future of responsive environments. The talk was done through a Hololens where the mixed reality of the audience and the presentation content was projected on the screen.
