Handle 3D objects in VR like Tony Stark (Iron Man)

Are you the one beefing with the lack of actual interaction within VR training? High five in the air, we are on your side. While we try our best to re-create you the environment that is closest to the actual real-world using 360° videos and photos, we see the limitation of visual depth cues in these virtual environments.

In most of the VR training, interactions are limited to clicking on a 2D object and… that’s it. While we were discussing with our clients and observing the interactions during their VR training, we were convinced that the User Interface (UI) was not as natural as we would like it to be. We see limitations on user interactions and complicated operational skill application. To achieve NUI (Natural User Interface), thus a truly immersive virtual environment, we think that grabbing and manipulating 3D objects is essential. For this reason, our development team has been working really hard to overcome the constraints and unleash the true power of VR for you. Long story short, we have succeeded in making your  VR training 2x more immersive by hybridizing the 3D and 360 environments under one roof, following with the ability to manipulate 3D objects 😊

Being able to interactwith 3D object is a real game changer, now everyone can be Iron Man.

Here is a summary of what we can do with the new 3D objects handling feature, using 3DoF or 6DoF controller

3DoF controller (e.g. for Oculus Go):

• Lower NUI as there are only 1 natural rotation along with 2 translations performing with the touchpad
• Basic interactions such as grabbing, rotating and releasing objects by pressing the button of the controller
• Ability to observe different sides of a 3D object in their own perspective

6DoF controller (e.g. for Oculus Quest):

• High NUI which allows natural and Intuitive controls for interacting with virtual objects
• Natural interactions such as grabbing, rotating and releasing objects, similar to how they are performed in reality (except you don’t feel the actual weight sorry).
• Ability to observe different sides of a 3D object in their own perspective
• In one word, Observe and Interact! (Alright there are 3 words)

By uncovering this challenge / opportunity, your VR training will be more visually stunning and interactive.

Here are 3 reasons why 3D objects handling is powerful for training.

Create muscle movement memory through practice

We believe everyone agrees that VR improves training effectiveness, as it allows the learner to practice the needed skills in a safe virtual environment until they mastered them. With the ability to manipulate 3D objects, you are not only training your brain muscle but also creating actual muscle movement memory. For example, you can manipulate virtual equipment by turning the handle, rotating the crankshaft, pulling and attaching the connecting rod, assembling two parts together and so on. In other words, it improves overall recall and retention. Bonus point, more calories will be burnt.

Bridge the gap between the real world and the learner’s imagination

Another advantage of 3D objects handling in VR is that, it allows the learner to visualize the object in 1:1 scale in detail. It is particularly useful in the training of equipment use, when you would be presented with equipment parts to examine and to assemble. With the ability to virtually touch the parts in real scale, your VR training will be more effective.

Unlike 3D animation training video, the learner is fully immersed in a 360 environment with the ability to grab and move 3D objects. They engage actively in the training and take needed actions to complete the task. It is like a game, but educational. This is the solution to turn a serious yet monotonous training (such as Health and Safety training, no offense) into a fun and engaging one.

Above, it is a quick demo we have done with Schneider Electric.