Skip to content

Fusion Tracking

Experimental feature

Fusion tracking is released with limited functionality. As a result, its performance and quality may not match that of other features in this product. User experience can vary significantly based on the hardware and software versions in use. Please consider these variables when using the feature.

Fusion Tracking is a powerful feature of our AR tracking framework, VIRNECT Track. It enables the simultaneous usage of the VIRNECT Track framework with other device embedded tracking technologies.

This unlocks a lot of potential for using the best of both worlds. Environmental perception and device optimized code of the native tracking frameworks in combination with the versatile and powerful object tracking capabilities of VIRNECT Track.

Fusion Tracker Sample on Android: The floating axis visualization on the right hand side indicates the origin of the AR Core environment. The VIRNECT Track targets are locked in place and can be tracked along with the environment. Therefore they are robust against occlusion and will keep their position even if they are no longer in view.

Key Features

  • Seamless Integration: The Fusion Tracker Mode seamlessly integrates with existing tracking technologies, allowing you to combine the strengths of different tracking methods. On native mobile platforms the Fusion Tracker supports ARCore on Android. On Unity, the Fusion tracker mode is fully compatible with the AR Foundation Package utilizing ARCore on Android or ARKit on iOS.

  • Improved Accuracy: By leveraging multiple tracking technologies, the Fusion Tracker Mode enhances the accuracy of object tracking, resulting in more precise and reliable AR experiences.

  • Dynamic Tracking: With the Fusion Tracker Mode, you can dynamically switch between different tracking technologies based on the availability and suitability of each method, ensuring optimal tracking performance in various scenarios.

  • Automatic Calibration: To ensure best quality tracking the fusion process utilizes the camera calibration data of the native device implementation.

  • Efficient Processing: Once the Track target is fused and locked in position, the Track framework will stop processing to avoid unnecessary load. Once the target is "unlocked", Track will start tracking again.

How to Enable Fusion Tracker Mode

To enable the Fusion Tracker Mode within our Unity package, please refer to the documentation here.

With the Android library, the Fusion Tracker Mode can be achieved by using the ARCore native implementation and forwarding the processed image to our framework.

Limitations

While the Fusion Tracker Mode offers significant advantages, it's important to be aware of its limitations:

  • Drift: The AR origin provided by the other Tracking Technologies might drift over time. The pose of the Track target might need to be reset sometimes to maintain perfect alignment.

  • Compatibility: Not all tracking technologies may be compatible with the Fusion Tracker Mode. Make sure to check the compatibility of the desired tracking methods before attempting to use them together.

  • Resource Requirements: Fusion tracking may require additional computational resources compared to using a single tracking technology. Ensure that your hardware can handle the increased resource demands.

  • Integration Challenges: Integrating multiple tracking technologies is very complex and may require additional development effort. At the current stage of development we can not guarantee that the fusion tracking will work on all systems and software versions.