Ultraleap launches its fifth-generation hand tracking platform - Gemini
Posted; October 26, 2021
Wednesday 27th October, 2021 From today, Ultraleap’s fifth-generation hand tracking platform, known as Gemini, is fully available on Windows. The most robust, flexible hand tracking ever, it’s already powering amazing experiences from Varjo, been integrated into Qualcomm’s Snapdragon XR2 platform, and is bringing touchless technology to self-service solutions around the world.
The Gemini Windows release is the first step in making the world’s best hand tracking easier to access and more flexible for multiple platforms, camera systems and third-party hardware.
Ultraleap have rebuilt their tracking engine from the ground up to be able to improve hand tracking across various aspects including:
- Improved two-handed interaction
- Faster initialization and hand detection
- Improved robustness to challenging environmental conditions
- Better adaptation to hand anatomy
Ultraleap have also made significant changes to the tracking platform to able to extend hand-tracking to different platforms and hardware. Varjo’s XR-3 and VR-3 headsets and Qualcomm’s XR2 chipset are two variations already announced, with more in the pipeline.
Tom Carter, CEO of Ultraleap, said: “From powering immersive XR experiences, to providing quick and easy engagement with digital screens, Gemini is making natural interaction between people and technology possible. Robust, accurate hand tracking is one of the biggest challenges in 21st century computing. With ten years of ongoing developer support, experimentation, and feedback, we’ve refined our hand tracking to deliver the best and most flexible hand tracking available. We are incredibly proud of the progress we have made, and we are looking forward to working with software and hardware partners to bring hand tracking to the masses.”
Hand tracking will be to XR what touchscreens were to mobile
The Windows release is the first time full Gemini has been made available to all and the first full hand tracking release from the company in three years. Since a preview of the release went out earlier in the year, Ultraleap have been further refining the software ahead of full launch.
The improved features are applicable to a range of use cases where Ultraleap hand tracking is already making an impact:
- Using hand tracking instead of VR controllers is making a big difference to Pre-Flight Cabin Check training for Lufthansa
- Being able to interact naturally with two hands matters for ergonomic and design reviews in Autodesk’s VRED
- Accommodating different sizes and shapes of hands matters for VR arcade experiences like Raw Thrills
- Fast, reliable initialization matters for projects such as Embodied Labs’ VR empathy training
- Social collaboration is being taken to the next level as users can freely motion and accentuate their language with their hands, as they do in real life
As part of the release, Ultraleap are also showcasing a new XR Launcher experience which will show how VR can be made accessible to more people by enabling and empowering them to use their hands naturally, with no controllers needed.
Accurate and robust hand tracking for touchless kiosk and OOH use cases
In Out of Home (OOH), Ultraleap’s hand tracking alongside the TouchFree application, is fuelling the demand for touchless interaction.
With this latest hand tracking update, Ultraleap’s recommended camera position is enabled – Above Facing User. This camera position will support more aesthetically pleasing set ups, easier integration and a longer life of the installation.
To download Gemini, please visit: https://developer.leapmotion.com/tracking-software-download
To download TouchFree, please visit: https://developer.leapmotion.com/touchfree Note that Gemini is not compatible with previous versions of TouchFree. If you want to take advantage of Gemini hand tracking in touchless kiosks, you’ll need to upgrade to TouchFree 2.1.
For developer documentation, guidelines and support, please visit: https://docs.ultraleap.com/
– ENDS –
Ultraleap’s world-leading hand tracking and unrivalled mid-air haptic technologies allow you to engage with the digital world naturally - without touching surfaces. No touchscreens. No controllers. No keypads. From enhancing 2D screens to developing fully immersive 3D experiences, Ultraleap powers natural, safe and effortless digital interaction in the increasingly connected world.
Ultraleap employs more than 150 people across Europe, North America and Asia. It has become the first to offer the full vertical stack of software and hardware to enable spatial computing for the automotive, out of home, industrial, XR, entertainment and medical sectors.
(Interviews available on request).