Leap Motion hands-on

The Verge
26 Jun 201205:00

TLDRIn this Leap Motion hands-on demo, David Holes, the CTO of Leap Motion, introduces a next-generation 3D motion sensing device. He demonstrates its ability to track 10 fingers in real time, capturing even subtle hand movements. The device can map hand motions onto a virtual touchscreen, enabling precise interactions, drawing, and manipulating objects in 3D space. It's highly responsive, offering natural and intuitive control, including pinch-to-zoom and multi-hand gestures. The demo showcases potential applications in drawing, rotating objects, and more, highlighting the future of touchless, immersive interactions with technology.

Takeaways

  • 🎮 Leap Motion is developing a next-generation 3D motion sensing device.
  • ✍️ The device is fast and responsive, allowing for precise input down to millimeters.
  • 🖐️ It can track all 10 fingers and capture subtle hand movements.
  • 📐 The system supports drawing in the air, with accurate tracking in 3D space.
  • 📱 The technology works with existing touch applications by simulating a virtual touchscreen.
  • 🖊️ Leap Motion can recognize tools like pencils and markers, enabling more dynamic input.
  • 📦 The device offers multi-hand and multi-object tracking, supporting simultaneous actions like drawing and rotating.
  • 🛠️ An app store will be available for specialized apps tailored to Leap Motion's capabilities.
  • 💡 It senses not just the position of a tool but also its orientation, useful for tasks like writing cursive.
  • 🤯 Leap Motion creates a highly intuitive experience, allowing users to interact with virtual spaces naturally, without needing to think about specific gestures.

Q & A

  • What is Leap Motion's primary product?

    -Leap Motion's primary product is a next-generation 3D motion sensing device.

  • What kind of demonstrations does Leap Motion typically start with?

    -Leap Motion usually starts with simple demonstrations like 2D drawing to showcase the responsiveness and precision of their device.

  • How fine is the precision of the Leap Motion device?

    -The Leap Motion device can recognize motions as small as a few millimeters and can track each square of just one centimeter.

  • What does the demo version of Leap Motion's device plug into?

    -The demo version of Leap Motion's device plugs into a computer.

  • How many fingers can the Leap Motion device recognize?

    -The Leap Motion device can recognize all 10 fingers.

  • Can the Leap Motion device track subtle motions?

    -Yes, the Leap Motion device can track very subtle motions of the fingers.

  • What is the capability of the Leap Motion device in terms of 3D tracking?

    -The Leap Motion device can track in 3D, allowing users to draw in the air, rotate objects, and perform other 3D interactions.

  • Can the Leap Motion device support multiple hands and tools simultaneously?

    -Yes, the Leap Motion device can support multiple hands and tools at the same time, allowing for complex interactions.

  • What kind of applications can be made backward compatible with Leap Motion's technology?

    -Legacy touch applications can be made backward compatible with Leap Motion's technology by projecting a virtual touchscreen.

  • Will there be a specialized app store for Leap Motion's device?

    -Yes, there will be a specialized app store for apps that are designed for or compatible with Leap Motion's device.

  • How does the Leap Motion device handle the direction of a pen or tool?

    -The Leap Motion device can sense the direction of a pen or tool, allowing for natural interactions like writing in cursive.

  • What is the potential of the Leap Motion device in terms of gaming?

    -The Leap Motion device offers high accuracy and responsiveness, making it suitable for precise gaming interactions like slicing fruit in a game.

Outlines

00:00

🎮 Introduction to Leap Motion and Its Capabilities

David Holes, CTO of Leap Motion, introduces a next-generation 3D motion sensing device that offers precise motion tracking. He explains how the device enables fast and responsive 2D drawing with fine details. It detects even small hand movements, allowing users to create intricate drawings, like writing 'hello' within a few millimeters. This early demo showcases the technology's potential, though the final version promises even greater accuracy.

🖐️ Hand and Finger Recognition in 3D

The Leap Motion device can track all 10 fingers, accurately capturing the shape and subtle movements of each hand in real time. David demonstrates drawing spirals in 3D space, emphasizing how the device can track multiple fingers and their motions. The device enables complex interactions like pinch-to-zoom, multi-hand gestures, and spatial manipulation, all rendered in 3D. This offers a more dynamic and natural interface for users.

🖱️ Effortless Backwards Compatibility for Touch Applications

David discusses how Leap Motion integrates with existing touch-based applications without the need for specialized development. The system projects a virtual touchscreen, simulating touch input for legacy applications. Users can interact with these apps by pointing and manipulating objects in 3D space as if they were touching a screen. The system supports simultaneous use of hands and tools, expanding its functionality for various creative and practical tasks.

✍️ Precision Interaction with Objects and Tools

The Leap Motion device can differentiate between various objects, such as pencils or markers, allowing users to perform specific tasks like drawing or writing. David demonstrates how the device senses not only the position but also the orientation of a pen, which enhances precision for tasks like writing in cursive. This level of detail surpasses traditional touchscreens, offering more intuitive and fluid control over interactions.

🌐 Combining Accuracy with Efficiency for Broader Applications

David highlights the efficiency of Leap Motion's input system, where small hand movements can control large areas on a screen. This precision allows users to cover an entire screen with just minimal wrist movement, combining the connected feel of a touchscreen with the speed and accuracy of a mouse. The balance of accuracy and efficiency opens up new possibilities for user interfaces, blending touch and pointer-based interactions.

🍉 Immersive Virtual Interaction and Spatial Manipulation

David expresses excitement about the immersive nature of the Leap Motion device, allowing users to manipulate objects in virtual space as if they were physically interacting with them. He demonstrates how users can grab, rotate, and move objects in 3D, creating a seamless and intuitive experience that feels natural. The ability to reach into virtual space and interact with digital objects opens up new possibilities for gaming, design, and beyond.

🤲 Intuitive Object Manipulation in 3D Space

As users interact with objects using Leap Motion, the device moves beyond simple gestures to offer direct manipulation of virtual objects. David explains how users can flick, rotate, and manipulate objects without thinking about specific gestures, making the experience intuitive. The device provides a more natural way of interacting with computers, where users engage with objects as if they are physically present, bypassing traditional control methods.

🚀 Revolutionary User Experience with Leap Motion

David shares his excitement about the potential of Leap Motion, emphasizing how it changes the way users interact with computers. The device allows for unprecedented levels of precision and control, making interactions feel intuitive and natural. He reflects on how this technology provides a new kind of user experience that transcends traditional input methods, enabling a more direct and tactile connection with digital environments.

Mindmap

Keywords

💡Leap Motion

Leap Motion is a next-generation 3D motion-sensing device that allows users to control a computer using hand gestures in the air. In the video, it is presented as a cutting-edge technology that can recognize and track hand movements with precision, offering a new level of interaction with digital environments.

💡3D Motion Sensing

3D motion sensing refers to the ability to detect and track movements in three-dimensional space. Leap Motion's technology is described as capable of sensing the shape and movement of the user’s hands and fingers, enabling actions such as drawing in the air or manipulating virtual objects, providing a more immersive experience.

💡Fine Motion Tracking

Fine motion tracking is the capability of the Leap Motion device to detect subtle and precise movements. As demonstrated in the video, the device can track individual finger movements down to a few millimeters, allowing the user to draw or interact with extreme accuracy, far beyond typical broad gesture recognition.

💡Virtual Touchscreen

A virtual touchscreen is a simulated touchscreen environment created by Leap Motion, which allows the user to interact with traditional touchscreen-based applications without physically touching a screen. In the video, it is shown how the Leap Motion system can project a virtual touchscreen in the air, enabling the user to interact with touch applications by simply pointing and gesturing.

💡Backward Compatibility

Backward compatibility in this context refers to the ability of the Leap Motion device to work with existing applications designed for touchscreens. The video highlights how Leap Motion can simulate a virtual touchscreen, making it compatible with legacy touch-based applications without requiring new software development or special adaptations.

💡Dynamic Feedback

Dynamic feedback is the real-time response the Leap Motion system provides based on user input. Instead of relying on predefined gestures, the system reacts to the user's movements, offering immediate visual or functional feedback. In the video, this is illustrated when the device shows the user’s actions as they interact with the virtual space, making the experience more intuitive.

💡Pinch to Zoom

Pinch to zoom is a gesture-based command that allows users to zoom in and out by pinching their fingers together or spreading them apart. Leap Motion supports this gesture and more, using 3D hand tracking to enable users to zoom in or out while interacting with virtual environments, as demonstrated in the video.

💡Multiple Hand Tracking

Multiple hand tracking is the ability of the Leap Motion device to track both hands simultaneously, enabling more complex interactions. In the video, the presenter shows how one hand can be used to draw while the other hand rotates the virtual object or page, enhancing the depth and fluidity of the interaction.

💡Object Recognition

Object recognition refers to the Leap Motion system’s capability to detect and differentiate between various objects, such as hands and tools. In the video, examples are given of how the system can map a pencil or marker for drawing, demonstrating the potential for more interactive and detailed user experiences.

💡Natural Interaction

Natural interaction describes how Leap Motion enables users to interact with virtual objects in a way that mimics real-world physical interactions. Instead of using abstract gestures or buttons, users can manipulate objects in 3D space with intuitive hand movements, such as grabbing, rotating, and flicking, as shown in the video. This creates a more immersive and user-friendly experience.

Highlights

Leap Motion is developing a next-generation 3D motion sensing device.

The device allows for fast and responsive 2D drawing with precision down to a few millimeters.

The demo version of the device is significantly less capable than the final version.

The device can recognize all 10 fingers and their individual shapes.

It can detect very subtle motions of the fingers.

The device supports 3D tracking and allows for actions like drawing spirals and rotating in the air.

Multiple fingers and hands can be tracked simultaneously.

The technology enables pinch-to-zoom and other touch-associated actions.

The device offers dynamic feedback, showing what you're doing rather than instructing how to do it.

It provides effortless backward compatibility with legacy touch applications.

The device can map a pencil to drawing and a marker to marking.

It allows for the use of multiple hands and tools simultaneously.

The device can detect the direction of a pen, not just its location.

It offers a specialized app store for apps made for the device.

The device can sense the direction of the pen, allowing for cursive writing.

It provides a connectedness similar to touch with the responsiveness of a mouse.

The device allows for reaching into virtual space and moving things in a natural, physical way.

It enables intuitive manipulation of objects as if they were in your hands.

The device offers a novel interaction with computers, making it feel like moving objects between fingertips.