Leap Motion Explained

Leap Motion, Inc.
Location:San Francisco, California, United States
Industry:Motion control
Foundation:2010
Fate:Acquired in 2019 (by Ultraleap)

Leap Motion, Inc. (formerly OcuSpec Inc.)[1] was an American company that manufactured and marketed a computer hardware sensor device that supports hand and finger motions as input, analogous to a mouse, but requires no hand contact or touching. In 2016, the company released new software designed for hand tracking in virtual reality. The company was sold to the British company Ultrahaptics in 2019,[2] which rebranded the two companies under the new name Ultraleap.[3]

History

The technology for Leap Motion was first developed in 2008, while co-founder David Holz was studying for a Ph.D. in mathematics.[4] [5] Holz co-founded the company with Michael Buckwald in 2010.[6] The company raised a $1.3 million seed financing round in June 2011 with investments from venture capital firms Andreessen Horowitz, Founders Fund, and SOSV, as well as several angel investors.[7] In May 2012, Leap Motion announced a $12.75M Series A funding round led by Highland Capital Partners.[8] In January 2013, Leap Motion announced a further series B round of funding for $30M.[9]

After operating in quiet since 2010, Leap Motion publicly announced its first product, originally called The Leap, on May 21, 2012. The company launched a software developer program in October 2012[10] and distributed roughly 12,000 units to developers interested in creating applications for the device. While the device was slated to launch in May 2013, full-scale shipping was later delayed until July. In March 2014, it was reported in TechCrunch that roughly 500,000 units had been sold, far short of initial expectations; as a result, Leap Motion announced layoffs for 10 percent of its workforce, primarily in sales and marketing.[11]

On April 7, 2014, COO Andy Miller left the company.[12] In May 2014, Leap Motion released its version 2 software to developers in a public beta.[13] [14] [15] In August 2014, the company launched a VR tracking mode for its core software, designed to provide hand tracking while the device is mounted on virtual reality headsets such as the Oculus Rift.[16] [17] Later that year, Leap Motion launched a global game jam in partnership with independent games festival IndieCade with over $75,000 in prizes. The competition received over 150 submissions.[18] A second competition in 2015 resulted in 189 entries.[19] In March 2015, it was announced that the upcoming OSVR Hacker Development Kit would include an optional faceplate with embedded Leap Motion module.[20] In February 2016, Leap Motion released new software, called Orion, built for use in VR.[21]

In May 2019, Leap Motion was acquired by Ultrahaptics; the combined company was named 'Ultraleap'. The reported sale price was $30 million - about 10% of the company's peak valuation of $300 million reached in 2013.[22] [2]

Ultraleap continued to develop the Leap Motion technology, supporting Android with the release of Gemini[23], and later expanding the computer vision functionality with Hyperion[24] . Shortly after the launch of Hyperion in June 2024, the company announced plans to half its workforce and sell off the Leap Motion technology once more. As of August 2024 they are still looking for a buyer.[25]

Partnerships

Leap Motion partnered with ASUS who was expected to ship high-end notebooks, and all-in-one PCs (AIO PCs) with the technology later in 2013.[26] Leap Motion also announced a deal with Hewlett Packard to embed its technology within HP computers.[27] In December 2013, it was reported Leap Motion would be embedded into eleven HP devices, including keyboards and laptops.[28]

Leap Motion has formed retail partnerships with Best Buy, Newegg, and Amazon.com.[29] Leap Motion Controllers were sold by Dick Smith in Australia and New Zealand.[30] [31]

Technology

The Leap Motion Controller is a small USB peripheral device which is designed to be placed on a physical desktop, facing upward. It can also be mounted onto a virtual reality headset. Using two monochromatic IR cameras and three infrared LEDs, the device observes a roughly hemispherical area, to a distance of about 1 meter. The LEDs generate pattern-less IR light[32] and the cameras generate almost 200 frames per second of reflected data.[33] This is then sent through a USB cable to the host computer, where it is analyzed by the company software using "complex maths" in a way that has not been disclosed by the company, in some way synthesizing 3D position data by comparing the 2D frames generated by the two cameras.[34] [35] In a 2013 study, the overall average accuracy of the controller was shown to be 0.7 millimeters.[36]

The smaller observation area and higher resolution of the device differentiates the product from the Kinect, which is more suitable for whole-body tracking in a space the size of a living room.[37] In a demonstration to CNET, the controller was shown to perform tasks such as navigating a website, using pinch-to-zoom gestures on maps, high-precision drawing, and manipulating complex 3D data visualizations.

Leap Motion initially distributed thousands of units to developers who are interested in creating applications for the device. The Leap Motion Controller was first shipped in July 2013.[38] In February 2016, Leap Motion released a major beta update to its core software. Dubbed Orion, the software is designed for hand tracking in virtual reality.[39] [40]

Developer community

In December 2013, Founders Fund and SOSV announced the LEAP.AXLR8R, a business accelerator for startups making innovative use of the Leap Motion controller.[41] [42] Projects emerging from the accelerator included Diplopia (now Vivid Vision), a tech startup using the Leap Motion Controller and Oculus Rift for lazy eye sufferers,[43] [44] [45] and MotionSavvy, which is developing a Leap Motion-equipped tablet case that can interpret American Sign Language.[46] [47]

Leap Motion had an app store called Airspace where it sold apps made by developers.[48] [49] As of May 2014, the store had over 200 apps, including a Google Earth integration,[50] [51] virtual clay sculpting app,[52] [53] digital musical instrument,[54] and virtual reality demos.[55] The store and client were officially retired on June 30, 2017.[56] The URL to the store now redirects to the Leap Motion gallery.

The Leap Motion Controller has also been used by surgeons and researchers for medical software,[57] [58] [59] automotive companies for concept cars,[60] and musicians for composition in Ableton Live.[61] In 2016, AltspaceVR added hand tracking support for the Leap Motion Controller to their online social platform.[62] [63]

In a video, Uriel Yehezkel demonstrated using the Leap Motion controller and GECO MIDI to control Ableton Live with hand gestures.[64] [65]

Reception

On July 22, 2013, the controller was released to pre-order customers to mixed reviews.[66] [67] To some reviewers, the product feels underwhelming and does not live up to the hype. It is an "admirable distraction but not useful for truly productive usage" and to some it feels as though they "experienced a gimmick". Some reviews have expressed cautious optimism about the product's success and innovation.[68] [69] [70] To other reviewers, the Leap Motion Controller seemed "pretty damned impressive" and that the device "demonstrates Leap Motion’s impressive mastery of computer vision."[71] [72] While the Orion software offers improvements in tracking and as the system continues to improve, some users feel that "it fails just often enough to undercut its value as an interface."[73]

The Orion beta works on the existing peripheral, and the company also announced that Orion hardware would be embedded in future virtual reality headsets .

External links

Notes and References

  1. News: Leap Motion Sets Deal With Asustek, Gets $30M Venture Capital. 2013-01-04. International Business Times. 2018-11-15.
  2. News: Leap Motion, Once a Virtual-Reality High Flier, Sells Itself to U.K. Rival . Parmy . Olson . 2019-05-30 . Wall Street Journal . 2020-01-15 .
  3. Web site: Official Website of Ultraleap . 2020-01-15 .
  4. Web site: One Giant Leap for Mankind . Nicole Marie . Richardson . 2013-05-28 . Inc.com . 2014-08-15 . Holz began developing the software back in 2008 while he was studying for a Ph.D. in mathematics at the University of North Carolina at Chapel Hill. Frustrated by the limitations of the mouse and keyboard, he spent nearly five years developing the cameras in the controller. By the time he paired up with Buckwald, a childhood friend and entrepreneur, Holz had a prototype. [...] .
  5. Web site: Will These Guys Kill The Computer Interface As We Know It? . Tom . Foster . 2013-07-22 . . 2014-08-15 .
  6. Web site: Company Overview of Leap Motion, Inc.. www.bloomberg.com. 2018-12-03.
  7. Web site: OcuSpec Raises 1.3M From Andreessen And Others To Build An "Affordable Kinect" . Alexia . Tsotsis . 2011-06-10 . . 2012-05-23 . Stealth motion control startup OcuSpec has just raised a $1.3 million seed round from Andreesen Horowitz, Founders Fund, SOSventures International and angels Brian McClendon, Bill Warner and others. [...] Leap Motion (previously OcuSpec).
  8. News: Leap Motion Announces $12.75 Million Series A Funding Round Led by Highland Capital Partners . . Leap Motion . 2012-05-09 . 2012-05-23 . Leap Motion, a San Francisco-based motion-control software company changing the future of human/computer interaction, today announced a $12.75 million Series A funding round led by Highland Capital Partners with participation from existing investors..
  9. Web site: Leap Motion Announces $30M Series B Funding And Bundle Deal With ASUS Computers . Anthony. Kosner. 2013-12-06 . . 2013-12-08 . Leap Motion, the startup behind the revolutionary LEAP motion-control device, has secured an additional $30 million in Series B funding, and announced a partnership with ASUS to bundle its controllers with ”new high-end notebooks and premium All-in-One PCs later this year.”.
  10. Web site: Leap Motion launches Software Developer Program and starts sending test units of its 3D controller . Matthew . Panzarino . 2012-10-29 . The Next Web . 2014-08-19 .
  11. Web site: Leap Motion Lays Off 10% Of Its Workforce After Missing On First Year Sales Estimates . Darrell . Etherington . 2014-03-20 . . 2014-08-14.
  12. Web site: Confirmed: Former Apple Exec Andy Miller Out at Leap Motion. Liz. Gannes. recode.net. April 7, 2014.
  13. Web site: Leap Motion's latest motion tracking tech can see your joints . Sean . Buckley . 2014-05-28 . . 2014-08-14.
  14. Leap Motion Adds More-Intricate Tracking to Its Amazing Controller . Tim . Moynihan . 2014-05-28 . . 2014-08-14 .
  15. Web site: Leap Motion Hand Tracking Gets More Realistic To Solve Real World Problems . Anthony . Wing . 2014-05-29 . . 2014-08-14.
  16. Web site: Leap Motion's next sensor is designed specifically for virtual reality. Sean. Buckley. Engadget. AOL.
  17. Web site: CES 2015: Leap Motion Co-Founders Talk 'Dragonfly' Made-for-VR Motion Input Camera. 14 January 2015.
  18. Web site: Leap Motion '3D Jam' Dev Contest Offers $75k in Prizes for Leap-Based Experiences, Starts October 19th - Road to VR. Ben Lang. Road to VR. 10 October 2014.
  19. Web site: Lyra VR puts music synthesis within virtual reach. www.gizmag.com. 13 November 2015. 2016-04-18.
  20. Web site: Winners of Leap Motion '3D Jam' Game Jam Contest Announced - Road to VR. Scott Hayden. Road to VR. 10 January 2015.
  21. Web site: Leap Motion Announces Orion for Faster, More Accurate VR Hand Tracking VRFocus. VRFocus. 2016-04-18.
  22. Web site: Leap Motion, the gesture startup reportedly almost acquired by Apple, sells to UK haptics company. Adi. Robertson. 30 May 2019.
  23. Web site: Ultraleap Gemini Impressions: Great Hand Tracking Is Coming Soon. David. Heaney. 10 January 2022.
  24. Web site: Ultraleap Hyperion Makes The Best Hand Tracking Tech Even Better. David. Heaney. 10 May 2024.
  25. Web site: British tech star Ultraleap to halve workforce in break-up plan. Mark. Kleinman. 27 June 2024.
  26. Web site: ASUS partners up with Leap Motion.
  27. News: Leap Motion seals HP deal to embed gesture control technology. BBC News. 16 April 2013.
  28. Web site: HP embeds Leap Motion gesture control tech in 11 computers . Daniel. Terdiman. 2013-12-09 . . 2013-12-09 . In September, HP said it was incorporating Leap Motion's tech into the Envy 17 laptop, making it the first manufacturer to build the system directly into a computer. This time around, however, HP is embedding the system into stand-alone keyboards, as well as into laptops. All told, the Leap Motion system will be included in eight HP desktop all-in-one machines, and three new desktop PCs..
  29. Web site: HP embeds Leap Motion gesture controller in 11 desktop and all-in-one PCs. Brad. Chacos. 2013-12-06 . . 2013-12-09 . Leap Motion works on any computer, and you can buy the standalone hardware for $80 at Best Buy stores, or online at Newegg, Amazon, or Leap Motion's own website. .
  30. Web site: LDick Smith to exclusively sell Leap Motion . Ross. Catanzariti. 2013-10-10 . . 2013-12-09 . "Dick Smith has more than 270 retail stores, a presence in many high-profile David Jones stores and a popular online retail site, making it the perfect partner for Leap Motion to launch in Australia," he said. .
  31. Web site: Leap Motion 3D Controller Launches in NZ With Dick Smith. Alan. Bell. 2013-04-12 . . 2013-12-09 . Leap Motion have announced the local release details for the Leap Motion 3D controller this morning, revealing the date that it will become available in New Zealand[...]the Leap Motion 3D Controller retails in New Zealand for $159, and can be pre-ordered online at dicksmith.co.nz. .
  32. Analysis of the Accuracy and Robustness of the Leap Motion Controller. 3690061 . 23673678. 10.3390/s130506380. 13. 5. 2013. 6380–93 . Weichert . F . Bachmann . D . Rudak . B . Fisseler . D. Sensors . 2013Senso..13.6380W . free .
  33. Web site: Controller — Leap Motion JavaScript SDK v2.3 documentation. developer.leapmotion.com. 2016-04-18.
  34. Web site: Observation Area.
  35. https://www.youtube.com/watch?v=uF0NSUmxFYA An inside view
  36. Weichert. Frank. Bachmann. Daniel. Rudak. Bartholomäus. Fisseler. Denis. 2013-05-14. Analysis of the Accuracy and Robustness of the Leap Motion Controller. Sensors (Basel, Switzerland). 13. 5. 6380–6393. 10.3390/s130506380. 1424-8220. 3690061. 23673678. 2013Senso..13.6380W. free.
  37. Web site: Leap Motion: 3D hands-free motion control, unbound . Daniel . Terdiman . Daniel Terdiman . 2012-05-20 . Cutting Edge . . 2012-05-23 .
  38. Web site: Etherington. Darrell. Leap Motion Controller Ship Date Delayed Until July 22, Due To A Need For A Larger, Longer Beta Test. AOL. TechCrunch. 2013-04-25.
  39. Web site: Orion is Leap Motion's Overhauled VR Hand Tracking Engine. Lang. Ben. Road to VR. 17 February 2016. en-US. 2016-04-18.
  40. Web site: Leap Motion's new motion-sensing tech is built for VR. Engadget. 2016-04-18.
  41. Web site: Founders Fund and SOSventures launch startup accelerator for Leap Motion's gesture tech . Lauren. Wagner. 2013-12-09 . . 2013-12-08 . Founders Fund and SOSventures have joined to launch Leap Axlr8r –– a startup accelerator for companies building on Leap Motion, the gesture-based technology that’s dictating the future of 3D human computer interaction. .
  42. Web site: Leap Motion Hand Tracking Gets More Realistic To Solve Real World Problems. Anthony Wing Kosner. 29 May 2014. Forbes.
  43. Web site: Using Leap Motion And Oculus Rift, This Game Tries To Correct Lazy Eye. Fast Company. 31 January 2014.
  44. Web site: Oculus VR and Leap Motion used to help people with double vision. ABC7 San Francisco. 11 June 2014.
  45. Web site: 'Diplopia' Becomes 'Vivid Vision', Trials Get Underway - Interview with CEO James Blaha - Road to VR. Brian Hart. Road to VR. 30 March 2015.
  46. Web site: MotionSavvy uses gesture recognition to give sign language a voice. Sean. Buckley. Engadget. AOL.
  47. Web site: MotionSavvy Is A Tablet App That Understands Sign Language. Alexia Tsotsis. AOL. TechCrunch.
  48. Web site: Leap Motion bounding to more HP desktops, all-in-ones with new keyboard . Kevin. Lee. 2013-12-06 . . 2013-12-08 . Users will be able to access Airspace, Leap Motion's own app store, for a (hopefully) expanding number of applications..
  49. Web site: Leap Motion Controller Leaps Forward With Software, Sharpens Focus With Apps . Anthony. Kosner . 2013-11-23 . . 2013-12-08 . This is only the second app produced by Leap Motion that has been released into Airspace. .
  50. Web site: With New Leap Motion Support, Google Earth Lets You Touch The World. Fast Company. 22 April 2013.
  51. Web site: Use Leap Motion with Google Earth. google.com.
  52. Web site: Leap Motion releases Free Form, an app that lets human hands sculpt digital clay (video). Michael Gorman. AOL. Engadget.
  53. Web site: leap Motion survey: A look into the eventual fate of processing. townoftech.com.
  54. Web site: Leap Motion's new Muse app lets you create music with in-air hand gestures. Jackie Dove. 4 April 2014. The Next Web.
  55. An Arty Oculus Trip Through the Large Hadron Collider. 27 October 2014. WIRED.
  56. News: April 29, 2020 . App Store Retirement FAQ . 1 . Leap Motion Support . September 6, 2023.
  57. Web site: "Minority Report" Tech Meets the Operating Room. IEEE. 21 March 2016. 2016-04-18.
  58. Web site: TedCas Integrates Leap Motion Controller with Medical Imaging Systems TEDCAS. www.tedcas.com. 2016-04-18.
  59. Rosa. Guillermo M.. Elizondo. MarÍa L.. Use of a gesture user interface as a touchless image navigation system in dental surgery: Case series report. Imaging Science in Dentistry. 2014. 44. 2. 10.5624/isd.2014.44.2.155. 4061300. 24944966. 155–160.
  60. Web site: Mercedes-Benz unveils its vision of a self-driving car. Engadget. 2016-04-18.
  61. Web site: Ableton's Connection Kit lets you make music with Lego and a banana. Vincent. James. The Verge. 28 March 2016. 2016-04-18.
  62. Web site: AltspaceVR Adds Full Oculus Rift Support (Update: Vive, Too). 2016-04-05. Tom's Hardware. 2016-04-18.
  63. News: Alone together: my weird morning in a virtual reality chatroom. Stuart. Keith. 2016-03-24. The Guardian. en-GB. 0261-3077. 2016-04-18.
  64. Sterling. Bruce. Augmented Reality: Controlling music with Leapmotion Geco and Ableton (Hands Control). Wired. 5 January 2017. 6 November 2013.
  65. Web site: Controlling Music With Leap Motion Geco & Ableton. Synthtopia. 5 January 2017. 4 November 2013.
  66. https://www.nytimes.com/2013/07/25/technology/personaltech/no-keyboard-and-now-no-touch-screen-either.html Leap Motion Controller, Great Hardware in Search of Great Software
  67. Web site: Hutchinson. Lee. Hands-on with the Leap Motion Controller: Cool, but frustrating as hell. Ars Technica. Condé Nast. 2013-07-27.
  68. Web site: Leap Motion Launches With Limited Appeal, But It Could Be A Ticking Time Bomb Of Innovation.
  69. Web site: Leap Motion controller review.
  70. Web site: Leap Motion: As far as controllers go it's not a big leap forward... yet. 22 July 2013.
  71. Web site: Hands On: Leap Motion's Minority Report-style Gesture Controller Gets Smarter, Faster, And More Accurate. Kumparak. Greg. TechCrunch. 2016-04-18.
  72. Web site: Video Shows Huge Improvements in Leap Motion Tracking. Lang. Ben. Road to VR. 18 February 2016. en-US. 2016-04-18.
  73. Web site: Leap Motion's revamped hand tracking is getting built straight into VR headsets. Robertson. Adi. The Verge. 17 February 2016. 2016-04-18.