Microsoft HoloLens explained

Microsoft HoloLens should not be confused with Microsoft HoloLens 2.

Microsoft HoloLens
Aka:Project Baraboo (during the development period)
Developer:Microsoft
Manufacturer:Microsoft
Family:Windows 10
Type:Mixed reality augmented reality head-mounted display smartglasses
Generation:2
Os:Windows Mixed Reality
Cpu:Intel Atom x5-Z8100 (1GHz)
Memory:
  • 2 GB RAM
  • 1 GB HPU RAM
Storage:64 GB (flash memory)
Display:2.3 megapixel widescreen head-mounted display
Sound:Spatial sound technology
Input:
Controllers:Gestural commands via sensors and HPU
Camera:2.4 MP
Touchpad:Side Panel
Platform:Windows 10
Weight:579 g (1.28 lb)
Successor:HoloLens 2
Releasedate:
  • (Development Edition)
  • N/A (Consumer version)
Price:$3,000[1]
$5,000 (Commercial Suite)

Microsoft HoloLens is an augmented reality (AR)/mixed reality (MR) headset developed and manufactured by Microsoft. HoloLens runs the Windows Mixed Reality platform under the Windows 10 operating system. Some of the positional tracking technology used in HoloLens can trace its lineage to the Microsoft Kinect, an accessory for Microsoft's Xbox 360 and Xbox One game consoles that was introduced in 2010.[2]

The pre-production version of HoloLens, the Development Edition, shipped on March 30, 2016, and is targeted to developers in the United States and Canada for a list price of $3000[3] [4] which allowed hobbyist, professionals, and corporations to participate in the pre-production version of HoloLens.[5] Samsung and Asus have extended an offer to Microsoft to help produce their own mixed-reality products, in collaboration with Microsoft, based around the concept and hardware on HoloLens.[6] [7] On October 12, 2016, Microsoft announced global expansion of HoloLens and publicized that HoloLens would be available for preorder in Australia, Ireland, France, Germany, New Zealand and the United Kingdom.[8] There is also a commercial suite (similar to a pro edition of Windows), with enterprise features such as BitLocker security. As of May 2017, the suite sold for US$5,000.[9] Microsoft has decided to rent the Hololens without clients making the full investment. Microsoft partners with a company called Absorbents to give the service of HoloLens rental.[10]

HoloLens 2 was announced at the Mobile World Congress (MWC) in Barcelona, Spain, on February 24, 2019,[11] and was available on preorder at $3,500.[12] [13]

Description

The HoloLens is a head-mounted display unit connected to an adjustable, cushioned inner headband, which can tilt HoloLens up and down, as well as forward and backward.[14] To wear the unit, the user fits the HoloLens on their head, using an adjustment wheel at the back of the headband to secure it around the crown, supporting and distributing the weight of the unit equally for comfort,[15] before tilting the visor towards the front of the eyes.

The front of the unit houses many of the sensors and related hardware, including the processors, cameras and projection lenses. The visor is tinted; enclosed in the visor piece is a pair of transparent combiner lenses, in which the projected images are displayed in the lower half.[16] The HoloLens must be calibrated to the interpupillary distance (IPD), or accustomed vision of the user.[17] [18]

Along the bottom edges of the side, located near the user's ears, are a pair of small, red 3D audio speakers. The speakers, competing against typical sound systems, do not obstruct external sounds, allowing the user to hear virtual sounds, along with the environment. Using head-related transfer functions, the HoloLens generates binaural audio, which can simulate spatial effects; meaning the user, virtually, can perceive and locate a sound, as though it is coming from a virtual pinpoint or location.[19] [20]

On the top edge are two pairs of buttons: display brightness buttons above the left ear, and volume buttons above the right ear.[21] Adjacent buttons are shaped differently—one concave, one convex—so that the user can distinguish them by touch.

At the end of the left arm is a power button and row of five, small individual LED nodes, used to indicate system status, as well as for power management, indicating battery level and setting power/standby mode. A USB 2.0 micro-B receptacle is located along the bottom edge. A 3.5 mm audio jack is located along the bottom edge of the right arm.[4]

Hardware

The HoloLens is a first generation AR device. The displays on the HoloLens are simple waveguide displays with a fixed focus of approximately two meters. Because of the fixed focus, the displays exhibit the Vergence-Accommodation Conflict.[22]

The HoloLens features an inertial measurement unit (IMU) (which includes an accelerometer, gyroscope, and a magnetometer)[23] four "environment understanding" sensors (two on each side), an energy-efficient depth camera with a 120°×120° angle of view,[24] a 2.4-megapixel photographic video camera, a four-microphone array, and an ambient light sensor.[4] [25]

In addition to an Intel Cherry Trail SoC containing the CPU and GPU,[26] HoloLens features a custom-made Microsoft Holographic Processing Unit (HPU),[4] a coprocessor manufactured specifically for the HoloLens by Microsoft. The SoC and the HPU each have 1GB LPDDR3 and share 8MB SRAM, with the SoC also controlling 64GB eMMC and running the Windows 10 operating system. The HPU uses 28 custom DSPs from Tensilica[27] to process and integrate data from the sensors, as well as handling tasks such as spatial mapping, gesture recognition, and voice and speech recognition.[16] According to Alex Kipman, the HPU processes "terabytes of information". One attendee estimated that the display field of view of the demonstration units was 30°×17.5°.[28] In an interview at the 2015 Electronic Entertainment Expo in June, Microsoft Vice-President of Next-Gen Experiences, Kudo Tsunoda, indicated that the field of view is unlikely to be significantly different on release of the current version.[29]

The HoloLens contains an internal rechargeable battery, with average life rated at 2–3 hours of active use, or 2 weeks of standby time. The HoloLens can be operated while charging.[4]

HoloLens features IEEE 802.11ac Wi-Fi and Bluetooth 4.1 Low Energy (LE) wireless connectivity. The headset uses Bluetooth LE to pair with the included Clicker, a thumb-sized finger-operating input device that can be used for interface scrolling and selecting. The Clicker features a clickable surface for selecting, and an orientation sensor which provides for scrolling functions via tilting and panning of the unit. The Clicker features an elastic finger loop for holding the device, and a USB 2.0 micro-B receptacle for charging its internal battery.[30]

The HoloLens core display has been integrated into hard hat hardware systems.[31]

Applications

Since 2016, a number of augmented-reality applications have been showcased for the HoloLens. Some of the applications that were available at launch included:

Other applications announced or showcased for HoloLens include:

Interface

The HoloLens uses voice commands, gaze, hand gestures, and a controller as the primary input methods.[69] Gaze commands, such as head-tracking, allows the user to bring application focus to whatever the user is perceiving.[70] "Elements"—or any virtual application or button—are selected using an air tap method, similar to clicking an imaginary computer mouse. The tap can be held for a drag simulation to move an element, as well as voice commands for certain commands and actions.

The HoloLens shell carries over and adapts many elements from the Windows desktop environment. A "bloom" gesture for accessing the shell (performing a similar function to pressing a Windows key on a Windows keyboard or tablet, or the Xbox button on an Xbox One Controller) is performed by opening one's hand, fingers spread with the palm facing up.[71] [72] Windows can be dragged to a particular position, as well as resized. Virtual elements such as windows or menus can be "pinned" to locations, physical structures or objects within the environment; or can be "carried", or fixed in relation to the user, following the user as they move around.[73] Title bars for application windows have a title on the left, and buttons for window management functions on the right.

In April 2016 Microsoft created the Microsoft HoloLens App for Windows 10 PCs and Windows 10 Mobile devices. The app allows developers to run apps on the HoloLens, use cell phone or computer keyboards for text input, view streamed video from the HoloLens on an external device, and remotely capture mixed reality photos and videos.

Developing applications for HoloLens

Microsoft Visual Studio is an IDE that can be used to develop applications (both 2D and 3D) for HoloLens. Applications can be tested using HoloLens emulator (included into Visual Studio 2015 IDE) or HoloLens Development Edition.

2D applications

HoloLens can run almost all Universal Windows Platform apps.[74] These apps appear as 2D projections. Not all Windows 10 APIs are currently supported by HoloLens,[75] but in most cases the same app is able to run across all Windows 10 devices (including HoloLens), and the same tools that are used to develop applications for Windows PC or Windows Phone can be used to develop a HoloLens app.

3D applications

3D applications, or "holographic" applications, use Windows Holographic APIs. Microsoft recommends Unity engine and Vuforia to create 3D apps for HoloLens, but it's also possible for a developer to build their own engine using DirectX and Windows APIs.[76]

Criticism

See also: Integrated Visual Augmentation System. In November 2018 Microsoft got a contract for the supply of 100,000 HoloLens MR glasses, worth $479 million, to the U.S. military.[77] The MR goggles are intended to provide "increased lethality, mobility, and situational awareness necessary to achieve overmatch against [...] current and future adversaries." Just before the opening of one of the largest international technology conferences—the GSMA Mobile World Congress 2019 in Barcelona—fifty Microsoft employees wrote a letter to their CEO Satya Nadella and President Brad Smith stating that they "refuse to develop technologies for warfare and oppression". They demanded that corporate management terminate the contract.[78]

See also

External links

Notes and References

  1. News: Pandher. Gurmeet Singh. Microsoft HoloLens Preorders: Price, Specs Of The Augmented Reality Headset.. The Bitbag. March 2, 2016. April 1, 2016. https://web.archive.org/web/20160304102828/http://www.thebitbag.com/microsoft-hololens-preorders-price-specs-of-the-augmented-reality-headset/137410. March 4, 2016. dead.
  2. News: Mcbride. Sarah. With HoloLens, Microsoft aims to avoid Google's mistakes. May 23, 2016. Reuters. May 23, 2016.
  3. Web site: Microsoft announces Windows Holographic with HoloLens headset. Shaban. Hamza. September 2, 2014. The Verge. January 21, 2015.
  4. Web site: Introducing the Microsoft HoloLens Development Edition. Microsoft. We will work to get devices out as quickly as possible. As soon as additional devices are available, more accepted applicants will be invited to purchase.. October 7, 2015.
  5. Web site: Announcing Microsoft HoloLens Development Edition open for pre-order, shipping March 30. February 29, 2016.
  6. Web site: Samsung seeks partnership with Microsoft for hololens. May 13, 2015. The Korea Times. Kim Yoo-chul. December 7, 2015.
  7. Web site: Asus mulls HoloLens augmented-reality glasses of its own. October 19, 2015. Wearable Tech. CNET. Tibken. Shara. December 7, 2015. https://web.archive.org/web/20160416104502/http://www.cnet.com/news/asus-may-release-hololens-augmented-reality-glasses-of-its-own/. April 16, 2016. dead.
  8. News: Microsoft announces global expansion for HoloLens. October 12, 2016. Microsoft News Centre Australia. en-US. October 16, 2016.
  9. Web site: Buy Microsoft HoloLens Commercial Suite - Microsoft Store . Microsoft Store. en . 2017-05-05.
  10. News: Microsoft's HoloLens is now available to rent. Lucas. Matney. 14 February 2018. Techcrunch.
  11. Web site: Microsoft's new $3,500 HoloLens 2 headset means business. cnn.com. February 24, 2019. February 25, 2019.
  12. Web site: HoloLens 2 pricing and preorder. 2019-02-24. Microsoft.
  13. Web site: HoloLens 2 AR announced for $3,500, available to preorder now, ships later this year. 2019-02-24. CNET.
  14. Web site: HoloLens hands-on: Building for Windows Holographic. May 1, 2015. SlashGear. That means very little pressure on your nose, and even if you’re wearing glasses you can generally find a workable way to keep them on underneath.. Davies. Chris. May 1, 2015.
  15. Web site: Microsoft Hololens hardware. Microsoft. May 1, 2015.
  16. Developing for HoloLens. April 30, 2015. Microsoft. 00:07:15. May 1, 2015. HoloLens is the first—and so far—only holographic computer out there. [...] I hope that in the not-so-distant future there will be many such devices. [...] This is running Windows 10. All of the APIs for human and environment understanding are part of Windows, and this version of Windows that we put on this device—we call it Windows Holographic.. Alex Kipman, Seth Juarez.
  17. Web site: Developing with HoloLens: Decent hardware chases Microsoft's lofty augmented reality ideal. May 1, 2015. PC World. Hachman. Mark. May 1, 2015.
  18. Web site: Microsoft HoloLens Hands-On: Incredible, Amazing, Prototype-y as Hell. January 21, 2015. One Microsoft employee [...] typed my IPD (interpupillary distance) into a connected PC. Microsoft says the final version will automatically measure the distnace [''[[sic]]] between your eyes, but the prototypes don’t have that feature yet.. Hollister. Sean. May 1, 2015.
  19. Microsoft HoloLens: The Science Within - Spatial Sound with Holograms. February 29, 2016. Microsoft. March 7, 2016.
  20. See also: 3D audio effect, virtual surround, psychoacoustics
  21. Web site: HoloLens: Still magical, but with the ugly taint of reality. May 1, 2015. Ars Technica. Bright. Peter. May 2, 2015.
  22. Web site: Comfort - Mixed Reality . 2022-09-22 . learn.microsoft.com . en-us.
  23. Web site: BUILD 2015: A closer look at the Microsoft HoloLens hardware. April 30, 2015. Microsoft Devices Blog. This custom silicon efficiently processes data from the sensors, resulting in a relatively simple yet informative output that can be easily used by developers so they can focus on creating amazing experiences without having to work through complex physics calculations.. Holmdahl. Todd. February 29, 2016.
  24. Project HoloLens: Our Exclusive Hands-On With Microsoft's Holographic Goggles. January 21, 2015. Wired. Condé Nast. Hempel. Jessi. January 22, 2015.
  25. http://www.windowscentral.com/microsoft-hololens-processor-storage-and-ram Microsoft HoloLens - Here are the full processor, storage and RAM specs
  26. News: Colaner. Seth. What's Inside Microsoft's HoloLens And How It Works. August 23, 2016. Tom's Hardware. August 23, 2016.
  27. News: Bright. Peter. Microsoft sheds some light on its mysterious holographic processing unit. August 24, 2016. Ars Technica. August 23, 2016.
  28. Web site: On the road for VR: Microsoft HoloLens at Build 2015, San Francisco. May 1, 2015. Doc-Ok.org. As I was stripped of all devices and gadgets before being allowed into the demo room, I had to guesstimeasure it by covering the visible screen with my hands (fingers splayed) at arm’s length, ending up with 1 3/4 hands horizontally, and 1 hand vertically (in other words, a 16:9 screen aspect ratio) (see Figure 1). In non-Doc-Ok units, that comes out to about 30° by 17.5° (for comparison, the Oculus Rift DK2′s field of view is about 100° by 100°).. Kreylos. Oliver. June 17, 2015.
  29. Giant Bomb LIVE! at E3 2015: Day 01. June 16, 2015. 3:13:06. July 4, 2015. the hardware we have now [...] the field of view isn't exactly final, but I wouldn't say it's going to be [...] hugely, noticeably different, either.. Jeff Gerstmann, Phil Spencer, Kudo Tsunoda.
  30. Web site: Working with accessories. Windows Dev Center. March 7, 2016. dead. https://web.archive.org/web/20160308054651/https://dev.windows.com/en-us/holographic/working_with_accessories. March 8, 2016. mdy-all.
  31. Web site: Trimble XR10 with HoloLens 2. 14 Oct 2022.
  32. Microsoft HoloLens: HoloStudio. February 29, 2016. Microsoft. March 7, 2016.
  33. Web site: These are the first apps and games for Microsoft's HoloLens. 2016-02-29. The Verge. 2017-05-19.
  34. Web site: CAE VimedixAR transforms medical education with Microsoft HoloLens. Microsoft. August 31, 2017.
  35. Microsoft HoloLens: Skype. February 29, 2016. Microsoft. March 7, 2016.
  36. Web site: HoloLens HoloTour HoloForge. www.holoforge.io. 2019-11-10.
  37. Web site: Microsoft HoloLens apps. Microsoft. March 7, 2016.
  38. Microsoft HoloLens: Fragments. February 29, 2016. Microsoft. March 7, 2016.
  39. Microsoft HoloLens: Young Conker. February 29, 2016. Microsoft. March 7, 2016.
  40. Web site: HoloLens' Project X-Ray delivers a first-person augmented reality shooter. June 16, 2015. Polygon. Vox Media. Crecente. Brian. June 28, 2015.
  41. Web site: Microsoft HoloLens Launch Games, Apps Detailed. February 28, 2016. Fortune. Gaudiosi. John. March 7, 2016.
  42. Web site: Introducing first ever experiences for the Microsoft HoloLens Development Edition. February 29, 2016. Microsoft Devices Blog. Microsoft. Tsunoda. Kudo. March 7, 2016.
  43. Web site: Microsoft Wins $480m Military Contract to Outfit Soldiers with HoloLens AR Tech. November 29, 2018 . Techcrunch . Matney . Lucas . November 30, 2018.
  44. Web site: News - Jagiellonian University - Jagiellonian University . 2022-05-10 . en.uj.edu.pl.
  45. Web site: Poland's Jagiellonian University Medical College brings the Microsoft HoloLens 2 into the classroom . 2022-05-10 . Microsoft Customers Stories . en.
  46. Microsoft HoloLens: Partner Spotlight with Case Western Reserve University. July 8, 2015. Microsoft. July 9, 2015.
  47. Web site: Case Western Reserve, Cleveland Clinic Collaborate with Microsoft on 'Earth-Shattering' Mixed-Reality Technology for Education. April 29, 2015. Case Western Reserve University. July 9, 2015.
  48. Web site: Scott. Mike. Building The First Holographic Brain 'Atlas'. Neuroscience News. November 8, 2019. Case Western Reserve. 27 October 2020.
  49. Web site: Trimble's SketchUp Viewer marks first commercial app for HoloLens in the Windows Store. November 7, 2016. MSPoweruser.
  50. Web site: Halo 5 headlines greatest holiday games lineup in Xbox history. June 15, 2015. Microsoft News Center. Microsoft. June 15, 2015.
  51. E3 2015 Media Briefing. June 15, 2015. Microsoft. 01:13:36. August 23, 2015. Kudo Tsunoda, Lydia Winters, Sax Persson.
  52. Our journey together. July 13, 2015. 42:42. July 15, 2015. Satya Nadella, Lorraine Bardeen, Dan McCulloch.
  53. Web site: NASA, Microsoft Collaborate to Bring Science Fiction to Science Fact. June 25, 2015. Ramsey. Sarah. Jet Propulsion Laboratory. June 28, 2015.
  54. A Cloud-based Architecture for Processing 3D Mars Terrain. January 23, 2016. Linux Expo of Southern California Inc.. February 17, 2016. ...but the rover moves everyday, and we wanted this tool to be useful operationally, so we actually needed to, not just do this once, but we needed a way to create these scenes easily and automatically as the rover moves, and new imagery is downlinked.. Parker Abercrombie. Ballroom A, Pasadena Convention Center. A Cloud-based Architecture for Processing 3D Mars Terrain. Parker. Abercrombie. January 23, 2016. SCaLE 14x — The Fourteenth Annual Southern California Linux Expo. https://www.socallinuxexpo.org/scale/14x. February 17, 2016.
  55. Web site: NASA, Microsoft Collaboration Will Allow Scientists to 'Work on Mars'. January 21, 2015. Northon. Karen. Jet Propulsion Laboratory. January 22, 2015.
  56. Windows 10: The Next Chapter. January 21, 2015. Microsoft. 01:36:53. January 22, 2015. Terry Myerson, Alex Kipman, Jeff Norris, Satya Nadella. April 12, 2015. https://web.archive.org/web/20150412031218/https://ll.ms-studiosmedia.com/events/2015/1501/Windows10CP/live/Windows10CP.html. dead. Web site: Satya Nadella, Terry Myerson, Joe Belfiore and Phil Spencer: Windows 10 Briefing. January 21, 2015. News Center. Microsoft. March 6, 2015. https://web.archive.org/web/20150318073724/http://news.microsoft.com/speeches/satya-nadella-terry-myerson-joe-belfiore-and-phil-spencer-windows-10-briefing/. March 18, 2015. dead.
  57. Web site: Microsoft HoloLens + Autodesk Fusion 360 = Mixed Reality for Product Design and Engineering [VIDEO]]. November 30, 2015. In the Fold. Autodesk. Gardiner. Garin. December 7, 2015.
  58. Web site: Galaxy Explorer. https://web.archive.org/web/20160301050834/https://microsoftstudios.com/hololens/shareyouridea/galaxy-explorer/. dead. March 1, 2016. Microsoft Studios. Microsoft. February 17, 2016.
  59. Web site: Announcing the Microsoft HoloLens 'Share Your Idea' campaign. December 1, 2015. Building Apps for Windows. Microsoft. February 17, 2016.
  60. Vision Summit 2016 Keynote. February 10, 2016. Unity Technologies. 57:26. February 17, 2016. It's a new application under development in my lab, and we're talking about it publicly for the first time today. It's a tool for spacecraft designers, and it borrows a lot of technology from the work that we're doing for our applications on the International Space Station.. Jeff Norris. Ray Dolby Ballroom, Dolby Theatre.
  61. News: Dina. Bass. Microsoft, Volvo Car to Bring Augmented Reality Into Showrooms. Bloomberg News. November 20, 2015 . November 20, 2015.
  62. Web site: CAE Healthcare announces first mixed reality ultrasound simulation solution with Microsoft HoloLens. Healthcare Scene News. January 27, 2017. April 3, 2017.
  63. News: Holoportation - Microsoft Research. Microsoft Research. 2017-06-20.
  64. News: Microsoft HoloLens helps Spanish doctors cut surgery time in half. 2017-10-23.
  65. https://www.imperial.ac.uk/news/197617/mixed-reality-headsets-hospitals-help-protect-doctors/ Mixed-reality headsets in hospitals help protect doctors and reduce need for PPE
  66. Moro. Christian. Phelps. Charlotte. Redmond. Petrea. Stromberga. Zane. 2021. HoloLens and mobile augmented reality in medical and health science education: A randomised controlled trial. British Journal of Educational Technology. en. 52. 2. 680–694. 10.1111/bjet.13049. 229433413. 1467-8535.
  67. Moro. Christian. Phelps. Charlotte. Jones. Dominique. Stromberga. Zane. 2020. Using Holograms to Enhance Learning in Health Sciences and Medicine. Medical Science Educator. en. 30. 4. 1351–1352. 10.1007/s40670-020-01051-7. 2156-8650. 8368738. 34457800.
  68. https://www.sarahmeyohas.com/dawnchorus
  69. Web site: Development overview. Windows Dev Center. Microsoft. March 1, 2016. dead. https://web.archive.org/web/20160308061545/https://dev.windows.com/en-US/holographic/development_overview. March 8, 2016. mdy-all.
  70. Microsoft HoloLens: Gaze Input. February 29, 2016. Microsoft. March 7, 2016.
  71. Web site: Restart: Microsoft in the age of Satya Nadella. January 21, 2015. Wired. Each lens has three layers of glass—in blue, green, and red—full of microthin corrugated grooves that diffract light. [...] A "light engine" above the lenses projects light into the glasses, where it hits the grating and then volleys between the layers of glass millions of times.. Hempel. Jessi. January 22, 2015.
  72. Web site: Gestures. Windows Dev Center. March 7, 2016.
  73. Microsoft HoloLens: What is a hologram?. February 29, 2016. Microsoft. March 7, 2016.
  74. Web site: Building 2D apps.
  75. Web site: Current limitations for apps using APIs from the shell. December 11, 2016. December 20, 2016. https://web.archive.org/web/20161220103803/https://developer.microsoft.com/en-us/windows/holographic/. dead.
  76. Web site: Development overview.
  77. Web site: Joshua Brustein: Microsoft Win's $480 Million Army Battlefield Contract . 2019-02-23 . Bloomberg.com.
  78. News: Glaser . April . Microsoft Workers Say the Company Is War Profiteering, and They've Timed Their Protest to Hurt . 2020-11-15 . Slate Magazine . 2019-02-22 . en.

This article is licensed under the GNU Free Documentation License. It uses material from the Wikipedia article "Microsoft HoloLens".

Except where otherwise indicated, Everything.Explained.Today is © Copyright 2009-2024, A B Cryer, All Rights Reserved. Cookie policy.