Optical head-mounted display explained

An optical head-mounted display (OHMD) is a wearable device that has the capability of reflecting projected images as well as allowing the user to see through it. In some cases, this may qualify as augmented reality (AR) technology. OHMD technology has existed since 1997 in various forms, but despite a number of attempts from industry, has yet to have had major commercial success.

Types

Various techniques have existed for see-through HMDs. Most of these techniques can be summarized into two main families: "Curved Mirror" (or Curved Combiner) based and "Waveguide" or "Light-guide" based. The curved mirror technique has been used by Vuzix in their Star 1200 product, by Olympus, and by Laster Technologies. Various waveguide techniques have existed for some time. These techniques include diffraction optics, holographic optics, polarized optics, and reflective optics:

• Diffractive waveguide – slanted diffraction grating elements (nanometric 10E-9). Nokia technique now licensed to Vuzix.
• Holographic waveguide – 3 holographic optical elements (HOE) sandwiched together (RGB). Used by Sony and Konica Minolta.
• Polarized waveguide – 6 multilayer coated (25–35) polarized reflectors in glass sandwich. Developed by Lumus.
• Reflective waveguide – A thick light guide with single semi-reflective mirror is used by Epson in their Moverio product. A curved light guide with partial-reflective segmented mirror array to out-couple the light is used by tooz technologies GmbH.^[1]
• "Clear-Vu" reflective waveguide – thin monolithic molded plastic w/ surface reflectors and conventional coatings developed by Optinvent and used in their ORA product.
• Switchable waveguide – developed by SBG Labs.

Input devices

Head-mounted displays are not designed to be workstations, and traditional input devices such as keyboards do not support the concept of smart glasses. Input devices that lend themselves to mobility and/or hands-free use are good candidates, for example:

• Touchpad or buttons
• Compatible devices (e.g. smartphones or control unit)
• Speech recognition
• Gesture recognition
• Eye tracking
• Brain–computer interface

Recent developments

2012

• On 17 April 2012, Oakley's CEO Colin Baden stated that the company has been working on a way to project information directly onto lenses since 1997, and has 600 patents related to the technology, many of which apply to optical specifications.^[2]
• On 18 June 2012, Canon announced the MR (Mixed Reality) System which simultaneously merges virtual objects with the real world at full scale and in 3D. Unlike the Google Glass, the MR System is aimed for professional use with a price tag for the headset and accompanying system is $125,000, with $25,000 in expected annual maintenance.^[3]

2013

• At MWC 2013, the Japanese company Brilliant Service introduced the Viking OS, an operating system for HMD's which was written in Objective-C and relies on gesture control as a primary form of input. It includes a facial recognition system and was demonstrated on a revamp version of Vuzix STAR 1200XL glasses ($4,999) which combined a generic RGB camera and a PMD CamBoard nano depth camera.^[4]
• At Maker Faire 2013, the startup company Technical Illusions unveiled castAR augmented reality glasses which are well equipped for an AR experience: infrared LEDs on the surface detect the motion of an interactive infrared wand, and a set of coils at its base are used to detect RFID chip loaded objects placed on top of it; it uses dual projectors at a framerate of 120 Hz and a retroreflective screen providing a 3D image that can be seen from all directions by the user; a camera sitting on top of the prototype glasses is incorporated for position detection, thus the virtual image changes accordingly as a user walks around the CastAR surface.^[5]

2016

• The Latvian-based company NeckTec announced the smart necklace form-factor, transferring the processor and batteries into the necklace, thus making facial frame lightweight and more visually pleasing.

2018

• Intel announces Vaunt, a set of smart glasses that are designed to appear like conventional glasses and are display-only, using retinal projection.^[6] The project was later shut down.^[7]
• Zeiss and Deutsche Telekom partners up to form tooz technologies GmbH to develop optical elements for smart glass displays.^{[8] [9]}

Market structure

Analytics company IHS has estimated that the shipments of smart glasses may rise from just 50,000 units in 2012 to as high as 6.6 million units in 2016.^[10] According to a survey of more than 4,600 U.S. adults conducted by Forrester Research, around 12 percent of respondents are willing to wear Google Glass or other similar device if it offers a service that piques their interest.^[11] Business Insider's BI Intelligence expects an annual sales of 21 million Google Glass units by 2018.^[12]

According to reliable reports, Samsung and Microsoft are expected to develop their own version of Google Glass within six months with a price range of $200 to $500. Samsung has reportedly bought lenses from Lumus, a company based in Israel. Another source says Microsoft is negotiating with Vuzix.^[13]

In 2006, Apple filed patent for its own HMD device.^[14]

In July 2013, APX Labs founder and CEO Brian Ballard stated that he knows of 25-30 hardware companies who are working on their own versions of smart glasses, some of which APX is working with.^[15]

Comparison of various OHMDs technologies

Combiner technology	Size	Eye box	FOV	Limits / Requirements	Example
Flat combiner 45 degrees	Thick	Medium	Medium	Traditional design	Vuzix, Google Glass
Curved combiner	Thick	Large	Large	Classical bug-eye design	Many products (see through and occlusion)
Phase conjugate material	Thick	Medium	Medium	Very bulky	OdaLab
Buried Fresnel combiner	Thin	Large	Medium	Parasitic diffraction effects	The Technology Partnership (TTP)
Cascaded prism/mirror combiner	Variable	Medium to Large	Medium	Louver effects	Lumus, Optinvent
Free form TIR combiner	Medium	Large	Medium	Bulky glass combiner	Canon, Verizon & Kopin (see through and occlusion)
Diffractive combiner with EPE	Very thin	Very large	Medium	Haze effects, parasitic effects, difficult to replicate	Nokia / Vuzix
Holographic waveguide combiner	Very thin	Medium to Large in H	Medium	Requires volume holographic materials	Sony
Holographic light guide combiner	Medium	Small in V	Medium	Requires volume holographic materials	Konica Minolta
Combo diffuser/contact lens	Thin (glasses)	Very large	Very large	Requires contact lens + glasses	Innovega & EPFL
Tapered opaque light guide	Medium	Small	Small	Image can be relocated	Olympus

See also

• Epiphany Eyewear
• EyeTap
• Golden-i
• Open Cobalt
• Recon Instruments
• SixthSense
• Smartglasses
• Virtual retinal display

Further reading

• 3D VIS Lab, University of Arizona – "Head-Mounted Display Systems" by Jannick Rolland and Hong Hua
• Optinvent – "Key Challenges to Affordable See Through Wearable Displays: The Missing Link for Mobile AR Mass Deployment" by Kayvan Mirza and Khaled Sarayeddine
• Comprehensive Review article – "Head-Worn Displays: A Review" by Ozan Cakmakci and Jannick Rolland
• Google Inc. – "A review of head-mounted displays (HMD) technologies and applications for consumer electronics" by Bernard Kress & Thad Starner (SPIE proc. # 8720, 31 May 2013)

Notes and References

1. Web site: tooz technologies. 2022-01-26. Tooz. de.
2. News: Oakley Tests Technology That Would Rival Google's Project Glass. bloomberg.com. 17 April 2012. Mark. Milian.
3. News: 3D evolved: Hands-on with Canon's MREAL virtual reality system. digitaltrends.com. 21 February 2013.
4. News: Dual-Eye Augmented Reality Goggles Recognize Faces, Gestures. Laptop Mag . Avram . Piltch . 25 February 2013.
5. News: How two Valve engineers walked away with the company's augmented reality glasses. The Verge. 18 May 2013 . Sean . Hollister.
6. Web site: 5 February 2018. Intel is making smart glasses that actually look good. The Verge . Dieter . Bohn.
7. Web site: Bohn. Dieter. 2018-04-18. Intel is giving up on its smart glasses. 2019-11-08. The Verge. en.
8. News: Deutsche Telekom pairs up with Zeiss in smart glasses startup. Bloomberg.com. 7 February 2018 .
9. Web site: ZEISS and Telekom Strengthen Commitment to Smart Glasses in Joint Venture. 2022-01-24. Zeiss . en . 6 February 2018.
10. News: Spurred by Google Glass, IHS Forecasts Nearly 10 Million Smart Glasses to Ship from 2012 to 2016. IHS.com. 24 April 2013.
11. News: 21.6 million geeky Americans want Google Glass right now. bizjournals.com. 21 June 2013.
12. News: BI INTELLIGENCE FORECAST: Google Glass Will Be An $11 Billion Market By 2018. businessinsider.com. 21 May 2013.
13. News: Microsoft, Samsung developing high-tech specs to rival Google Glass. nypost.com. 15 May 2013. Garett. Sloane.
14. News: Take That, Google Glass: Apple Granted Patent for Head-Mounted Display. Wired.com. 7 March 2013. Christina. Bonnington.
15. News: Before Google Glass, there was Terminator Vision. Now its maker focuses on enterprise. Pando Daily. 12 July 2013 . Hamish . McKenzie . https://web.archive.org/web/20130714061010/https://pandodaily.com/2013/07/12/before-google-glass-there-was-terminator-vision-now-its-maker-focuses-on-enterprise/ . 2013-07-14 . dead.